auditory cortical monitoring prevents speech errors before they happen caroline a. niziolek ucsf...

Post on 11-Jan-2016

213 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Auditory cortical monitoring prevents speech errors

before they happen

Caroline A NiziolekUCSF Depts of Radiology and Otolaryngology ndash Head and Neck

SurgeryBiomagnetic Imaging LaboratorySpeech Neuroscience Laboratory

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

deafness

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The Speech Chain

Denes amp Pinson 1993

deafnessdecrease in intelligibility

frontal motor lesion

perceptualdeficits

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

MEG fMRI ECoG

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

Houde Niziolek et al 2014 ISSPMEG fMRI ECoG

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory feedback causes compensatory changes in our

speech output

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory feedback causes compensatory changes in our

speech output

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

e

f0 (pitch)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eformant

s(vowel)

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Focal acoustic changesevoke focal compensation

frequency

am

plit

ud

eamplitude (loudness

)

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Chang Niziolek et al 2013 PNAS

f0 shift during vocalization

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

f0 shift of emphatic stress

f0 c

ontr

ast

dist

ance

Patel et al 2011 JSLHR

ampl c

ontr

ast

dist

ance

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

>
>

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Niziolek amp Guenther 2013 J NeurosciNiziolek amp Guenther 2014 Frontiers for Kids

x y

frequencyam

plitu

de

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Real-time formant alteration

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Greater compensation to vowels shifted across a boundary

Niziolek amp Guenther 2013 J Neurosci

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Enhanced auditory error to shifts across a boundary

Niziolek amp Guenther 2013 J Neurosci

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Chang Niziolek et al 2013 PNAS Niziolek amp Guenther 2013 J Neurosci

f0 formants

Patel et al 2011 JSLHR

f0 c

on

tra

ct d

ista

nce

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Neural responses to feedback

Chang Niziolek et al 2013 PNAS

NO

RM

AL

ALT

ER

ED

ltfeedback match

suppression

feedback mismatch

no suppression

ge

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory cortical neurons are suppressed during speech but only when the feedback matches what is expected

What causes this selective suppression Can it be used for error detection

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Models of speech motor control

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

Models of speech motor control

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

CONTROLLER premotor

motor cortex

OUTPUTvocal tract articulators

COMPARISONauditory cortex

auditory signal

internal prediction

corrective error signal

Models of speech motor control

motorcommand

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Artificially-altered feedback

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

release from suppression

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Artificially-altered feedback

Chang Niziolek et al 2013 PNAS

change in speech output

release from suppression

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Are these error-correction processes at work

in natural speech

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Multi-vowel task

eatspeak Ed add

listen eat Ed add

Niziolek et al 2013 J Neurosci

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Auditory M100

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Owen et al 2012 NeuroImageNiziolek et al 2013 J Neurosci

Source localization Champagne

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Vowel spacecenter vs periphery

Niziolek et al 2013 J Neurosci

ldquoeatrdquo

ldquoEdrdquo

ldquoaddrdquo

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Are peripheral productions processed as errors

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center periphery

F1

F2

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center periphery

F1

F2

predict variability

off center = expected

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Individual subjectdecrease in suppression

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Decrease in suppression isconsistent in left AC

p = 0002

Niziolek et al 2013 J Neurosci

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Decrease in suppression isconsistent in left AC

Niziolek et al 2013 J Neurosci

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

center

center

periphery

periphery

F1

F2

predict variability

off center = expected

donrsquot predict variability off center = error

WINNER

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

acoustic distance

decrease in suppression prop

Niziolek et al 2013 J Neurosci

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Suppressionfalls off at the

vowel periphery

Niziolek et al 2013 J Neurosci

Fall-offincreases with

acoustic distance

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Acoustic error is coded by auditory suppression

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

The efferent prediction may reflect an acoustic

target or goal

(not merely a ldquocopyrdquoof motor commands)

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull How does auditory feedback affect speech output

bull How do we detect deviations from what we intend to say

bull What is the corrective behavior when a deviation is detected

Understanding speech production via perception

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Does error-like processing have behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Behavioral consequences

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Behavioral consequences

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Behavioral consequences

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Behavioral consequences

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J NeurosciBehavioral consequences

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

If centering is partly driven by auditory feedback it should

bull correlate with cortical responses to feedback

bull decrease when you canrsquot hear yourself (ie in masking noise)

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Centering correlates with suppressionNiziolek et al 2013 J Neurosci

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Masking noise reduces centering

Niziolek et al submitted

quiet

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Masking noise reduces centering

quiet masking noise

Niziolek et al submitted

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Masking noise reduces centering

quiet masking noise

Implications for hearing loss

Niziolek et al submitted

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

We detect deviations from an expected

targetDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

We correct our deviations before they

become errorsDecreased suppression ongoing error detection process (we make ldquoerrorsrdquo all the time)

Centering ongoing error correction process (partly mediated by feedback)

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Ongoing amp future directions

Assess error detection and correction capacities in patients with speech disorders

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

center periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Speech error detection and correction in aphasia

center

center

periphery

periphery

F1

F2detection impaired

detection preserved

sensory feedbacktraining

motor skilltraining

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Ongoing amp future directions

How task-specific is the perceived error

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Niziolek et al in prep

Redefining center and periphery

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Sort by formant

Niziolek et al in prep

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by formant

Sort by pitch

Redefining center and periphery

F1

F2

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Multi-pitch task

Niziolek et al in prep

eatspeak eat eat

listen eat eat eat

z x cz x c

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Owen et al 2012 NeuroImageNiziolek et al in prep

Source localization right hemi

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by pitch

Pitch task auditory suppression

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by pitch

Pitch task auditory suppression

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 0048

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

F0

Sort by formant

Sort by pitch

Pitch task auditory suppression

F1

F2

Niziolek et al in prep

p = 027

(ns)

p = 0048

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Task-specific suppression

F0

formant

pitch

F1F2

vowel task

pitchtask

(ns)

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Pitch centering

Niziolek et al in prep

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Pitch centering

Niziolek et al in prep

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Niziolek et al in prep

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull Altered auditory feedback causes compensatory changes to speech output

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

Understanding speech production via perception

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

bull Altered auditory feedback causes compensatory changes to speech output

bull Degree of auditory cortical suppression allows us to detect deviations from what we intend to say

bull This suppression may underlie a corrective behavior that serves to bring speech back on track

Understanding speech production via perception

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Thank you

NIH F32DC011249NIH R01DC010145NSF BCS0926196

Frank GuentherJohn Houde

Sri NagarajanEddie Chang

Danielle MizuiriSusanne Honma

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Decrease in suppressionin both speak and listen

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

No systematic changesin suppression in right AC

Niziolek et al 2013 J Neurosci

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

Anti-centering

masking noise Niziolek et al in prep

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

ldquoSIS falloffrdquo across acoustic space

Niziolek et al 2013 J Neurosci

  • Auditory cortical monitoring prevents speech errors before they
  • The Speech Chain
  • The Speech Chain (2)
  • The Speech Chain (3)
  • The Speech Chain (4)
  • The Speech Chain (5)
  • The Speech Chain (6)
  • The Speech Chain (7)
  • The Speech Chain (8)
  • Understanding speech production via perception
  • Understanding speech production via perception (2)
  • Understanding speech production via perception (3)
  • Understanding speech production via perception (4)
  • Understanding speech production via perception (5)
  • Understanding speech production via perception (6)
  • Understanding speech production via perception (7)
  • Understanding speech production via perception (8)
  • Understanding speech production via perception (9)
  • Understanding speech production via perception (10)
  • Auditory feedback causes compensatory changes in our speech out
  • Auditory feedback causes compensatory changes in our speech out (2)
  • Auditory feedback causes compensatory changes in our speech out (3)
  • Focal acoustic changes evoke focal compensation
  • Focal acoustic changes evoke focal compensation (2)
  • Focal acoustic changes evoke focal compensation (3)
  • Focal acoustic changes evoke focal compensation (4)
  • Slide 27
  • Slide 28
  • Slide 29
  • Real-time formant alteration
  • Real-time formant alteration (2)
  • Real-time formant alteration (3)
  • Real-time formant alteration (4)
  • Real-time formant alteration (5)
  • Real-time formant alteration (6)
  • Real-time formant alteration (7)
  • Real-time formant alteration (8)
  • Real-time formant alteration (9)
  • Real-time formant alteration (10)
  • Real-time formant alteration (11)
  • Real-time formant alteration (12)
  • Real-time formant alteration (13)
  • Real-time formant alteration (14)
  • Real-time formant alteration (15)
  • Real-time formant alteration (16)
  • Greater compensation to vowels shifted across a boundary
  • Enhanced auditory error to shifts across a boundary
  • Slide 48
  • Understanding speech production via perception (11)
  • Understanding speech production via perception (12)
  • Neural responses to feedback
  • Neural responses to feedback (2)
  • Neural responses to feedback (3)
  • Neural responses to feedback (4)
  • Neural responses to feedback (5)
  • Auditory cortical neurons are suppressed during speech but onl
  • Auditory cortical neurons are suppressed during speech but onl (2)
  • Models of speech motor control
  • Models of speech motor control (2)
  • Models of speech motor control (3)
  • Models of speech motor control (4)
  • Models of speech motor control (5)
  • Models of speech motor control (6)
  • Models of speech motor control (7)
  • Models of speech motor control (8)
  • Artificially-altered feedback
  • Artificially-altered feedback (2)
  • Artificially-altered feedback (3)
  • Are these error-correction processes at work in natural speech
  • Multi-vowel task
  • Auditory M100
  • Source localization Champagne
  • Vowel space center vs periphery
  • Vowel space center vs periphery (2)
  • Are peripheral productions processed as errors
  • Slide 76
  • Slide 77
  • Slide 78
  • Slide 79
  • Slide 80
  • Slide 81
  • Slide 82
  • Slide 83
  • Individual subject decrease in suppression
  • Decrease in suppression is consistent in left AC
  • Decrease in suppression is consistent in left AC (2)
  • Slide 87
  • Slide 88
  • acoustic distance
  • acoustic distance (2)
  • acoustic distance (3)
  • acoustic distance (4)
  • acoustic distance (5)
  • acoustic distance (6)
  • acoustic distance (7)
  • Slide 96
  • Slide 97
  • The efferent prediction may reflect an acoustic target or goal
  • Understanding speech production via perception (13)
  • Understanding speech production via perception (14)
  • Does error-like processing have behavioral consequences
  • Behavioral consequences
  • Behavioral consequences (2)
  • Behavioral consequences (3)
  • Behavioral consequences (4)
  • Behavioral consequences (5)
  • If centering is partly driven by auditory feedback it should
  • Centering correlates with suppression
  • Masking noise reduces centering
  • Masking noise reduces centering (2)
  • Masking noise reduces centering (3)
  • We detect deviations from an expected target
  • We correct our deviations before they become errors
  • Ongoing amp future directions Assess error detection and correc
  • Speech error detection and correction in aphasia
  • Speech error detection and correction in aphasia (2)
  • Speech error detection and correction in aphasia (3)
  • Speech error detection and correction in aphasia (4)
  • Speech error detection and correction in aphasia (5)
  • Speech error detection and correction in aphasia (6)
  • Speech error detection and correction in aphasia (7)
  • Ongoing amp future directions How task-specific is the perceive
  • Redefining center and periphery
  • Redefining center and periphery (2)
  • Redefining center and periphery (3)
  • Redefining center and periphery (4)
  • Redefining center and periphery (5)
  • Multi-pitch task
  • Source localization right hemi
  • Pitch task auditory suppression
  • Pitch task auditory suppression (2)
  • Pitch task auditory suppression (3)
  • Pitch task auditory suppression (4)
  • Task-specific suppression
  • Task-specific suppression (2)
  • Task-specific suppression (3)
  • Pitch centering
  • Pitch centering (2)
  • Slide 139
  • Understanding speech production via perception (15)
  • Understanding speech production via perception (16)
  • Understanding speech production via perception (17)
  • Understanding speech production via perception (18)
  • Thank you
  • Decrease in suppression in both speak and listen
  • No systematic changes in suppression in right AC
  • No systematic changes in suppression in right AC (2)
  • Anti-centering
  • ldquoSIS falloffrdquo across acoustic space

top related