1 new technique for improving speech intelligibility for the hearing impaired miriam furst-yust...
Post on 15-Jan-2016
215 views
TRANSCRIPT
![Page 1: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/1.jpg)
11
New Technique for Improving Speech Intelligibility for the Hearing
Impaired
Miriam Furst-YustMiriam Furst-Yust
School of Electrical EngineeringSchool of Electrical Engineering
Tel Aviv UniversityTel Aviv University
![Page 2: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/2.jpg)
22
The Hearing Aid ProblemThe Hearing Aid Problem Current hearing aids are very helpful to severe and profound Current hearing aids are very helpful to severe and profound
hearing impairment in quiet environment. hearing impairment in quiet environment.
Most people with mild-to-moderate hearing loss are unable to understand speech in a noisy background.
Current Hearing aids are useless in a noisy background.
![Page 3: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/3.jpg)
33
THE PROBLEM:THE PROBLEM:
common noise suppression common noise suppression techniques are not robust and techniques are not robust and
most of the time are not most of the time are not effectiveeffective
![Page 4: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/4.jpg)
44
Our ApproachOur Approach
A single microphone followed by a A single microphone followed by a cochlear model algorithm that improves cochlear model algorithm that improves the signal-to-noise ratio.the signal-to-noise ratio.
The algorithm is robust, so speech with The algorithm is robust, so speech with high SNRs are not distorted. high SNRs are not distorted.
![Page 5: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/5.jpg)
55
Cochlear Representation Cochlear Representation AlgorithmAlgorithm
A Device that Mimicsthe Human Hearing
and Speech Perception
![Page 6: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/6.jpg)
66
Mimic the cochlear representation of Mimic the cochlear representation of speech signalsspeech signals
Identify the speech areas in the Identify the speech areas in the cochlear representation and discard the cochlear representation and discard the noise areasnoise areas
Reconstruct the speech signal from the Reconstruct the speech signal from the modified cochlear representationmodified cochlear representation
Cochlear Representation Algorithm (CRA)
![Page 7: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/7.jpg)
77
Cochlear RepresentationsCochlear Representations of of TonesTones
Cochlear representation
![Page 8: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/8.jpg)
88
Representation of a wordRepresentation of a word
Input Signal: The word “SHEN”
INPUT OUTPUT
NormalEar
Damaged Ear
![Page 9: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/9.jpg)
99
SpectrogramTime representation
Input SpeechInput Speech
![Page 10: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/10.jpg)
1010
Energy Estimation Energy Mask
Energy Estimation
![Page 11: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/11.jpg)
1111
TIME (sec)
Cochlear Representation
![Page 12: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/12.jpg)
1212
Modified Cochlear Representation
![Page 13: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/13.jpg)
1313
Time representation Spectrogram
Speech Reconstruction
![Page 14: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/14.jpg)
1414
CRACRA Performance Performance
MELPMELP
2.42.4 Kb/sKb/sG729G729
88 Kb/sKb/s
MELPMELP
2.42.4 Kb/sKb/sG729G729
88 Kb/sKb/s
Noisy Sentence Clean Sentence
![Page 15: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/15.jpg)
1515
Analysis of Human Analysis of Human Performances with CRA:Performances with CRA: Recognition of CVC words in an Recognition of CVC words in an
open setopen setSubjects: Subjects:
1.1. Hearing Impaired with their Cochlear Hearing Impaired with their Cochlear ImplantsImplants
2.2. Hearing Impaired with their Hearing Hearing Impaired with their Hearing Aids Aids
3.3. Normal HearingNormal Hearing
![Page 16: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/16.jpg)
1616
Word database - HABWord database - HAB
HHebrew adaptation (Kishon-Rabin,2002) to AB ebrew adaptation (Kishon-Rabin,2002) to AB ((AArthur rthur BBoothroyd) list (Boothroyd,1968) oothroyd) list (Boothroyd,1968) comprising CVC words.comprising CVC words.
Equal distributions in each list of phonemes in the Equal distributions in each list of phonemes in the Hebrew languageHebrew language
HAB common use in hearing tests. Reduces effect HAB common use in hearing tests. Reduces effect of frequency and/or familiarity on test scoresof frequency and/or familiarity on test scores
Two speakers: male and female. 15 lists of 10 Two speakers: male and female. 15 lists of 10 words (total of 300 words)words (total of 300 words)
Recorded at a sampling rate of 44.1 kHzRecorded at a sampling rate of 44.1 kHz
![Page 17: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/17.jpg)
1717
Applied Word databaseApplied Word database
Test subject’s ability to recognize words in Test subject’s ability to recognize words in noisy environmentsnoisy environments
Gaussian white noise in SNRs of 0 – 30 dBGaussian white noise in SNRs of 0 – 30 dB Bandpass filter 500-8000 HzBandpass filter 500-8000 Hz Apply cochlear model and reconstruction Apply cochlear model and reconstruction
algorithmalgorithm
![Page 18: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/18.jpg)
1818
Normal Hearing PerformancesNormal Hearing Performancesin open-set words identificationin open-set words identification
![Page 19: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/19.jpg)
1919
Hearing Aid Users Hearing Aid Users PerformancesPerformances
in open-set words identificationin open-set words identification
Signal-to-Noise Ratio (dB)
0
10
20
30
40
50
60
70
No Noise 30 24 18
Hearing Aid
HearingAid+CRA
Perc
en
tag
e
Corr
ect
)%(
* Hearing Impaired performance were significantly improved by CRA in SNR of 18 dB
No. of Subjects=51
![Page 20: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/20.jpg)
2020
Cochlear Implant Users Cochlear Implant Users PerformancesPerformances
in open-set words identificationin open-set words identification
Signal-to-Noise Ratio (dB)
0
10
20
30
40
50
60
No Noise 30 24 18
Hearing Aid
HearingAid+CRA
Perc
en
tag
e
Corr
ect
)%(
* Hearing Impaired performance were significantly improved by CRA in SNR of 18, 24 and 30 dB
No. of Subjects=16
![Page 21: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/21.jpg)
2121
Why CRA is Beneficial to the Why CRA is Beneficial to the Hearing Impaired Hearing Impaired
but Not Effective but Not Effective
to Normal Hearing Subjects?to Normal Hearing Subjects?
![Page 22: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/22.jpg)
2222
Normal Hearing Recognition Normal Hearing Recognition rate of 2.5 Oct. Band Limited rate of 2.5 Oct. Band Limited
SpeechSpeech
0102030405060708090
100
Clean SNR=0 dB SNR=3 dB
600 Hz
2500 Hz
No filter
Center Frequency = 600 Hz
Center Frequency = 2500 Hz
![Page 23: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/23.jpg)
2323
Summary & Conclusions: Summary & Conclusions: Normal Hearing PeopleNormal Hearing People
Speech is redundant in the frequency Speech is redundant in the frequency domain.domain.
Normal Hearing subjects can efficiently Normal Hearing subjects can efficiently recognize speech in noisy environments recognize speech in noisy environments because they identify the speech in because they identify the speech in different frequency bands.different frequency bands.
CRA reduces the speech redundancy.CRA reduces the speech redundancy. Therefore, CRA that is applied to a wide-Therefore, CRA that is applied to a wide-
band signal is not effective to normal band signal is not effective to normal hearing people. hearing people.
![Page 24: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/24.jpg)
2424
Summary & Conclusions: Summary & Conclusions: Hearing Impaired People Hearing Impaired People
Hearing Impaired people have band Hearing Impaired people have band limited hearing.limited hearing.
The speech redundancy is not very The speech redundancy is not very useful to the hearing impaired.useful to the hearing impaired.
Therefore, CRA can be very effective Therefore, CRA can be very effective to the hearing impaired. to the hearing impaired.
![Page 25: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/25.jpg)
2525
Hardware Solution :Real time Implementation of the
Algorithm
Implementation of the algorithm as Implementation of the algorithm as part of common digital hearing aid or part of common digital hearing aid or Cochlear Implant. Cochlear Implant.
![Page 26: 1 New Technique for Improving Speech Intelligibility for the Hearing Impaired Miriam Furst-Yust School of Electrical Engineering Tel Aviv University](https://reader036.vdocuments.us/reader036/viewer/2022062423/56649d785503460f94a5a718/html5/thumbnails/26.jpg)
2626
Real Time ImplementationReal Time Implementation