![Page 1: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/1.jpg)
Human Detection and Localization of Sounds
in Complex EnvironmentsW.M. Hartmann
Physics - AstronomyMichigan State University
QRTV, UN/ECE/WP-29Washington, DC4 May, 2010
![Page 2: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/2.jpg)
Goals: GRB-51-18, QRTV
• Phases II-IV. Determine human and technical factors relevant to improving the safety of pedestrians in the presence of quiet road vehicles.
e.g.: • Detection• Localization
These are psychoacoustical topics
![Page 3: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/3.jpg)
Psychoacoustics Goals
• Mathematical models of hearing processes.
• Consistent with animal physiology.• Consistent with human imaging and
encephalography.• Explain data from listening experiments in
which listeners respond to sounds.
![Page 4: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/4.jpg)
People from off the street
Irreproducible results
Experiment
![Page 5: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/5.jpg)
Psychoacoustical Methods
• Controlled environment• Focused attention• Trained listeners• Long
experiments• Specialized
protocol.
![Page 6: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/6.jpg)
Experimental protocol
Two-interval forced choice
One of these intervals has a signal in it.The listener knows that in advance.
Interval 1 Interval 2
![Page 7: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/7.jpg)
Experimental Goals Met
• Reproducible data• Find the best possible performance for the
human organism. • Successfully test models.
• Relevant to the blind pedestrian on the street corner?
But
![Page 8: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/8.jpg)
Single interval/ No interval
• Maybe there’s a signal…. Maybe not.
Signal present: HIT MISS
No signal: FALSE CORRECTALARM REJECTION
YES NO
![Page 9: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/9.jpg)
Hit Rate + Miss Rate =100False Alarm+Correct Rejection=100
![Page 10: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/10.jpg)
Slope about 1.0
Listener in unbiassed experiment
![Page 11: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/11.jpg)
Miss rate about 0.
Pedestrian
![Page 12: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/12.jpg)
Is psychoacoustics of any use at all in this context?
• P, “It cannot be heard.”• Conclusion: It can’t be heard.
• P, “It’s easily heard.”• Conclusion: Maybe it can be heard.
• There’s more:
![Page 13: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/13.jpg)
Active cochlea
![Page 14: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/14.jpg)
0
20
40
60
80
Cal
Test
![Page 15: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/15.jpg)
Detection
• In typical environments, background noise means that detection thresholds are masked thresholds.
• Masking is frequency specific.• Tonotopic organization starts with the
cochlea.
![Page 16: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/16.jpg)
![Page 17: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/17.jpg)
![Page 18: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/18.jpg)
Buick Lucerne, 1 meter, idle
60 dBA15 dB beeps
![Page 19: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/19.jpg)
100 dBA
![Page 20: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/20.jpg)
Buick Lucerne, 1 meter, 2000-1500 RPM
72 dBA
![Page 21: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/21.jpg)
![Page 22: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/22.jpg)
DC9, next to the intake
30 dB
hp
![Page 23: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/23.jpg)
Sound Localization
• Azimuth-90 degrees to 90 deges
• Elevation – including front back0 to 360 degees
• Distance
![Page 24: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/24.jpg)
ITD = Interaural time differenceILD = Interaural level difference
xL xR
t t
Azimuth
![Page 25: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/25.jpg)
714 Hz
1428 Hz
θ=41 deg => 500 us
=> ITD < 1200 Hz
ITD
![Page 26: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/26.jpg)
Right ear
Left ear
Brightspot
ILD
Arago-Poisson, 1818
Headshadow
>1300 Hz
![Page 27: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/27.jpg)
ILD
![Page 28: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/28.jpg)
Listener Responses
![Page 29: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/29.jpg)
Amplitude modulation• fc=1500 Hz, fm = 100 Hz• 100% modulation
2/3 ms 10 ms
![Page 30: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/30.jpg)
AMfm=100 Hz100%
Listener N
Listener Responses
![Page 31: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/31.jpg)
Direct sound retains coherenceMax cross-correlation = 1.
xL xR
t t
![Page 32: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/32.jpg)
Room reflections destroy coherence
xL xR
t t
![Page 33: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/33.jpg)
Coherence γ
ITDτo
BW (τ-τo)
![Page 34: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/34.jpg)
⇒Need high coherenceto use envelope cues.
![Page 35: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/35.jpg)
PRECEDENCE EFFECT
• Competition between Sound 1 & Sound 2• Sound 1: Localization cues, ITD, ILD, etc.• Sound 2: Localization cues, ITD, ILD, etc.
time1 2
Sound 1 takes precedence.
![Page 36: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/36.jpg)
• Sound 1: Localization cues, ITD, ILD, etc.• Sound 2: Localization cues, ITD, ILD, etc.
time1 2
Sound 1 takes precedence.
Fused image near location of Sound 1.
![Page 37: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/37.jpg)
1 2
Yvor Winters, 1900-1968
![Page 38: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/38.jpg)
1 2closer
![Page 39: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/39.jpg)
Elevation and front/back
• Anatomical filtering – cues at high frequencies > 8 kHz or > 2 kHz.
• Problem for elderly listeners.• Front/back
– Turn the head. Otherwise lost.
![Page 40: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/40.jpg)
Distance
• Intensity of known sounds• Air absorption attenuates high frequencies• Direct-to-reverberant ratio• Low-frequency ILD (< 1 meter).
![Page 41: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/41.jpg)
Buick Lucerne, at grille, idle
66 dBA
![Page 42: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/42.jpg)
Conclusions
• To be detectable, signals should have frequencies different from masking. Practically, this means mid to high.
• To be localizable (AZ), signals should have low frequencies. Both ITD and ILD work for the widest range of azimuths. Signals should be impulsive to elicit precedence.
• To disambiguate front/back signals should have high frequencies too.
![Page 43: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/43.jpg)
The End
Thanks to the NIDCD
![Page 44: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/44.jpg)
ILD + Responses
Listener does notuse ear signalsindependently.
![Page 45: Human Detection and Localization of Sounds in Complex ...€¦ · Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State](https://reader033.vdocuments.us/reader033/viewer/2022060808/608cfc058c35623417192765/html5/thumbnails/45.jpg)
IPD + Responses
1500 Hz is too fast for ongoingITD or IPD.