Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Real-time monitoring of noise and acoustic events: listening to the deep, identifying and understanding
Laboratory of Applied Bioacoustics (LAB)Technical University of Catalonia (UPC, BARCELONA Tech)http://www.lab.upc.es
Michel André
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
LIDO live data flow
Country/Location Platform Data stream
FRANCE ANTARES 36 x 250 kHz
NEPTUNE CANADA Folger Passage 1 x 96 kHz
NEPTUNE CANADA Barkley Canyon 1 x 96 kHz
NEPTUNE CANADA Barkley Slope 1 x 96 kHz
SPAIN (MED SEA) OBSEA 1 x 96 kHz
JAPAN (JAMSTEC) Hatsushima 1 x 100 Hz
JAPAN (JAMSTEC) Kushiro 3 x 100 Hz
ITALY (ESONET) NEMO TSS/TSN 2x 4 x 96 kHz
SPAIN (ATLANTIC) BIMEP 1 x 96 kHz
CTBTO ? 11 HA 11 x 200 Hz
Sources of Noise
ruido antropogénicosonar industrial, militar
exploración sísmicatransporte marítimo
mareasactividad sísmica burbujas
interacciónolas
olas que se rompen
olas, viento
tormentas lluvia, nieveturbulencias
ruido de animales marinoscetáceos, crustáceos, etc.
30
40
50
60
70
80
90
100
110
130
Fréquence [kHz]0.001 0.01 0.1 1 10 100
Inte
nsité
dB
re 1
μPa2 /H
z a
1m
intensidad
frecuencia
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
- Shipping - Exploration and production of offshore fossil energy, - Navy and industrial sonar - Experimental acoustics - Underwater explosions -Engineering activities- Supersonic airplanes - Offshore windmills
… in search of a balance
Live monitoring of underwater noise and acoustic signals
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, Austria
nuclear testing
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Choice of “right” indicators
INDICATORS FOR GOOD ENVIRONMENTAL STATUS FOR UNDERWATER NOISE AND OTHER FORMS OF ENERGY
European Marine Strategy Framework Directive (International Council for the Exploration of the Sea)
Controling the effects of noise
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
TG11 EnergyATTRIBUTE Criteria to assess the descriptor Indicators to be measured
Underwater noise - Low and mid-frequency impulsive sound
High amplitude impulsive anthropogenic sound within a frequency band between 10Hz and 10 kHz, assessed using either sound energy over time (Sound Exposure Level SEL) or peak sound level of the sound source. Sound thresholds set following review of received levels likely to cause effects on dolphins; these levels unlikely to be appropriate for all marine biota. The indicator addresses time and spatial extent of these sounds.
The proportion of days within a calendar year, over areas of 15’N x 15’E/W in which anthropogenic sound sources exceed either of two levels, 183 dB re 1µPa2.s (i.e. measured as Sound Exposure Level, SEL) or 224 dB re 1µPapeak (i.e. measured as peak sound pressure level) when extrapolated to one metre, measured over the frequency band 10 Hz to 10 kHz
Underwater noise – High frequency impulsive sounds
Sounds from sonar sources below 200 KHz that potentially have adverse effects, mostly on marine mammals, appears to be increasing. This indicator would enable trends to be followed.
The total number of vessels that are equipped with sonar systems generating sonar pulses below 200 kHz should decrease by at least x% per year starting in [2012].
Underwater noise – low frequency continuous sound
Background noise without distinguishable sources can lead to masking of biological relevant signals, alter communication signals of marine mammals, and through chronic exposure, may permanently impair important biological functions. Anthropogenic input to this background noise has been increasing. This indicator requires a set of sound observatories and would enable trends in anthropogenic background noise to be followed.
The ambient noise level measured by a statistical representative sets of observation stations in Regional Seas where noise within the 1/3 octave bands 63 and 125 Hz (centre frequency) should not exceed the baseline values of year [2012] or 100 dB (re 1µParms; average noise level in these octave bands over a year).
Controling the effects of noise
Underwater noise – low frequency sounds
The ambient noise level measured by a statistical representative sets of observation stations in Regional Seas where noise within the 1/3 octave bands 63 and 125 Hz (centre frequency) should not exceed the baseline values of year [2012] or 100 dB (re 1µPa rms; average noise level in these octave bands over a year).
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Sources of Noise & Acoustic Signals
Unwanted against Intentional
Shipping noise
Explosions
Offshore Construction
Sonar
Seismic Surveys
Scientific Experiments
… in search of a balance
Live monitoring of underwater noise and acoustic signals
Nuclear Testing
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, Austria
Biological Sources
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Effects of Noise
Mitigation actions & Long-term monitoring
Is it possible to combine both objectives in a same approach/system?
Real-time and Statistical Analysis
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Controling the effects of noise
Standardization of methods to measure noise
Classification methods to detect and identify acoustic sources
NEED FOR A ROBUST AUTOMATED MONITORING SYSTEM ABLE TO SATISFY THE REQUIREMENTS OF THE SCIENTIFIC COMMUNITY AND ALLOW
THE SUSTAINABLE DEVELOPMENT OF THE INDUSTRY
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Marine soundscape
* Cetacean whistles and calls* Cetacean clicks, bursts, creaks, buzzes ...* Tonal, impulsive and broadband ship noise* Explosions* Sonar, echosounder, * Waves, rain, bubbles, etc.* etc.
Challenging for automated classification methods
Controling the effects of noise
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
audio data stream Segment 1 Segment 2 Segment 3 Segment 4 Segment 6Segment 5
......
LocalisationTracking
Classifier 1Classifier 2...
Stage 2
Measure noise
Discard segment with no acoustic event
Assign acoustic events to broad categories
Stage 1
FM-tonal soundsImpulses...
Sperm whalesBeaked whalesPilot whalesDolphinsExplosionsShipsSonar
Bearing, PositionTrajectory, …
Stage 3
Real-Time Mitigation
Long term assessment and Control of the effects of noise sources on marine organisms
Public outreach
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Controling the effects on Cetaceans
SETUP
Pre-Processing Server•Segments & tags data•Encodes 1 channel into mp3•No data storage – we rely on the MADS
Analysis Server•Source identification•Localisation and tracking of sources
Transmission analysis results and mp3 channel
X-channel multi-cast data stream
Transmission of analysis results and mp3 data to Web ServerADS
RT Acoustic Software Development Acoustic Data Management
MADS
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Impulse detector 1-5 kHz
Short tonal sounds detector
Impulse detector>20 kHz
Constant tonal
sounds detector
Broadband shipping
noise detector
Impulse classifier
Buzz classifier
Short tonal sounds classifier
Pinger/sonarDolphin whistlesKiller whale calls
Continuous shipping noise
Impulse detector < 100 Hz, 0,1-1 kHz
Impulse detector 5-20 kHz
Segment
Short tonal sounds localiser
Loca
lisat
ion
Det
ectio
nC
lass
ifica
tion
Impulse localiser
Sperm whale clicksUltrasonic cetacean clicksImpulsive ship noiseBuzzesKiller whale clicksExplosions
Baleen whales Noise measurement In the full bandwidth
+ in all the above bandwidths+ 1/3 Octave band 63Hz
+ 1/3 Octave band 125Hz
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Loca
lisat
ion
Det
ectio
nC
lass
ifica
tion
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Detection of short tonal sounds in the band 0.2-16 kHz. Acoustic data from Neptune, 3-24 March 2010, 10 min recorded every 3.5 hour.
DETECTION & CLASSIFICATION
Fin whales, 29th April 2010, 02am, off Kushiro, JAPAN, JAMSTEC observatory(Feed Forward Neural Network)
Zaugg, S., van der Schaar, M., Houégnigan, L., Gervaise, C., André, M. Real-time acoustic classification of sperm whale clicks and shipping impulses from deep-sea observatories. Applied Acoustics, issue doi:10.1016/j.apacoust.2010.05.005, 2010
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
2nd International Aquatic Noise Conference 2010, Cork City Ireland.Real-time monitoring of noise and acoustic events in cetacean acoustic niches
LOCALIZATION
Sperm whale tracking, 09th August 2005, 09pm, East-Sicily, NEMO observatory(Hybrid spatial spectral estimation: space-time methods and TDOA-based methods)
Figure 3.9 : Sperm whale tracking, 09th August 2005, 09pmHouégnigan, S. Zaugg, M. van der Schaar, M. André. Space–time and hybrid algorithms for the passive acoustic 3D localisation of sperm whales and vessels. Appl ied Acoustics (2010), doi:10.1016/j.apacoust.2010.05.017
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Detection of short tonal sounds in the band 0.2-16 kHz. Acoustic data from Neptune, 3-24 March 2010, 10 min recorded every 3.5 hour.
INTERACTION WITH NOISE
Sperm Whales at ANTARES (Ligurian Sea), July 2010
André, M., van der Schaar, M., Zaugg, S., Houégnigan, L., Sánchez, A., Mas, A. Listening to the Deep: real-time monitoring of noise pollution and cetacean acoustic signals. Marine Pollution Bulletin (accepted).
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Detection of short tonal sounds in the band 0.2-16 kHz. Acoustic data from Neptune, 3-24 March 2010, 10 min recorded every 3.5 hour.
GLOBAL NOISE
MEASUREMENTS
(10 segment average)
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Detection of short tonal sounds in the band 0.2-16 kHz. Acoustic data from Neptune, 3-24 March 2010, 10 min recorded every 3.5 hour.
GLOBAL CETACEAN
DISTRIBUTION
(50 segment average)
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Detection of short tonal sounds in the band 0.2-16 kHz. Acoustic data from Neptune, 3-24 March 2010, 10 min recorded every 3.5 hour.
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
http://listentothedeep.com
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Underwater vehicles, e.g. gliders
Radio-linked , expandable or moored stand-alone buoys
Deep-sea or shallow water cabled observatories
Underwater neutrino telescopes
Past and Existing recordings
Towed arrays
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
The system is designed to be modular and dynamic (allows the choice of detectors/classifiers) depending on the objectives and geographical areas
The system successfully allows: - the real-time detection and classification of acoustic events- the real-time and long-term monitoring of noise- immediate mitigation actions- the online display of the audio stream and the statistical analysis
The modular system can be implemented on: - cabled observatories, - autonomous radio-linked buoys, moored antennas- autonomous vehicles (e.g. gliders), - towed arrays- existing data sets,- etc.C
ON
CLU
SIO
NS
& P
ER
SPE
CT
IVE
S
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
The system can be applied (industry):-during offshore operations, seismic surveys (expandable buoys), windmills/wave energy (autonomous buoys during construction, cabled observatory during operation), shipping lines, coastal operations (e.g. harbour construction), etc.
The system can be applied (science):- in existing and future acoustic observatories-during CEE and tagging to understand the acoustic ecology of the individual,- existing recordings
The system will be implemented (Fall) with:- an alert procedure that will allow to automatically target acoustic events of interest and receive it live (e.g. mitigation or research)- automatic display of AIS data and correlation with noise measurements to determine the acoustic signature of ships cruising over the observatoriesC
ON
CLU
SIO
NS
& P
ER
SPE
CT
IVE
S
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
Comprehensive Nuclear-Test-Ban Treaty: Science & Technology 2011, Vienna, AustriaReal-time monitoring of noise and acoustic events: listening, identifying and understanding
Universitat Politècnica de CatalunyaLaboratori d’Aplicacions Bioacústiques
The data from the existing observatories are availlable to the scientific community
The system can be operated by a non-expert
The analysis is performed automatically and doesn’t require post-processing
The system is immediately available to be applied to CTBTO Hydroacoustics Observatories
CO
NC
LUS
ION
S &
PE
RS
PEC
TIV
ES
Thank you….