Upload File

king’s speech foreign language: pronounce with...

  • Home
  • Documents
  • KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with
13
KING’S SPEECH Foreign language: pronounce with style! “Towards automatic evaluation of pronunciation” July 5 th 2017

Upload: others

Post on 06-Sep-2020

1 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

KING’SSPEECHForeignlanguage:pronouncewithstyle!

“Towardsautomaticevaluationofpronunciation”

July5th 2017

Page 2: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

KING’S SPEECH:SYSTEM OVERVIEW

Speech&videoacquisitionandvisualization

Pronunciationanalysis

Gamescheduler

Avatar-basedrendering

Empowermentanalysis

Speechsynthesis/database

Page 3: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

STARTING POINT:TEXT AND SPEECH

Student

Teacher

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

IPA:Elva etydje

Howwellhasthestudentrepeatedtheteacher’sphrase?

Whattoevaluate?Vowels

Consonants

Intonation

Accentuation

Rhythmicgroups

Liaison

…andmore…

Page 4: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

IS THE INPUT SPEECH GOOD ENOUGH?

Checktheinputsignal!Correctsamplingfrequency?

Sufficientsignalenergy?

Reasonableduration?

Hasthesignalclipped?

Doesitcontainnoise?

…?

ApplyVoiceActivityDetection(VAD)

Page 5: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

SPEECH ALIGNMENT:WHAT’S BEHIND THE SCENES?

PhoneticalignmentUsesspeechrecognitiontechnology

TrainaHiddenMarkovModel(HMM)

Inputs:HMMmodel,speechfile&transcription

Output:timeintervalsofphonemesinspeechfile

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

Page 6: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

SPEECH ALIGNMENT:HOW TO VALIDATE IT?

Remember:wedon’tperformrecognition!CalculatetheLowFrequencyModulatedEnergy

Peakscorrespondtovowels(well,mostlikely!)

Compare:peaklocationsvs.alignmentresults

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

LFMEAutomaticalignmentvalidation

Page 7: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

PRONUNCIATION ANALYSIS

Casestudy:Vowels

Page 8: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

VOWELS ANALYSIS:WHAT FEATURES TO LOOK AT?

Formants:whatarethey?

Howtocalculatethem?LinearPredictionCoding(LPC)

Vocaltractlengthnormalization(VTLN)

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

LFMEAutomaticalignmentvalidation

Formantsestimation LPC

Optimalorder

Warpingfunction(VTLN)

Page 9: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

VOWELS ANALYSIS:WHAT ABOUT NASALS?

Nasals:whatarethey?

Howtodistinguish?Computesmoothedpowerspectrum

Findpeaksinregionsrelatedtoformants

Usepeakinformationasacousticparameters

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

LFMEAutomaticalignmentvalidation

Formantsestimation LPC

Optimalorder

Warpingfunction(VTLN)

Nasalizationevaluation /ɛ/ /ɛ/̃

Page 10: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

VOWELS ANALYSIS:COMPARISON AND FEEDBACK

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

LFMEAutomaticalignmentvalidation

Formantsestimation LPC

Optimalorder

Warpingfunction(VTLN)

Nasalizationevaluation

Statisticalanalysis

Howtocomparevowels?Distancebetweenformantvectors(student/teacher)

Contextisimportant!

Checkdistancefromallothervowels

Oralswithorals,nasalswithnasals

Page 11: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

StudentAudiovalidation&pre-processing VAD

Teacher

VOWELS ANALYSIS:THE FULL PICTURE

Speechalignment

PhoneticTranscription(fənɛtɪk trænskrɪpʃən)

LFMEAutomaticalignmentvalidation

Formantsestimation LPC

Optimalorder

Warpingfunction(VTLN)

Nasalizationevaluation

Statisticalanalysis

Page 12: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

KING’S SPEECH:COMING NEXT

Speech&videoacquisitionandvisualization

Pronunciationanalysis

Gamescheduler

Avatar-basedrendering

Empowermentanalysis

Speechsynthesis/database

19th ofJuly:“Modular architectureforimmersivelearning applications”

LanguageKaraokescenario

Deeplearningphonemeevaluation

Student-TeacherFacialandSpeechsynchronization

Page 13: KING’S SPEECH Foreign language: pronounce with style!artes.ucp.pt/enterface17/2017.07.05/Celine_Kings Speech... · 2017. 7. 5. · KING’S SPEECH Foreign language: pronounce with

THANK YOU FOR YOUR ATTENTION!


How to Pronounce Django

Martin Luther King’s ‘I Have A Dream’ speech and the March on Washington

Pronounce it perfectly in english

Speech Recognizer Training Thank you for helping us to train our speech recognizer! Read each word out loud. If you don't know how to pronounce a word,

How to Pronounce

Close Reading & Text Dependent Questions - TPS … Reading Presentation.pdf · Close Reading & Text Dependent Questions ... comprehension. Close Reading ... Luther King’s Speech,

Animal Farm Speech Analysis - Aboutwoodland8ela.weebly.com/uploads/3/7/7/2/...mlk_imagine_speech_ana… · ... Martin Luther King’s “I have a Dream” speech, ... A rhetorical

LESSON PLAN Equality and Freedom - Homepage | USCIS · PDF fileview the speech together in class. ... library. When introducing Dr. King’s speech, ... 6 Intermediate Level Equality

Connected Speech - drhanantaqi.weebly.comdrhanantaqi.weebly.com/uploads/4/9/1/9/49191371/connected_speech_new.pdf · What is connected speech? When we speak naturally we do not pronounce

The king’s speech case study final powerpoint

SC105 - Southeast Missouri State Universitycstl-cla.semo.edu/bclubbs/summer 2011 complete sylla…  · Web viewBrown Bag Speech Outline Workshop25 points. ... Did they pronounce

UNION BUDGET 2011-2012 SHYAM BENEGAL Film-maker … · SHYAM BENEGAL Film-maker “The King’s Speech was a solid, hardworking, non-flashy film that won 4 Oscars... The FM’s speech

How to Pronounce Russian Correctly

Pronounce it Perfectly in Russian

Can You Pronounce it Right!

Escuchary repetira partirde: digital · Vocaroo Transcribe Audio TEXT TO SPEECH SanakoPronounce Pronounce Live (Diactic17) SpeechAce TextAloud. Title: Microsoft PowerPoint - 011bueno.pptx

‘the King’s Speech’ Construction

Pronounce 6

Stylistic devices in Martin Luther King’s speech

10th Grade Speech Curriculum Planning Organizer … · Gettysburg address and King’s I Have a Dream Speech. ... choice, meaning, and comprehension. RL.9-10.10 By the end of grade

Oration Pronounce 00 Sp Of

Pictures relating to the film The King’s Speech have been removed

How to Pronounce German Correctly

00.How to Pronounce Russian Correctly

Pronounce It Perfectly in English01

1 5 Questions - Pronunciation Studio › wp-content › uploads › ... · 3. In GB English1 /r/ in connected speech, regional accents may pronounce them all: There aren’t enough

Hornady Transportation Newsleter · 7. King’s last public speech foretold his death. 8. Members of King’s family did not believe James Earl Ray acted alone. 9. King’s mother

Wheels by Catherine MacPhail - Booktopiastatic.booktopia.com.au/pdf/9780435131050-2.pdf · well known speech, such as Martin Luther King’s ‘I have a dream’ speech, to identify

“I Have a Dream” - ca01000043.schoolwires.netca01000043.schoolwires.net/cms/lib08/CA01000043/Centricity/Domain... · “I Have a Dream” King’s Speech ... for Comprehension

Can You Pronounce It Right! 2

THE KING’S SCHOOL IN MACCLESFIELD FORMER PUPILS’ … · 2 Spring 2018 Spring 2018 3 KING’S SPEECH KING’S SPEECHTHE FORMER PUPILS’ MAGAZINE THE FORMER PUPILS’ MAGAZINE

Gospel of Matthew Chapter 6:1-18. King’s Speech Chapter 5-7 / Sermon on the mount

worksheet - cinehorloge.fr · worksheet the king’s speech ... In order to help with comprehension, ... here are some questions and background information for

Animated feature - The San Francisco Examiner ballot.pdfAnimated feature “ How to Train ... “ Inception” (Hans Zimmer) “ The King’s Speech” (Alexandre Desplat) ... “

01.How to Pronounce Russian Correctly