supervisor: dr. elsayed eissa hemayed. o marwa ibrahim lamey. mayada ibrahim aly. o mona sherif...
TRANSCRIPT
Supervisor:Dr. Elsayed Eissa Hemayed
o Marwa Ibrahim Lamey.Mayada Ibrahim Aly.
o Mona Sherif Ahmed.o Suad Mohamed Barakat.
Team Members
Agenda
oIntroduction
oTools
oTime Plan
oProject Overview
Time Plan
ToolsO
verviewIntro.
Introduction
Time Plan
ToolsO
verviewProblem definition
Intro.oHearing children can be taught many lessons and morals through stories.
What about deaf children?
Time Plan
ToolsO
verviewIntro.oFact: There exists 5 million deaf persons in
Egypt
Can’t we help them interacting with the community!??...
Background
Time Plan
ToolsO
verviewIntro.
This is not always the picture
Al Amal School- Resala Charity
Time Plan
ToolsO
verviewIntro.
Project Overview
Time Plan
ToolsO
verviewIntro.
oOur prototype is about to translate a category of children stories to the sign language in real time
oGoal: To minimize the gap between hearing parents or teachers and deaf children
Our Scope
Time Plan
ToolsO
verviewIntro.oInput: Arabic story speech signal
oOutput: Input translation to the sign language
oType: Desktop Application
Description
Time Plan
ToolsO
verviewIntro.oiCommunicator
oIBM SiSi
Market Survey
Time Plan
ToolsO
verviewIntro.oArabic speech recognition
oStart from speech and end up with sign language
SIGNlator Uniqueness
Time Plan
ToolsO
verviewIntro.oTranslation of Arabic speech to sign
language in real time.
o Translation of Arabic text to sign language.
oLearning mode.
SIGNlator Features
Time Plan
ToolsO
verviewIntro.
Block Diagram
Text to Sign languageاالشاري القاموس
للصم العربي
Recognizer Graphics module
Time Plan
ToolsO
verviewIntro.
Feature Extraction Search
Acoustic Model
Language Model
Audio Words
Dictionary
Automatic Speech Recognition-Architecture
Recognizer
Time Plan
ToolsO
verviewIntro.
ASR Categories
Word Based Phoneme Based
Isolated WordsWord Based
Isolated WordsPhoneme BasedIsolated Words
Continuous Speech
Word BasedContinuous Speech
Phoneme BasedContinuous Speech
Our Choice!!
• Very high accuracy• Maximum 150 words.
• Unlimited words can be recognized if added to the dictionary.
• Less accurate but still acceptable accuracy
Time Plan
ToolsO
verviewIntro.oTackling a new field
oPhonemes of Arabic language.
oAccents of Arabic language .
oArabic language model.
oPrepare the training set.
Challenges
Time Plan
ToolsO
verviewIntro.oAdaptability.
oExpendability.
oChange program type to be mobile application.
oIntegrate with Ayat’s Project
Future Work
Time Plan
ToolsO
verviewIntro.oRecognizer : HTK
oText to Sign languageoC# using Microsoft Visual Studio 2008oSQL Server 2005
oGraphics module: Quest3D 4.0
oGUI: Expression Studio 2 ( Blend)
Tools
Time Plan
54 days25 d
34d6d
38days
13d
18d
43days16d
14d51 days
7d6d
Brain StormingMarket Research
DesignMid-Terms
DesignFinals
Implementation
IntegrationMid-Terms
Implementation & Testing
FinalsTesting
8/7/09
26/10/0930/9/09
27/10/091/10/09
30/11/095/12/09 11/12/09
12/12/09
24/3/10
30/12/091/1/10 8/2/10
9/2/10
7/8/09
1/7/1030/6/1010/5/10
9/5/1025/4/10
10/4/1025/3/1024/4/1011/4/10
15/7/109/7/10
Doc
Working Period
Idle period
Sponsors
Thank you
Causes of deafness
• 9.6% Pregnancy-Related causes• 8.4% Post-Natal causes• 28% Genetic causes• 54% Unknown causes
Not necessary to be born for deaf parents