cmps 261 – project proposal
DESCRIPTION
Visually Representing American Sign Language Translations Victor Geislinger. CMPS 261 – Project Proposal. Background/Motivation. American Sign Language (ASL) Fingerspelling (FS) Handshapes Basis of language. Background/Motivation. Interpreters Emergency Inaccessible Expensive - PowerPoint PPT PresentationTRANSCRIPT
CMPS 261 – Project Proposal
Visually Representing American Sign LanguageTranslations
Victor Geislinger
Background/Motivation
● American Sign Language (ASL)● Fingerspelling (FS)● Handshapes
– Basis of language
Background/Motivation
● Interpreters– Emergency– Inaccessible– Expensive
● Learning Tool– Feedback
Method
● Collect Data via Leap Motion Controller– Focus on hand(s)/finger(s)– Real time capture
http://reviews.cnet.com/input-devices/leap-motion-controller/4505-3133_7-35823002.html
Method
● Categorize individual letters– Form hard to determine
● Classify group shapes– Easier to guess– “Autocorrect” feature
Method
● Transitions sometimes exist as one unit– “J” and “Z”– Double letters– “I-L-Y”– “A-I-R”– “B-U-S”
Output
● Gives interpreted word/sentence● Color coded to give likely letter from shape
group
Output
● Features other possible guesses– Given by opacity, position, and/or hierarchy tree
● Gives timeline of duration of letter– Possibly used to visually see speed of speech
Potential Issues/Challenges
● Identifying letters from same group– Difficult/impossible to do with current technology
● Differences in style/accent● Transition lengths● Output might have to many possibilities