Download - ASLLENGE
Department of Electrical and Computer Engineering
He ZhouHui ZhengWilliam MaiXiang Guo
Advisor: Professor Patrick Kelly
ASLLENGEMidway Design review
Dec 2 2011
Department of Electrical and Computer Engineering
Outline Project Overview MDR Specifications Project Progress Software Implementation Hardware Implementation Design Spec Team Roles Timeline Q/A
Department of Electrical and Computer Engineering
Project Overview
Department of Electrical and Computer Engineering
Project Progress
MDR goals reached:• Hand tracking • Some gestures recognition • Basic GUI functional• A internal testing database• Functioning microcontroller
Department of Electrical and Computer Engineering
System Requirements (Revised) Motion Tracking:
• Track upper human body• Recognize different human gesture• Translate ASL to English word
Microcontroller:• Accurate A/D conversion • Reliable communication with chosen output interface
Graphical User Interface:• Real-time operation• Display text feedback
Cost• Below $500.
Department of Electrical and Computer Engineering
Software Design Flow
Department of Electrical and Computer Engineering
GUI Design Progress Achieved Goals
• Created a User Interface window • Display translated text • Display skeletal image
Future Goals/Expandable• 3D Avatar• Voice recognition• Tutorial
Department of Electrical and Computer Engineering
Test Database of body parts
Created a hierarchical tree data structure Nodes contain information including:
• Area of tracking• Location of next motion• word associated with it
Department of Electrical and Computer Engineering
Hardware Implementation Increasing the resistance
of the flex sensor with bend
Analog signal input to an Arduino Mega 2560
The Arduino Mega 2560 works as an AD converter
PC captures the signal via USB or Bluetooth
9
Flex Sensor Glove
Arduino Mega 2560
Department of Electrical and Computer Engineering
More detail for Implementation Impedance buffet with relation
at Digital number display on the
Ardunio software is equal to
Experimental result is almost linear from 0 to 5 volts
Arduino reading
R 1
-
+Flex Sensor
Vin
VoutR2
0 1 2 3 4 5 6 70500
10001500
Experimental Result
Input Volatge to Anolaog Pin(V)
Dig
ital N
umbe
r
Impedance Buffer
Department of Electrical and Computer Engineering
Cost of Major Components
Name of Component
Flex Sensor
Arduino Mega 2560
A Pair of Gloves
Kinect Sensor
Bluetooth Module
Quantities 10 1 1 1 1
Unit Price $12 $56 $10 $150 $20
Total Price $356
11
Department of Electrical and Computer Engineering
Team Roles He Zhou(CSE): test and integrate software
prototype Hui Zheng(CSE): database development and
programming William Mai (EE): build microcontroller to detect
finger and palm movements Xiang (EE): build Arduino board, overall testing,
building ASL database, and website administration
12
Department of Electrical and Computer Engineering
CDR Deliverables Complete and expand basic databases for both
finger tracking and upper body tracking. Complete the finger tracking module. Build a fully functioning system prototype.
Department of Electrical and Computer Engineering
TimelinePDR
Purchase PartsPlanning
GUIInterface with the Sensors
Build Finger SensorsBuild Test Database
Prototype 1MileStone MDR Deliverables
System IntegrationWinter Break
Expand DatabasePrototype 2
MileStone CDR DeliverablesAlpha Testing
UpdateBeta TestingSpring Break
Finalize ProjectMileStone FRP Deliverables
10/16/2011 12/5/2011 1/24/2012 3/14/2012 5/3/2012
14
Department of Electrical and Computer Engineering
Q&A
15