Department of Electrical and Computer Engineering

He ZhouHui ZhengWilliam MaiXiang Guo

Advisor: Professor Patrick Kelly

ASLLENGEMidway Design review

Dec 2 2011

Department of Electrical and Computer Engineering

Outline Project Overview MDR Specifications Project Progress Software Implementation Hardware Implementation Design Spec Team Roles Timeline Q/A

Department of Electrical and Computer Engineering

Project Overview

Department of Electrical and Computer Engineering

Project Progress

MDR goals reached:• Hand tracking • Some gestures recognition • Basic GUI functional• A internal testing database• Functioning microcontroller

Department of Electrical and Computer Engineering

System Requirements (Revised) Motion Tracking:

• Track upper human body• Recognize different human gesture• Translate ASL to English word

Microcontroller:• Accurate A/D conversion • Reliable communication with chosen output interface

Graphical User Interface:• Real-time operation• Display text feedback

Cost• Below $500.

Department of Electrical and Computer Engineering

Software Design Flow

Department of Electrical and Computer Engineering

GUI Design Progress Achieved Goals

• Created a User Interface window • Display translated text • Display skeletal image

Future Goals/Expandable• 3D Avatar• Voice recognition• Tutorial

Department of Electrical and Computer Engineering

Test Database of body parts

Created a hierarchical tree data structure Nodes contain information including:

• Area of tracking• Location of next motion• word associated with it

Department of Electrical and Computer Engineering

Hardware Implementation Increasing the resistance

of the flex sensor with bend

Analog signal input to an Arduino Mega 2560

The Arduino Mega 2560 works as an AD converter

PC captures the signal via USB or Bluetooth

9

Flex Sensor Glove

Arduino Mega 2560

Department of Electrical and Computer Engineering

More detail for Implementation Impedance buffet with relation

at Digital number display on the

Ardunio software is equal to

Experimental result is almost linear from 0 to 5 volts

Arduino reading

R 1

-

+Flex Sensor

Vin

VoutR2

0 1 2 3 4 5 6 70500

10001500

Experimental Result

Input Volatge to Anolaog Pin(V)

Dig

ital N

umbe

r

Impedance Buffer

Department of Electrical and Computer Engineering

Cost of Major Components

Name of Component

Flex Sensor

Arduino Mega 2560

A Pair of Gloves

Kinect Sensor

Bluetooth Module

Quantities 10 1 1 1 1

Unit Price $12 $56 $10 $150 $20

Total Price $356

11

Department of Electrical and Computer Engineering

Team Roles He Zhou(CSE): test and integrate software

prototype Hui Zheng(CSE): database development and

programming William Mai (EE): build microcontroller to detect

finger and palm movements Xiang (EE): build Arduino board, overall testing,

building ASL database, and website administration

12

Department of Electrical and Computer Engineering

CDR Deliverables Complete and expand basic databases for both

finger tracking and upper body tracking. Complete the finger tracking module. Build a fully functioning system prototype.

Department of Electrical and Computer Engineering

TimelinePDR

Purchase PartsPlanning

GUIInterface with the Sensors

Build Finger SensorsBuild Test Database

Prototype 1MileStone MDR Deliverables

System IntegrationWinter Break

Expand DatabasePrototype 2

MileStone CDR DeliverablesAlpha Testing

UpdateBeta TestingSpring Break

Finalize ProjectMileStone FRP Deliverables

10/16/2011 12/5/2011 1/24/2012 3/14/2012 5/3/2012

14

Department of Electrical and Computer Engineering

Q&A

15