critical design review comit. contents motivations mission overview stakeholders sponsors team...

CRITICAL DESIGN REVIEW

COMIT

2

CONTENTS

• Motivations• Mission• Overview• Stakeholders• Sponsors• Team Organization

• Electrical System Overview• Functional Decomposition• Environmental Circuit Overview• Image Sensing Overview• Data Processing Overview• Application Framework

• Structural System Overview• Drawings

• Budget• Risks & Impacts• Economic Impacts• Risk Mitigation and Safety• Environmental Impacts• Societal Impact

• Schedule• Gantt Chart• Milestones

Presenter: Nate TurleyCapstone Senior Design 2012

COMIT TouchSystems

3

MISSION

“The mediocre teacher tells. The good teacher explains. The superior teacher demonstrates. The great teacher inspires.” ― William Arthur Ward

Our mission is to inspire students in a way that defies conventions of the classroom, engaging them in the sights, sounds, and kinesthetic of a new experience.

Presenter: Jenny CoferCapstone Senior Design 2012

COMIT TouchSystems

4

OVERVIEW

• This project will provide a table-sized multi-touch interface on which to run educational applications. • Primary Foci: • Exciting, dynamic, non-conventional learning• Appeals to childlike curiosity• Engages multiple users• User-Centered Design• Educates on math, science, and music


COMIT TouchSystems

5

STAKEHOLDERS

"Consumer preference and motivation is far less influenced by the tangible attributes of product and service than the sub-conscious sensory and emotional elements derived by the total experience."

Dr. Gerald Zaltman, Harvard Business School


COMIT TouchSystems

6

SPONSORS

• “A leader in sustainable, energy-efficient LED lighting”

• “Designers, fabricators, architects, engineers and end-users have come to rely on ACRYLITE® sheet products to meet their unique challenges in a broad range of market.”


COMIT TouchSystems

7

TEAM ORGANIZATION

Team Member Roles

Jenny Cofer Project Manager

Jared Yenzer Systems Engineer

Justin Barth Hardware Engineer

Nate Turley Software Engineer

Nate Glab Structural Engineer


COMIT TouchSystems

8

ELECTRICAL SYSTEM OVERVIEW

JUSTIN BARTH

Presenter: Justin BarthCapstone Senior Design 2012

COMIT TouchSystems

9

LEVEL 0 FUNCTIONAL DECOMPOSITION

Power 120 V AC

Touch

Touch Table

Legend

Input / Output

Display

Audio

10


Power Suppl

y

12 V 12 V

Touch Sensing

Touch Utilization

Environmental Sensors

Power 120 V AC

Touch

Display

Audio

TouchData

Legend

Input / Output

Power

Data

11


Power Suppl

y

120V AC

Power 120 V AC

Display

Audio

Touch

Projector

Application

Framework

Image Processing System

ImagingSystem

Acrylic Surface

IR LEDS

Touch Sensing

Touch Utilization

Environmental Sensors

12 V

Legend

Input / Output

Power

Data

12 V

12

ENVIRONMENTAL SENSORS

SYSTEM OVERVIEWJARED YENZER

Presenter: Jared YenzerCapstone Senior Design 2012

COMIT TouchSystems

13

ENVIRONMENTAL SENSORS


COMIT TouchSystems

Proximity Sensor

3.3 V

Imag

ing

S

yste

m

LED STRIPS

R in I/O

Analog Output

TemperatureSensor

5 V

AnalogOutput

CAT5114Potentiometer

CAT32LED DRIVER

14

PROXIMITY SENSOR

GP2Y0A21YK SPECIFICATIONS

• Infrared Analog Sensor

• 25 Hz Sampling Rate

• 5V Supply

• Detecting Distance• 10 to 80 cm


COMIT TouchSystems

15

TEMPERATURE SENSOR

TMP36 SPECIFICATIONS

• Analog Sensor

• 5V Supply

• ± 2º Celsius Accuracy

• -40º C to +125º C Range


COMIT TouchSystems

16

IMAGING SYSTEM OVERVIEW

JARED YENZER


COMIT TouchSystems

17

IMAGING SYSTEM


COMIT TouchSystems

TCM8230Camera

ATXMEGA16D4μController

3.3 V

20 MHz CLK

8 Lines Parallel Camera Data

2.8 V 1.5 V

I2C BUS

I/Os to Potentiometer D

ata

P

rocessin

g

Syste

m

Proximity Sensor & Temp Data

En

vir

on

men

tal

Sen

sors

S

yste

m

18

MICROCONTROLLER

ATXMEGA16D4 INPUTS/OUTPUTS

• I2C BUS• Program Camera Reg.• Image Size• Color Options• Shutter Speed

• I/O Pin for LED Circuit• Control Potentiometer

• 12-Bit ADC• Proximity Sensor• Temperature Sensor


COMIT TouchSystems

19

CAMERA

TCM8230 Inputs/Outputs

• Parallel Data Out• D0 – D7

• I2C Bus• Control Registers

• 30 FPS• YUV Format (3 Bytes)• Luminance (Y)• Chrominance (UV)

• Sub-QCIF (128px x 96px)


COMIT TouchSystems

20

PROGRAMMER

AVRISP MKII SPECIFICATIONS

• Program AVR• PDI 6 pin Interface


COMIT TouchSystems

21

TESTING RESULTS

TEST BOARD SOFTWARE

• Test Major Components• Microcontroller √• Camera• Voltage Regulators √ • Proximity Sensors

• Drivers for MCU √


COMIT TouchSystems

22

IMAGE PROCESSING SYSTEM OVERVIEW

JUSTIN BARTH


COMIT TouchSystems

FPGA IMAGE PROCESSING SYSTEM


COMIT TouchSystems

Imag

ing

S

yste

m

Alt

era

DE0

Rasp

berr

y P

i

8 Line Parallel Camera Data

Horizontal EndFrame End

Camera Clock Touch Coordinatesin TUIO FormatAvailable Input

5v USB

GPIO

RS-2

32

23

20MHz Clock

24

FPGA

Altera DE0 INPUTS/OUTPUTS


COMIT TouchSystems

• 72 GPIO pins

• RS-232 Serial Out• 115,200 baud

• 50MHz

25

RS-232 TO USB ADAPTER

RS-232 to USB Adapter INPUTS/OUTPUTS


COMIT TouchSystems

• RS-232 on FPGA

• USB on Raspberry Pi

26

FPGA DATA SENT OVER RS-232


COMIT TouchSystems

BLOB DETECTION ALGORITHM


COMIT TouchSystems

For each luminance pixel in frame if pixel ≥ brightness threshold for neighbor in pixel neighbors if neighbor is part of a blob pixel is incorporated into that blob if pixel not assigned a blob pixel assigned to new blob compare location of new pixel with blob parameters determine left, right, top, bottom most points of blob

Draw boxes around each blobUse center point of boxes to determine touch coordinates to send out

27

28

BLOB DETECTION ALGORITHM IN MATLAB


COMIT TouchSystems

Basic image of IR touch blobs Image after processed through Matlab algorithm

29

APPLICATION FRAMEWORKOVERVIEW

NATE TURLEY


COMIT TouchSystems

30

FUNCTIONAL DECOMPOSITION

5 V

Pro

jecto

r

Raspberry Pi

Imag

e

Pro

cessin

g

Syste

mTUIO Spec via COM port

HDMI

31

RASBERRY PI BOARD

SPECIFICATIONS

• 700 MHz ARM11• Overclocking

• Broadcom VideoCore IV• OpenGL ES 2.0

• USBx2 via integrated Hub• HDMI Video Output• 5v, 700mA, 3.5 W• OS: Raspbian


COMIT TouchSystems

Broadcom BCM2835 SoC

32

SOFTWAREOpenFrameworks• Open source c++ toolkit• Game engine architecture• Setup()• Update()• Draw()

• Built in event listener• Custom Event Args• Callbacks

• OpenGL ES 2.0• Standard for embedded accelerated graphics• Hardware floating point support


COMIT TouchSystems

33


COMIT TouchSystems

UML CLASS DIAGRAMCRITICAL SOFTWARE COMPONENTS

34

APPLICATION FLOW CHART


COMIT TouchSystems

35

PROJECTOR

ViewSonic PDJ5351 SPECIFICATIONS


COMIT TouchSystems

• 23’’ Throw Distance

• 2500 Lumens

• 3000:1 Contrast Ratio

• $420

36

STRUCTURALSYSTEM OVERVIEW

NATHAN GLAB

Presenter: Nate GlabCapstone Senior Design 2012

COMIT TouchSystems

37

TABLE STRUCTURE


COMIT TouchSystems

38

TABLE STRUCTURE


COMIT TouchSystems

39

INSIDE TABLE STRUCTURE


COMIT TouchSystems

40

BUDGET OVERVIEWJENNIFER COFER


COMIT TouchSystems

41

BUDGET

Item Company Unit Price Quantity Total Cost

Projector $420 1 $420

IR LED Reel EnvironmentalLights.com

$215 - $21.50 (estimated)

1, length 5m

$193 (estimated)

Rear Projection Sheet (diffuser)

Acrylite $152.57 - $15.26

1, 40x25in $137.31

Endlighten T Acrylic (Polished)

Acrylite $219.34 - $21.93

1, 40x25in $197.41

Plexiglas Overlay

Home Depot $109 1, 40x25 $109


COMIT TouchSystems

42

BUDGET

Item Company Unit Price Quantity

Total Cost

Proximity Sensing Board Final

Advanced Circuits

$33 1 $33

AVRISP Microcontroller

Atmel $56.64 1 $56.64

Proximity LEDs Sparkfun $1.35 48 $64.80

CMOS Camera Sparkfun $9.95 2 $19.90

Potentiometer Mouser $3.04 2 $6.08

LED Driver Mouser $2.48 2 $4.96

IR LED track materials

$50 $50


COMIT TouchSystems

43

BUDGET

Item Company Unit Price Quantity Total Cost

Sound System

Provided 1 1 N/A

Structural Materials

Home Depot $150

Proximity Sensing Board Draft

Advanced Circuits

$33 1 $33

Total $1,481.18


COMIT TouchSystems

44

ECONOMIC ASPECTS

• Marketability of system: • Could decrease teachers needed (esp. special education)• Could supplement homeschooling • Could extend past an educational environment• Cost expected to decrease in mass production


COMIT TouchSystems

45

RISKS & IMPACTSOVERVIEWJENNIFER COFER


COMIT TouchSystems

46

ENVIRONMENTAL IMPACTS

• Acrylite is Green and LEEDs certified • “We are committed to minimizing our environmental impact.

Operating under the Guiding Principles of Responsible Care®, we strive to continuously improve our health, safety, and environmental performances. Our goal is to improve the environment by supplying sustainable and long-living acrylic products to the green building sector and to all other markets we serve.”

• Environmental Lights has A New Angle on Green• “At EnvironmentalLights.com we believe in sustainable lighting

solutions that are energy-efficient and long-lasting, which lowers energy use and minimizes the environmental impacts from manufacturing and waste.”


COMIT TouchSystems

http://www.acrylite.net/product/acrylite/en/about/green-statement/pages/default.aspx

http://www.environmentallights.com/green

47

RISK MITIGATION & SAFETY

• Temperature• Fans• Ventilation• Overall heat sensor (in LED circuit)• Temperature sensor on camera board / projector unit

• Dust• Fans • Devices accessible for cleaning

• Followed Component Specifications (linked below)• Acrylic here• IR LEDs here

• Followed UL Guidelines (linked here)Presenter: Jenny Cofer

Capstone Senior Design 2012COMIT TouchSystems

http://www.acrylite.net/sites/dc/Downloadcenter/Evonik/Product/ACRYLITE/3735-endlightent-technical-brochure.pdf

http://www.environmentallights.com/files/documents/ir_light_hazard.pdf

http://www.ul.com/global/eng/pages/

48

SOCIETAL IMPACT

• Defying educational conventions• “Spoon feeding in the long run teaches us

nothing but the shape of the spoon” ~ E. M. Forster

• Providing the alternative• “It is the supreme art of the teacher to awaken

joy in creative expression and knowledge.~ Albert Einstein


COMIT TouchSystems

49

SCHEDULE OVERVIEW

NATHAN GLAB


COMIT TouchSystems

SCHEDULE

50

SCHEDULE

Date Description DeliverableSept. 25/27 Milestone 1

Oct. 16/18 PDR

Oct. 23/25 Functional Decomposition

Nov. 13/15 Milestone 2

Dec. 4/6 CDR

Jan. 15/17 Milestone 3 Materials Ordered Have the Structure Assembled Application Framework complete Camera Driver set up Matlab blob detection optimized

Apr. 16/18 Milestone 4 FPGA Implementation Camera to FPGA integration FPGA to CPU integration Environmental Sensor Implementation Software Application Implementation

Apr. 23/25 Expo Completed table with custom software running

51


COMIT TouchSystems

52

QUESTIONS?


COMIT TouchSystems

critical design review comit. contents motivations mission overview stakeholders sponsors team...

Documents

ac power

ac touch display audio

music presenter

mediocre teacher

good teacher

superior teacher

great teacher

end users