You’ve Got You’ve Got SARS!!SARS!!

Group 6Group 6

Brent AndersonBrent AndersonLauren CutsingerLauren CutsingerMartin GilpatricMartin GilpatricMichael ObergMichael ObergMatthew TaylorMatthew Taylor

Capstone Spring 2006

Presentation OutlinePresentation Outline

Project OverviewProject Overview

ImplementationImplementationHardwareHardware

SoftwareSoftware

Project OrganizationProject Organization

Risk and ContingencyRisk and Contingency

IR in Medical ApplicationsIR in Medical Applications First-Pass Diagnostic ToolFirst-Pass Diagnostic Tool

Soft tissue injuriesSoft tissue injuries Circulatory ProblemsCirculatory Problems

ResearchResearch Biological response to low frequency appliancesBiological response to low frequency appliances Physical exercise and hypothermia researchPhysical exercise and hypothermia research

Passively screen for a selection of biological agents Passively screen for a selection of biological agents Quick response to possible pandemicsQuick response to possible pandemics Airports, office buildings and other mass transit areasAirports, office buildings and other mass transit areas SARS detection in several airportsSARS detection in several airports

SARS begins with a fever greater than 38°C (100.4°F)SARS begins with a fever greater than 38°C (100.4°F)

Project OverviewProject Overview

Design an infrared tracking system that Design an infrared tracking system that

will control a motorized camera platform.will control a motorized camera platform.

Track infrared image of person.Track infrared image of person.

Display IR image.Display IR image.

Determine Determine temperature of person for temperature of person for

possible disease detection.possible disease detection.

Thermopile Temperature Thermopile Temperature SensorsSensors

Multiple thermocouples in series that Multiple thermocouples in series that provide an extremely sensitive IR sensor.provide an extremely sensitive IR sensor.

Bulky and expensive compared to other Bulky and expensive compared to other types of IR sensors.types of IR sensors.

So Why Thermopiles?So Why Thermopiles?

Breakthroughs in Breakthroughs in Manufacturing process.Manufacturing process. Lower costLower cost Much smaller footprintMuch smaller footprint

Very accurate at –50 to Very accurate at –50 to 450 ° C450 ° C

Correct spectrum for Correct spectrum for HeatHeat

Comes in a 32x32 array!Comes in a 32x32 array!

System OverviewSystem Overview

SPI

SPI

SPI

PWM

VGA

Serial

Major ComponentsMajor Components IR CameraIR Camera PIC ProcessorsPIC Processors Camera MountCamera Mount MotorsMotors PCBPCB Output (PC)Output (PC)

HardwareHardwareProcessors 1.1. Dual PIC18F4550Dual PIC18F4550

MotorsMotors 1.1. Stepper MotorsStepper Motors

2.2. ControllersControllers

Camera MountCamera Mount 1.1. Lynx-B Lynx-B BPT-NSBPT-NS

2.2. Dual axisDual axis

4 Layer PCB4 Layer PCB 1.1. Power & GND planesPower & GND planes

2.2. Lower NoiseLower Noise

3.3. Allow for high speed Allow for high speed 48MHz48MHz

CameraCamera 1.1. ATX25C mini core ATX25C mini core

Why PIC18F4550Why PIC18F4550

Harvard ArchitectureHarvard Architecture Simultaneous data and program memory accessSimultaneous data and program memory access

Built in SPI interfaceBuilt in SPI interface CameraCamera PIC communicationPIC communication

Two PWM Channels for Stepper MotorsTwo PWM Channels for Stepper Motors Development EnvironmentDevelopment Environment

On Chip ProgrammerOn Chip Programmer

48MHz clock48MHz clock 2 UARTs for computer communication 2 UARTs for computer communication USB 2.0 Interface (optional)USB 2.0 Interface (optional)

Why ATX25C?Why ATX25C?

Thermopile 32x32 ArrayThermopile 32x32 ArrayLow Resolution allows for faster data Low Resolution allows for faster data

crunching.crunching.Provides enough data for human detection.Provides enough data for human detection.

SPI InterfaceSPI InterfaceCompatible with PIC18F4550Compatible with PIC18F4550

Why Stepper MotorsWhy Stepper Motors

High precisionHigh precision Up to 1.5 degrees of accuracyUp to 1.5 degrees of accuracy

Compatible With PIC18FCompatible With PIC18F PWM signalsPWM signals

Low cost for precisionLow cost for precision Easy positioning Easy positioning

Software OutlineSoftware Outline

Tracking AlgorithmsTracking Algorithms ““Hot Spot” DetectionHot Spot” DetectionEdge DetectionEdge Detection

Motor control Motor control On Chip Pulse Width Modulation (PWM)On Chip Pulse Width Modulation (PWM)

DisplayDisplayComunication with a PC for display and Comunication with a PC for display and

control.control.

Targeting Software GoalsTargeting Software Goals

Identify the portion of the picture Identify the portion of the picture containing the face of the subject.containing the face of the subject.

Tracking DemonstrationTracking DemonstrationAveragingAveraging

•Averages are taken along both the horizontal and vertical axis.

•The highest value of these averages indicates the hottest cross section in each dimension.

•The intersection of these cross sections should be the center of the warmest body. In this case we are hoping that this body will be the face of the subject.

Tracking DemonstrationTracking DemonstrationDifferentiationDifferentiation

•By differentiating the cross section averages generated in the previous method these plots can be generated.

•The peaks of these plots indicate the planes where there has been the greatest change in value.

•This method will find the boundries of what should be the head of the subject.

InterfaceInterface

Motor controlMotor control Interacting with onboard PWM for use with Interacting with onboard PWM for use with

motor control logic.motor control logic.Display data via a PCDisplay data via a PC

UART connectivity with a Linux machine to UART connectivity with a Linux machine to display pertinant information and raw data.display pertinant information and raw data.

Possibility of screen capture.Possibility of screen capture.Possibility of future additions though PC Possibility of future additions though PC

based processing.based processing.

Project Goals and ConstraintsProject Goals and Constraints

Baseline ObjectivesBaseline Objectives

Advanced GoalsAdvanced Goals

USB2USB2

Advanced Display and User InterfaceAdvanced Display and User Interface

PrintingPrinting

Constraints and Contingency PlansConstraints and Contingency Plans

Baseline ObjectivesBaseline Objectives

IR Camera <-> SPI bus w/ two IR Camera <-> SPI bus w/ two

µcontrollersµcontrollers

Real-time processing of incoming data Real-time processing of incoming data

stream at 10 Frames Per Secondstream at 10 Frames Per SecondDynamic image trackingDynamic image tracking

Determine and record Determine and record temperature datatemperature data

UART Data stream to PCUART Data stream to PC

Baseline Objectives (Cont)Baseline Objectives (Cont)

PC Client software for User PC Client software for User

Interface and ControlInterface and Control

Display of RAW Camera DataDisplay of RAW Camera Data

False Color Representation False Color Representation

with Heat Distributionwith Heat Distribution

Summary Statistics and Summary Statistics and

Indication of Abnormal TempIndication of Abnormal Temp

Advanced Goals and ExtensionsAdvanced Goals and Extensions

USB2 for data transmission, using USB2 for data transmission, using

UART for controlUART for control

Improvements to PC SoftwareImprovements to PC Software Image InterpolationImage Interpolation

Additional ControlsAdditional Controls PausePause

ScreenshotScreenshot

Print ScreenPrint Screen

Project ConstraintsProject ConstraintsAirport UsageAirport Usage

Tracking a single hot-spot (no crowds)Tracking a single hot-spot (no crowds)Limits on tracking speed.Limits on tracking speed.Target must be within predefined Target must be within predefined

distances (lens specific)distances (lens specific)PERSON MUST WEAR CLOTHING!!!!PERSON MUST WEAR CLOTHING!!!!

Face must be exposed.Face must be exposed.Heavy clothing preferred.Heavy clothing preferred.

Hardware ConstraintsHardware Constraints

Timing data on the SPI bus for Timing data on the SPI bus for communication between two processorscommunication between two processors

UART speeds. UART speeds. Camera ResolutionCamera Resolution

Will 32x32 resolution provide accuracy?Will 32x32 resolution provide accuracy? Image Processing SpeedImage Processing Speed

Can we processes 10 FPSCan we processes 10 FPS Smooth Motor Control Smooth Motor Control

Risks and Contingencies Risks and Contingencies

Parts DeliveryParts Delivery IR Camera: Can use CCD which supports SPIIR Camera: Can use CCD which supports SPI

Difficulties with opticsDifficulties with optics Software workarounds / mods to core algorithmsSoftware workarounds / mods to core algorithms Replacement opticsReplacement optics

Inability to process data flow in real-timeInability to process data flow in real-time Slow the data, lower the frame rateSlow the data, lower the frame rate Stage the data with external RAM componentsStage the data with external RAM components Add additional micro-controllers and design parallel Add additional micro-controllers and design parallel

processingprocessing

Team PlanningTeam Planning

• Cost of ImplementationCost of Implementation• Individual Member TasksIndividual Member Tasks• Team Milestones and GoalsTeam Milestones and Goals• Questions?Questions?

Camera 850.00$ Lens 150.00$ Camera mount 25.00$ 4-layer PCB Rev 1 125.00$ 4-layer PCB Rev 2 125.00$ Misc. Electronic parts 200.00$ Processor Programming Hardware 100.00$ Motors 50.00$

Total: 1,625.00$

CostsCosts

TasksTasks

Team Team MemberMember

Main TasksMain Tasks

BrentBrent • Core Chip ProgrammingCore Chip Programming• Overall Product DesignOverall Product Design

LaurenLauren • PCB LayoutPCB Layout• Mechanical Assembly Mechanical Assembly

MartinMartin • Targeting SoftwareTargeting Software• UART InterfacingUART Interfacing

MichaelMichael • Image Post-Processing Image Post-Processing • PC Client InterfacePC Client Interface

MatthewMatthew • PCB LayoutPCB Layout• Motor InterfacingMotor Interfacing

TimelineTimeline

TimeframeTimeframe Desired Deliverables Desired Deliverables

CDRCDR 1.1. Initial 4 Layer PCB DesignInitial 4 Layer PCB Design

2.2. Reading Camera Data, DisplayReading Camera Data, Display

3.3. Basic Motor ControlBasic Motor Control

Milestone 1Milestone 1 1.1. 4 layer PCB rev. 24 layer PCB rev. 2

2.2. Basic TrackingBasic Tracking

Milestone 2Milestone 2 1.1. Advanced TrackingAdvanced Tracking

2.2. Basic PC InterfaceBasic PC Interface

ExpoExpo 1.1. Complete PC InterfaceComplete PC Interface

Questions?Questions?