EEC 490 GROUP PRESENTATION: KINECT TASK VALIDATION

Scott KrugerNate Dick

Pete HogrefeJames Kulon

PART ONE: INTRODUCTION

Project Proposal Create Guidelines Of Kinect

Parameters Accuracy Of The Kinect Sensors Use Of Multiple Kinects Static, Dynamic Movement Data

Collected

INTRODUCTION CONTINUED

Work With Health Science Professors Use Eight Camera Motion Analysis

System Compare Kinect Accuracy To Eight

Camera Motion Analysis System Establish Limitations Of Kinect

Hardware

INTRODUCTION CONTINUED

Six Exercises Hamstring Stretch Sitting Position Scapular Plane Turn Sit To Stand Lateral Weight Shifting In Standing Video Game Bowling In Sitting Side Lying Hip Abduction

PART TWO: SOFTWARE

C# Microsoft SDK 1.0 SQL Databases

Storage Retrieval

Exporting Data Collected To Excel

SOFTWARE CONTINUED

Twenty Joints Of Detection Database: Data Storage

Body Part (string) X Coordinate Position (float) Y Coordinate Position (float) Z Coordinate Position (float)

SOFTWARE CONTINUED

Skeleton

SOFTWARE CONTINUED

Initial Design Functionality Start, Stop Recording Collect Data Tilt Camera Up/Down Green Dots Highlight Joint Of

Detection Export To Excel

SOFTWARE CONTINUED

SOFTWARE CONTINUED

Advanced Design Functionality Replay Skeleton Movements Slow, Pause Skeleton Different Views Total Frames Collected

SOFTWARE CONTINUED

PART THREE: MOTIONS LAB DEMO

MOTIONS LAB DEMO CONTINUED

Health Science Department (03/23/12)

Four Kinects Front, Back, Side, Corner Angles Different Heights Different Separation Of Distance To

Center

MOTIONS LAB DEMO CONTINUED

Health Science Lab Requirements 37 Strobes Of Detection Placed On

Body User Only Wears Shorts Shorts Are Tied Distance, Angles Of Some Joints Must

Be Measured: Ankles To Knees

MOTIONS LAB DEMO CONTINUED

Eight Exercises Walking Weight Shift- Arms Out, Side To Side Weight Shift- Foot Out, Front To Back Wrist Rotation Sword

MOTIONS LAB DEMO CONTINUED

Eight Exercises (Continued) Stand To Sit To Stand With Chair Seated Bowling Hamstring Stretch On Table Hip Abduction On Table

MOTIONS LAB CONTINUED

STANDING WEIGHT SHIFT

MOTIONS LAB CONTINUED

MOTIONS LAB CONTINUED

Observations Weight Shift: Ankle Joints Scattered Sit To Stand, Bowling Sitting: Leg

Joints Estimated Due To Chair Table Exercises: All Joints Scattered Walking: Hard Time Acquiring Data

MOTIONS LAB CONTINUED

Problems Of Demo Only Front Angle Data Useful Heights of Kinects Not Measured Distance From Center Not Measured No Universal Coordinate System

PART FOUR: CAPTURE SESSION

Two Kinects Side-by-Side

CAPTURE SESSION CONTINUED

Grid Layout

GRID LAYOUT

CAPTURE SESSION CONTINUED

Five Separate Movement Sets

CAPTURE SESSION CONTINUED

Data Analysis

CAPTURE SESSION CONTINUED

Data Analysis SDK Scale Is In Centimeters Maximum Depth Is Approximately

Four Meters Field Of View Is 45 Degrees

CAPTURE SESSION CONTINUED

Frame Rate Variance

CAPTURE SESSION CONTINUED

Kinect Can Be Very “Noisy”

CAPTURE SESSION CONTINUED

Abrupt Jumps

CAPTURE SESSION CONTINUED

Z-axis is Most Stable

CAPTURE SESSION CONTINUED

Defined Physical Operating Parameters

Data Anomalies - Software Or Hardware

Better Experimental Setup

PART FIVE: CONCLUSION

Future Progress Good (Green), Wrong (Red) Point

Colors Wrong Point Data Discarded On Screen Grid Animation

CONCLUSION CONTINUED

Algorithms To Solve Limitation Warnings Back Side Extremity Crossing Tables, Chairs Interference

Voice Commands

CONCLUSION CONTINUED

Compare Data To Physical Therapy System

Third Party Packages More Sophisticated More Capable Microsoft SDK 1.0: Barebones

CONCLUSION CONTINUED

Summary Learned How To Program Kinect Found Limitations Of Kinect Collected Data Compared, Analyzed Data

QUESTIONS?