KINECT INTERFACE

Project By: Brent Elder, Mike Holovka, Hisham Algadaibi

What is our project about? Design an interface for Window 7

Controlled by the Microsoft Kinect Device

Why?

Gesture based interaction between humans and computers have seen a large growth in popularity

To start developing towards interfaces that adapt more to humans

Get beyond the traditional input devices

Break into the field of gesture recognition

Goals

Gesture Recognition Software that will translate our gestures and

movements recorded by the Kinect into commands that will control our interface

Voice Recognition

Applications An array of different interface components

and applications that will respond our gestures

Who is it for?

We are the clients

Research into the field of Human – Computer interaction

Benefit our future careers

Help to inspire future students

How?

Kinect SDK

Rainmeter: Desktop Customization Tool

Hardware

RGB Camera 3D depth sensors Multi-array microphones Motorized tilt

What is Kinect SDK?

Programming toolkit Drivers Rich APIs for raw sensor streams

Languages

Concept Video

Features

Raw sensor streams

Skeletal tracking

Depth Data

Advanced audio capabilities

Rainmeter

Desktop Customization Tool

Allows you to place fully customizable widgets on desktop Range from monitoring system resources to controlling

media player Run shell commands

Free and open source Source Code available at Google Project site

Vocab

Rainmeter Plugins

Plugins: .dll file which provides additional functionality not

included in installation

Plugins are developed using C# or C++ Same as Kinect SDK

Development team includes plugin template file On Google Project Site

Rainmeter Plugins Continued Also include toolkit (Rainmeter.cs)

which provides the necessary development tools

Soon to be Wiki page up for plugin development as well

Success Criteria

Creation of software that will translate predefined gestures into commands

Interface that will respond accordingly to those commands

Learning experience

Risks

Programming difficulties

Not enough time to finish all features

Kinect SDK in Beta 2

Inaccuracy of the Kinect Device

Incapability of Kinect SDK with Rainmeter

Design

Planned Gestures

Hand moving (Mouse movement)

One Finger Click (Left mouse click)

Two Finger Click (Left mouse double click)

Horizontal and Vertical Swipe motion

Grab and hold (ex. Dragging files)

Keyboard command short-cuts

Planned Voice Commands

Kinect Activate

Kinect Deactivate

Kinect Shutdown

Kinect Restart

Kinect Sleep

Data Modeling

Not a database driven system

Gestures will be identified within the code

Voice commands may be able to be store in a database

Functional Requirements

Accept input from the Kinect sensor Ability to interpret different hand

gestures Ability to interpret different voice

commands Simple mouse control A variety of different applications that

are part of the interface. The interface will recognize at most two

hands and one person

Gantt Chart - Research

Gantt Chart – Development Phase 1

Gantt Chart –Development Phase 2

Gantt Chart – System Testing/Refactoring

Division of Labor

We are all knowledgeable with code development

We will each be working on every level of the project

Work will be divided evenly among us

Questions?