community day 2013 - the power of kinect

The power of Kinect

My name is Tom Kerkhove Owner of Kinecting for Windows Student New Media & Communication Technology at

Howest Microsoft Student Partner for Kinect for Windows &

Windows Azure

Who am I?

How does it work? What can we expect? Kinect for Windows != Xbox360 Kinect & “enemies” The Kinect effect What’s on the horizon Getting started

Agenda

How does it work?

Color Sensor

IR EmitterIR Depth Sensor

Microphone array

Tilt motor

Sensor output

DepthColor AudioAccelerometer & Infrared

Skeleton Tracking

Speech

FaceTracking

Kinect Fusion

ComputedData

HardwareData

What can we expect?

• Ability to get distance of pixel based on the sensor & gives player index

• Default or near mode

Depth

Skeleton Tracking

Tracked Skeleton means:Up to 20 tracked Joints

Up to 6 Skeletons :- 2 Tracked- 4 Position-only

• Two trackingmodes : Default

Seated

• Positions are in three dimensional world based on the sensor.(values are in meters)

Skeleton Tracking

• Tracks loudest audio input

• Automatic ambient noise filter

• Can track position by noise

Speech

• Released since SDK 1.5

• 87 tracked points

• Not unique per user

Face Tracking

• Grip recognition up to 2 persons

• Interaction controls Push

Grip

Cursor

Viewer

Interaction

Kinect Fusion

Kinect for Windows != Xbox360

Kinect for Windows vs Kinect for Xbox360

Features

- Additional features like Near-mode, Seated-mode, shorter USB-cable, extended camera, handgrip, etc.

- Basic features

Pricing - $200 - $250- Free SDK

- $100 - $150- Free SDK

Licensing - For development & public use - For development & xbox use- Not for public use

Sensor output

DepthColor AudioAccelerometer & Infrared

Skeleton Tracking

Speech

FaceTracking

Kinect Fusion

ComputedData

HardwareData

4 m

John Doe PC & Kinect

< 0.8 m

4 m

John Doe PC & Kinect

< 0.8 m

The Kinect effect.

What’s on the horizon?

• Ultra-wide 1080p RGB camera

• Fully track six persons

• Extended joint model Thumbs

Kinect 2.0 for Xbox

• Extended depth HD quality

High fidelity

Active IR (works same in dark)

Kinect 2.0 for Xbox

• Additional tracking Rotation between joints

Forces on muscles

Skin color

Expression (open eyes, smiling, etc.)

Additional tracking

Kinect 2.0 for Xbox

How about Kinect for Windows?

Getting started.

Libraries Official K4W SDK for C#, C++ & VB.net

AIRKinect as a ActionScript 3-wrapper

Kinect for Processing Library or Jnect for Eclipseas a Java-wrapper

KinectJS as a Javascript-wrapper

Getting Started!

Kinect Developer Toolkit & Studio

Kinect Code Libraries

Getting Started!

Kinect for Windows official Official SDK updates & change logs Kinect for Windows news Stay up-to-date Samples on CodePlex

Getting Started!

Human Interface Guidelines UX guidelines for creating applications

that are user-friendly

Learn how to get all the power out of the sensor

Developers need to read this as well

Getting Started!

Pluralsight Building a Real Application With Kinect

Channel 9’s Coding4Fun Features Kinect projects/blog posts/libraries from the community

Getting Started!

Start Here! Learn the Kinect API Looks at the hardware in more depth Fundamentals on the Kinect API Good look-up if you’re new to the SDK or

want to refresh your memory Covers SDK 1.5

Getting Started!

Programming with the Kinect for Windows Software Development Kit Takes Kinect API to the next level

Gestures & Postures

3D representations of the scene

Expert insights

Covers SDK v1.5

Getting Started!

Kinecting for Windows News on Kinect for Windows SDK Updates Cool projects Libraries Tutorials Videos

Getting Started!