community day 2013 - the power of kinect
DESCRIPTION
The power of Kinect is underestimated. It’s more than a toy used for gaming, it’s a piece of technology that can make our life easier and is evolving fast. This session will try to convince you about the power of Kinect and why developers should look into it. Next to that I’ll explain what the ‘difference’ is between Kinect and Oculus Rift & Leap Motion and why we need to brace ourselves for Kinect 2.0.TRANSCRIPT
The power of Kinect
My name is Tom Kerkhove Owner of Kinecting for Windows Student New Media & Communication Technology at
Howest Microsoft Student Partner for Kinect for Windows &
Windows Azure
Who am I?
How does it work? What can we expect? Kinect for Windows != Xbox360 Kinect & “enemies” The Kinect effect What’s on the horizon Getting started
Agenda
How does it work?
Color Sensor
IR EmitterIR Depth Sensor
Microphone array
Tilt motor
Sensor output
DepthColor AudioAccelerometer & Infrared
Skeleton Tracking
Speech
FaceTracking
Kinect Fusion
ComputedData
HardwareData
What can we expect?
• Ability to get distance of pixel based on the sensor & gives player index
• Default or near mode
Depth
Skeleton Tracking
Tracked Skeleton means:Up to 20 tracked Joints
Up to 6 Skeletons :- 2 Tracked- 4 Position-only
• Two trackingmodes : Default
Seated
• Positions are in three dimensional world based on the sensor.(values are in meters)
Skeleton Tracking
• Tracks loudest audio input
• Automatic ambient noise filter
• Can track position by noise
Speech
• Released since SDK 1.5
• 87 tracked points
• Not unique per user
Face Tracking
• Grip recognition up to 2 persons
• Interaction controls Push
Grip
Cursor
Viewer
Interaction
Kinect Fusion
Kinect for Windows != Xbox360
Kinect for Windows vs Kinect for Xbox360
Features
- Additional features like Near-mode, Seated-mode, shorter USB-cable, extended camera, handgrip, etc.
- Basic features
Pricing - $200 - $250- Free SDK
- $100 - $150- Free SDK
Licensing - For development & public use - For development & xbox use- Not for public use
Sensor output
DepthColor AudioAccelerometer & Infrared
Skeleton Tracking
Speech
FaceTracking
Kinect Fusion
ComputedData
HardwareData
4 m
John Doe PC & Kinect
< 0.8 m
4 m
John Doe PC & Kinect
< 0.8 m
The Kinect effect.
What’s on the horizon?
• Ultra-wide 1080p RGB camera
• Fully track six persons
• Extended joint model Thumbs
Kinect 2.0 for Xbox
• Extended depth HD quality
High fidelity
Active IR (works same in dark)
Kinect 2.0 for Xbox
• Additional tracking Rotation between joints
Forces on muscles
Skin color
Expression (open eyes, smiling, etc.)
Additional tracking
Kinect 2.0 for Xbox
How about Kinect for Windows?
Getting started.
Libraries Official K4W SDK for C#, C++ & VB.net
AIRKinect as a ActionScript 3-wrapper
Kinect for Processing Library or Jnect for Eclipseas a Java-wrapper
KinectJS as a Javascript-wrapper
Getting Started!
Kinect Developer Toolkit & Studio
Kinect Code Libraries
Getting Started!
Kinect for Windows official Official SDK updates & change logs Kinect for Windows news Stay up-to-date Samples on CodePlex
Getting Started!
Human Interface Guidelines UX guidelines for creating applications
that are user-friendly
Learn how to get all the power out of the sensor
Developers need to read this as well
Getting Started!
Pluralsight Building a Real Application With Kinect
Channel 9’s Coding4Fun Features Kinect projects/blog posts/libraries from the community
Getting Started!
Start Here! Learn the Kinect API Looks at the hardware in more depth Fundamentals on the Kinect API Good look-up if you’re new to the SDK or
want to refresh your memory Covers SDK 1.5
Getting Started!
Programming with the Kinect for Windows Software Development Kit Takes Kinect API to the next level
Gestures & Postures
3D representations of the scene
Expert insights
Covers SDK v1.5
Getting Started!
Kinecting for Windows News on Kinect for Windows SDK Updates Cool projects Libraries Tutorials Videos
Getting Started!