itp camp kinect class
DESCRIPTION
Slides from a class by Greg Borenstein presented at NYU ITP summer camp 2011TRANSCRIPT
Greg Borenstein@atduskgreghttp://ideasfordozens.com
Intro to the Kinect: Gestural Interfaces
ITP ResidentKinect Book for OʼReillySpecial Effects
About Me
About You
Processing experience?Understand 3D?Worked with the Kinect?On Windows?
The Plan
What is the Kinect?A stupid example of a gestural interfaceThe ingredients: joint position and 3D mathWhat makes a good gestural interface?A better example of a gestural interfaceHands-on
IR Projector
Image courtesy of futurepicture.org
IR Projector
IR Projector IR Camera
IR Projector IR CameraRGB Camera
Depth ImageRGB Image
Skeleton Data
$2000
$2000 $3000
Nov. 4 - Nov. 10
Processing.org
Dan Shiffmanphoto by Jeff HowardNYU ITP
openni.org
Simple OpenNIcode.google.com/p/simple-openni
Something Stupid
Something Stupid
Control Emacs with Your Beard w/ Devin Chalmers at Open Source Bridge
code here: https://github.com/qwzybug/osb-kinect
DEMO
How does this work?Measure distance between jointsTrigger actions using Robot
Get Position of Jointskinect.getJointPositionSkeleton()joint.dist()
DEMO
Measuring things in 3DOrientation of coordinate system Control the size and position of an image
DEMO
What makes a good gestural interface?
Kinect Abnormal Motion Assessment System
Involuntary Motion Disorders like Chorea van Sydenham, Tardive Dyskinesia, and Parkinsonʼs
motionassessment.com
Kinect Abnormal Motion Assessment System
Involuntary Motion Disorders like Chorea van Sydenham, Tardive Dyskinesia, and Parkinsonʼs
motionassessment.com
Kinect Abnormal Motion Assessment System
Won the National Health 2.0 Developer Challenge. Maybe improve treatment.
motionassessment.com
What do you want to make?
Making Things See:Hacking Computer Vision with the Microsoft Kinect, Processing, and Arduino
Beta “Real Soon Now” from OʼReilly
