interaction and opengl 3d graphics using microsoft kinect and cycling ’74 max by dale phurrough
DESCRIPTION
During this university style interactive session, you will learn easy methods for connecting to the Microsoft Kinect 3D depth sensor using patching tools like Cycling ’74 Max. After briefly learning the basics, you will see how two streams of data from the Kinect can be manipulated easily using Max and displayed in an interactive OpenGL 3D graphics environment. You will leave the session with access to the code examples from which you can learn and reuse. Prior knowledge of the Kinect, Max, or OpenGL graphics is not required. Questions from you, the participants, are encouraged.TRANSCRIPT
![Page 1: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/1.jpg)
Interaction and OpenGL® 3D graphics using Microsoft® Kinect® and Cycling ’74 Max®
Dale Phurrough
![Page 2: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/2.jpg)
Hello World:Procedural Languages
#include <stdio.h>int main(){ printf("Hello World"); return 0;}
program Hello;
begin write('Hello World');end.
do puts "Hello World"end
<? echo "Hello World";?>
![Page 3: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/3.jpg)
Hello World:Visual Patching Languages
![Page 4: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/4.jpg)
Cycling '74 Max
● Visual patching environment/language with 23 year history
● Original ancestor from IRCAM; French institute for science about music and sound
● World-wide use by musicians, developers, researchers, and visual artists
● Enhancements (extensions) are both open source and commercial
● Available for Windows and OS X
![Page 5: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/5.jpg)
Microsoft Kinect
● Released Nov 2010 for Xbox 360® gaming● Quickly hacked for art and robotics● Microsoft responded with hardware refresh and
SDK● Includes 4 sensors
– Depth camera for 3D
– Color camera
– Accelerometer (gravity rotation)
– Audio microphone array
![Page 6: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/6.jpg)
Depth Camera for Kinect
● Position in real distance (meters)
● Coordinates in X, Y, Z
● Head = 0.0, 0.8, 2.0
2.0 m
0.8
m
![Page 7: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/7.jpg)
3D Computer Graphics
● Commonly used today in all media
● Range of power from handys clusters of →computers
● Two common programming standards: OpenGL and Direct3D
![Page 8: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/8.jpg)
OpenGL 3D graphics
● Cross-platform (Windows, Android, Linux®, OS X, and more)
● Coordinates in X, Y, Z
![Page 9: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/9.jpg)
Max OpenGL Kinect↔ ↔
X
YZ
![Page 10: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/10.jpg)
Time to Code...Time to Patch
Patching time...
![Page 11: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/11.jpg)
Patch 1: Hello World
![Page 12: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/12.jpg)
Patch 2: Hello World in OpenGL
![Page 13: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/13.jpg)
Path 3: OpenGL shapes and color
![Page 14: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/14.jpg)
Path 4: Kinect Interactive OpenGL
![Page 15: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/15.jpg)
Cycling '74 Max
Slides and code are available on my website:
http://hidale.com Seminars
![Page 16: Interaction and OpenGL 3D graphics using Microsoft Kinect and Cycling ’74 Max by Dale Phurrough](https://reader033.vdocuments.us/reader033/viewer/2022060123/55978fac1a28abd0368b478d/html5/thumbnails/16.jpg)
Credit Notices
● Max/MSP and Jitter are trademarks of Cycling '74
● Mac, Mac OS, and OS X are trademarks of Apple Inc.
● Windows is a registered trademark of Microsoft Corporation in the United States and other countries.
● Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
● OpenGL is a registered trademark of Silicon Graphics, Inc.
● All other product and company names are trademarks or registered trademarks of their respective owners.