KINECT CONTROLLED PC

George (Hank) SchultzEastern Kentucky University

NET Program

2

OUTLINE My presentation explores the

possibility of what is possible with the Microsoft Kinect

I’ll cover what people around the world are doing with Kinect functionality

Also, go over the history of Kinect ‘hacking’

3

OUTLINE I’ll discuss some interesting

articles I found on the subject Will talk about my project Show a video Take questions

4

MOTIVATION Biggest

motivation is interest

I have read a lot of information online prior and wanted to research further

There have been many great projects done in the past

5

MOTIVATION

Happened to have a Kinect that I didn’t use a lot

A lot of great resources and articles on the topic online

6

INTRODUCTION Microsoft released the Kinect in

November of 2010 Originally only for use with the

Xbox 360 Not long after release people

were already looking for exploits Within six months hundreds of

different hacks were out

7

INTRODUCTION Most of

research done was through discussion boards and forums

Other research was articles written on the topic of using the Kinect with the PC

8

PROBLEM STATEMENT What I wanted to with my project

was be able to control a PC in some fashion using the Kinect

Basically, what I wanted to do, was emulate in some form what I had seen so many others do.

How can I use my Kinect device that I got for my Xbox, as a PC controller?

9

ASSUMPTIONS I assumed it would have been a lot

more difficult to interface the Kinect with my PC

Initially it was not difficult, but I was unable to do as much with it as I initially wanted.

10

PROPOSED SOLUTION My final project is able to use the

Kinect as a mouse (with limited functionality)

Easy to use and activate program Combined with other programs to

get to work correctly End result works great! Help from the following programs

11

PROPOSED SOLUTION OpenNI

Program to start testing drivers Helpful with Kinect hacking Open source Kinect framework for PC

12

PROPOSED SOLUTION PRIMESENSE

NITE This software helps the Kinect view

what it sees as a 3D space, which is neccesary to recognize the user and the user’s commands

13

PROPOSED SOLUTION

This program really drives the whole project

After everything is set up, this one powers the Kinect and is the interface between it and the computer

14

RESULTS After much research,

troubleshooting, uninstalling, reinstalling, and messing around with the different software and drivers, I was able control my PC with the Kinect

15

RESULTS My original plan was to have a

media center controlled Kinect, but I did not have the resources I thought I did, but included is a clip of somebody else’s

clip

16

RESULTS Here is a video of me setting

everything up and actually controlling my PC with the Kinect

And yes before you ask, I felt a little like a Jedi.

Clip -excuse the watermark, I had to reduce size and this was the only way that worked

17

18

19

20

21

RESULTS As I stated earlier there are a lot

really interesting projects going on with the Kinect right now, I’ll share a few of them with you right now.

NAVI 3D-Image

22

CONCLUSIONS Before I started this project, I just

had a passing interest in Kinect ‘hacking’

After actually doing it myself, and seeing what others have done, I will definitely keep up on the research, and continue to see what else I can do with the Kinect

23

CONCLUSIONS I learned a lot about trouble

shooting Through this project I gained a lot

of knowledge of forums and message boards and was able to obtain a lot of help using them.

24

CONCLUSIONS I think that this type of technology

will only get more advanced, and used more widely as time goes on.

Kinect technology has already improved the field of robotics quite a bit.

25

FUTURE WORK I really enjoyed working on this

project, and even though I basically just have the beginning framework done, I’m excited to see what else I can do.

Eventually, when I have more resources I’d like to something like this.

26

FUTURE WORK Other ideas

Kinect controlled room, lights, fan, media center etc.

3D model capturing Add voice control

27

FUTURE WORK Any questions or suggestions?

28

29

CONTACT My name is Hank Schultz My permanent email address is

hank3hank@gmail.com

30

PROJECT REFERENCES Fish, E. (2011, June 4). Kinect Hack Creates Actual 3D Telepresence.

Retrieved March 26, 2012, from PCWorld: http://www.pcworld.com/article/229405/kinect_hack_creates_actual_3d_telepresence.html

Giles, J. (2010). Inside the race to hack Microsoft's Kinect. New Scientist.

Jared. (2011, February 2). Beginners Guide to Setting Up Your Microsoft Kinect for Windows PC Hacking. Retrieved March 22, 2012, from KINECT- HACKS: http://kinect.dashhacks.com/kinect-guides/2011/02/02/beginners-guide-setting-your-microsoft-kinect-windows-pc-hacking

Joel. (2011, January 17). Control Windows Games & Apps with an XBox Kinect camera. Retrieved March 27, 2012, from Kinemote: http://www.kinemote.net/community/viewtopic.php?f=12&t=24

Pirrilo, C. (2011, June 24). How to Hack Kinect (Officially). Retrieved March 22, 2012, from YouTube: http://www.youtube.com/watch?v=-j8y4iMYxSI

Tanz, J. (2011, June 28). Kinect Hackers Are Changing the Future of Robotics. Retrieved 22 March, 2012, from Wired: http://www.wired.com/magazine/2011/06/mf_kinect/all/1

31

VIDEO REFERENCES Griffindod. (2010 December 23). KinEmote Control Windows Media

Center, Boxee, XBMC & more Microsoft Kinect. Retrieved April 29, 2012, from Youtube: http://www.youtube.com/watch?v=3y0JT0xR_a4

HCiKonstanz. (2011 March 22). NAVI -- Navigational Aids for the Visually Impaired. Retrieved April 29, 2012, from Youtube: http://www.youtube.com/watch?feature=player_embedded&v=l6QY-eb6NoQ

Ikaziso. (2011 January 12). Control the Humanoid Robot by Kinect. Retrieved April 20, 2012 from Youtube: http://www.youtube.com/watch?v=w8BmgtMKFbY

KinectHacks. (2012 November 14). Using Kinect to Capture Video in 3D. Retrived April 29, 2012 from Youtube: http://www.youtube.com/watch?v=KW9of1Ud0uo

32

IMAGE ACKNOWLEDGEMENTS

Taken from www.xbox.com

Taken from www.xbox.com

Taken from http://75.98.78.94/default.aspx

33

IMAGE ACKNOWLEDGEMENTS

Taken from www.kinemote.net

Taken from http://timstephenson.blogspot.com/2010/11/return-of-jedi.html