Some Libraries for Kinect

1

2. Open NI

Open NI supports many API functions, can combine

middleware to increase ability for Kinect.

* Support:

- Detect gesture.

- Skeleton tracking

- Windows, Linux, Mac OSX

Some Libraries for Kinect

2

3. Point cloud library

Point cloud is library to process image in 3D space. Having many

algorithms such as: filtering, surface reconstruction, segmentation,

feature estimation… PCL can apply on many platforms such as:

Window, Mac OS, Linux, Android,…

Some applications by using Kinect1. Display the depth image side by side with color image

3

Some applications by using Kinect2. Looking at the pixel

4

Figure 3.2 Display R,G,B values when click mouse on image

Some applications by using Kinect3. Finding the closest Pixel

5

Figure 3.3 Our red circle following my outstretched fist

Implement

1. System design

Figure 4.1 General design

6

7

Rs232

Kinect

USB cable

IRsend sensor

Microcontroller board

Tivi

PC

Implement1. System design

Figure 4.2 Detail design8

1 2 3

1

2

3 Kinect IDE

MCU IDE

Kinect Driver

Implement

9

Define pin

Start

Set communication

Up Down

LeftRight

Val 1, Val 2, Val 3

Val 1 = 1 Val 1 = 2 Val 1 = 0

YesNo

YesNo

Yes

Val 2 = 1 Val 2 = 2

Yes

No

Val 2 = 0

No

Disable

Yes Yes

Stop

Conclusions

10

The Kinect has been one of the pioneer in the consumer market of the human / virtual environment interaction without using some actual buttons or controller, but only by using natural gesture or speech. We have seen that this field has progressed a lot since the Kinect has been released (a bit more than 1 year) and find its application in many different domain whereas the Kinect was orignally planed to be mostly used for games. The Kinect has opened the doors of the Virtual and Augmented Reality to everybody but it is not the perfect device, it still needs a better reliability (better sensors, cameras and microphones) also related components, or combined (screens, robotics...) need to be improved to develop all the capacity of the Kinect.

11

References[1] Chumbley, Eric M., Francis G. O'Connor, and Robert P. Nirschl. "Evaluation of Overuse Elbow Injuries - February 1, 2000 - American Academy ofFamily Physicians." American Academy of Family Physicians. American Academy of Family Physicians, 1 Feb. 2000. Web. 12July 2011. <http://www.aafp.org/afp/200 <http://www.aafp.org/afp/20000201/691.html>.

[2] “Golf Swing Tips.” Golf Swing Tips.Golfswingtips.4u.com, 2011. Web. 9 July2011. <http://golfswingtips4u.com/>.

[3] “OpenNI Modules.” Downloads.OpenNI TM, Nov. 2010. Web. June-July2011. <http://www.openni.org/>.

[4] “Physical Therapy Charges.” AkronGeneral. Akron General Health System,2011. Web. 14 July 2011.<http://www.akrongeneral.org/>.

[5] “Shoulder Problems and Injuries – TopicOverview.” WebMD. WebMD, LLC, 2011.

12

Thank you for your attention