dream-a-bot

35
DREAM-A-BOT TECHNOLOGY ROBOTIX SOCIETY IIT KHARAGPUR

Upload: technology-robotix-society

Post on 15-Mar-2016

215 views

Category:

Documents


1 download

DESCRIPTION

The slides for dream a bot initiative and Kinect workshop conducted by Technology Robotix Society, IIT Kharagpur.

TRANSCRIPT

Page 1: Dream-a-bot

DREAM-A-BOT

TECHNOLOGY ROBOTIX SOCIETY

IIT KHARAGPUR

Page 2: Dream-a-bot

WHAT IS DREAM-A-BOT?

Initiated by TRS last year

Proposals for sufficiently large-scale robotics

projects were invited

The chosen project would receive mentorship,

financial and logistical support from TRS

The first project was The Quadrotor

Page 3: Dream-a-bot

THE QUADROTOR

A multi-copter propelled by 4 rotors

Used as a UAV in security and surveillance, and

for robotics research

The Dream-A-Bot Quadrotor Project began

recently in Kharagpur

Roadmap has been laid; the rotors have been

tested; and the Inertial Measurement Unit has

been set up

Page 4: Dream-a-bot

THE WORK AHEAD!

EMBEDDED – IMU interfacing; Brushless DC

Motor Control; Feedback and PID

MECHANICAL – Aerodynamics; Flight Control

PROGRAMMING – Implementation of Flight

Algorithm; Computer Vision for navigation

Page 5: Dream-a-bot

DREAM-A-BOT 2.0

We are now looking for something centered

around using the Microsoft Kinect as an

integral part of the robot

We will be receiving ideas till June 30

Exact details for submission will be mentioned

later

The chosen idea will be the next Dream-A-Bot

project and the proposer responsible for it.

Page 6: Dream-a-bot

Image ProcessingBasics

Page 7: Dream-a-bot

WHAT IS IMAGE PROCESSING?

Accessing the data stored in an

image and working with it is called

Image Processing

Page 8: Dream-a-bot

WHAT IS AN IMAGE?

It is a 2 dimensional array of pixels with

each pixel having an unsigned value

between 0 and 255.

Page 9: Dream-a-bot

RESOLUTION

Defines how many pixels are there in the image

If an image has the resolution of [ 800 X 600 ] it

means that the image is a two dimensional

array of size[800][600] that is 800 pixel in the

horizontal direction for each of the 600 pixel in

the vertical direction.

Page 10: Dream-a-bot

PIXEL

Units which make up the image are

called pixels.

These contain valueS depicting the

shade of the particular cell.

Page 11: Dream-a-bot

CHANNELS

It is the number of divisions in a particular pixel.

Grayscale images have 1 channel – with value of each pixel

from 0 to 255

Normal colored images (Blue-Green-Red) have 3 channelas, the

shade of each pixel results from the combination of these 3

values.

Page 12: Dream-a-bot

THRESHOLD

In segmentation, it is the value of a particular channel set by the

programmer which is the border line between the wanted and

the unwanted pixels.

Page 13: Dream-a-bot

HISTOGRAM

A Graphical representation of the integral value

of the pixels versus the frequency of each pixel.

Page 14: Dream-a-bot

KINECT FOR WINDOWS

An overview

Page 15: Dream-a-bot

MICROSOFT KINECT

Senses depth, gestures, motion, sound and much

more.

Natural user

interface.

Lively interaction

with technology.

Page 16: Dream-a-bot

SENSOR COMPONENTS

Page 17: Dream-a-bot

HOW DOES IT WORK?

RGB Camera : Makes capturing colour pictures

possible.

IR emitter & IR depth sensor : Gets the “depth” for each

pixel

Multi-array microphone : Possible to record audio as

well as find the location and direction of it.

3-axis accelerometer : Possible to determine the

current orientation of the Kinect.

Page 18: Dream-a-bot

FEATURESFace Tracking and Recognition

Page 19: Dream-a-bot

FEATURESSkeleton Tracking

Page 20: Dream-a-bot

FEATURESGesture Recognition

Page 21: Dream-a-bot

FEATURES3D Reconstruction

Page 22: Dream-a-bot

FEATURESAudio Localization

Page 23: Dream-a-bot

APPLICATIONSGaming

Page 24: Dream-a-bot

APPLICATIONSGaming

Page 25: Dream-a-bot

APPLICATIONSNext-Gen User Interfaces

Page 26: Dream-a-bot

APPLICATIONSHealthcare

Page 27: Dream-a-bot

APPLICATIONSRobots – Human Mimicry

Page 28: Dream-a-bot

APPLICATIONSRobots – Autonomous Vehicles

Page 29: Dream-a-bot

WHAT IS REQUIRED TO ‘KINECT’ ?

All you need to get started with development

for the Kinect is -

A Kinect Sensor

A Windows Computer

Microsoft Visual Studio

Page 30: Dream-a-bot

GETTING STARTED

Log on to http://www.microsoft.com/en-us/kinectforwindows/

Page 31: Dream-a-bot

BUYING A SENSOR

You can shell out ~ Rs. 9,000

OR….

Page 32: Dream-a-bot

IDEAS! IDEAS! IDEAS!

Ideas and proposals for robotics projects

involving the Microsoft Kinect are now

being invited as part of the Dream-A-

Bot initiative.

So get thinking and fire away!

Page 33: Dream-a-bot

PROJECT PROPOSALS

The proposal should not be longer than 2

pages.

It should be in a .doc(x) or .pdf format.

It should include the following :

a) Project Title

b) Motivation and Applications

c) Working Idea

d) Time Span (Weekend/Semester/Long-Term)

e) Financial Requirements

f) Milestones and Possible Extensions

Page 34: Dream-a-bot

SUBMISSIONS

Send the draft of your proposals to

[email protected]

The deadline is June 30, 2013

The selected entry(ies) will be chosen as

part of the Dream-A-Bot initiative and the

proposers will be the project leaders

Page 35: Dream-a-bot

THANK YOU!

LOOKING FORWARD TO YOUR IDEAS!