dream-a-bot
DESCRIPTION
The slides for dream a bot initiative and Kinect workshop conducted by Technology Robotix Society, IIT Kharagpur.TRANSCRIPT
![Page 1: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/1.jpg)
DREAM-A-BOT
TECHNOLOGY ROBOTIX SOCIETY
IIT KHARAGPUR
![Page 2: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/2.jpg)
WHAT IS DREAM-A-BOT?
Initiated by TRS last year
Proposals for sufficiently large-scale robotics
projects were invited
The chosen project would receive mentorship,
financial and logistical support from TRS
The first project was The Quadrotor
![Page 3: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/3.jpg)
THE QUADROTOR
A multi-copter propelled by 4 rotors
Used as a UAV in security and surveillance, and
for robotics research
The Dream-A-Bot Quadrotor Project began
recently in Kharagpur
Roadmap has been laid; the rotors have been
tested; and the Inertial Measurement Unit has
been set up
![Page 4: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/4.jpg)
THE WORK AHEAD!
EMBEDDED – IMU interfacing; Brushless DC
Motor Control; Feedback and PID
MECHANICAL – Aerodynamics; Flight Control
PROGRAMMING – Implementation of Flight
Algorithm; Computer Vision for navigation
![Page 5: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/5.jpg)
DREAM-A-BOT 2.0
We are now looking for something centered
around using the Microsoft Kinect as an
integral part of the robot
We will be receiving ideas till June 30
Exact details for submission will be mentioned
later
The chosen idea will be the next Dream-A-Bot
project and the proposer responsible for it.
![Page 6: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/6.jpg)
Image ProcessingBasics
![Page 7: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/7.jpg)
WHAT IS IMAGE PROCESSING?
Accessing the data stored in an
image and working with it is called
Image Processing
![Page 8: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/8.jpg)
WHAT IS AN IMAGE?
It is a 2 dimensional array of pixels with
each pixel having an unsigned value
between 0 and 255.
![Page 9: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/9.jpg)
RESOLUTION
Defines how many pixels are there in the image
If an image has the resolution of [ 800 X 600 ] it
means that the image is a two dimensional
array of size[800][600] that is 800 pixel in the
horizontal direction for each of the 600 pixel in
the vertical direction.
![Page 10: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/10.jpg)
PIXEL
Units which make up the image are
called pixels.
These contain valueS depicting the
shade of the particular cell.
![Page 11: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/11.jpg)
CHANNELS
It is the number of divisions in a particular pixel.
Grayscale images have 1 channel – with value of each pixel
from 0 to 255
Normal colored images (Blue-Green-Red) have 3 channelas, the
shade of each pixel results from the combination of these 3
values.
![Page 12: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/12.jpg)
THRESHOLD
In segmentation, it is the value of a particular channel set by the
programmer which is the border line between the wanted and
the unwanted pixels.
![Page 13: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/13.jpg)
HISTOGRAM
A Graphical representation of the integral value
of the pixels versus the frequency of each pixel.
![Page 14: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/14.jpg)
KINECT FOR WINDOWS
An overview
![Page 15: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/15.jpg)
MICROSOFT KINECT
Senses depth, gestures, motion, sound and much
more.
Natural user
interface.
Lively interaction
with technology.
![Page 16: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/16.jpg)
SENSOR COMPONENTS
![Page 17: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/17.jpg)
HOW DOES IT WORK?
RGB Camera : Makes capturing colour pictures
possible.
IR emitter & IR depth sensor : Gets the “depth” for each
pixel
Multi-array microphone : Possible to record audio as
well as find the location and direction of it.
3-axis accelerometer : Possible to determine the
current orientation of the Kinect.
![Page 18: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/18.jpg)
FEATURESFace Tracking and Recognition
![Page 19: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/19.jpg)
FEATURESSkeleton Tracking
![Page 20: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/20.jpg)
FEATURESGesture Recognition
![Page 21: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/21.jpg)
FEATURES3D Reconstruction
![Page 22: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/22.jpg)
FEATURESAudio Localization
![Page 23: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/23.jpg)
APPLICATIONSGaming
![Page 24: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/24.jpg)
APPLICATIONSGaming
![Page 25: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/25.jpg)
APPLICATIONSNext-Gen User Interfaces
![Page 26: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/26.jpg)
APPLICATIONSHealthcare
![Page 27: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/27.jpg)
APPLICATIONSRobots – Human Mimicry
![Page 28: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/28.jpg)
APPLICATIONSRobots – Autonomous Vehicles
![Page 29: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/29.jpg)
WHAT IS REQUIRED TO ‘KINECT’ ?
All you need to get started with development
for the Kinect is -
A Kinect Sensor
A Windows Computer
Microsoft Visual Studio
![Page 30: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/30.jpg)
GETTING STARTED
Log on to http://www.microsoft.com/en-us/kinectforwindows/
![Page 31: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/31.jpg)
BUYING A SENSOR
You can shell out ~ Rs. 9,000
OR….
![Page 32: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/32.jpg)
IDEAS! IDEAS! IDEAS!
Ideas and proposals for robotics projects
involving the Microsoft Kinect are now
being invited as part of the Dream-A-
Bot initiative.
So get thinking and fire away!
![Page 33: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/33.jpg)
PROJECT PROPOSALS
The proposal should not be longer than 2
pages.
It should be in a .doc(x) or .pdf format.
It should include the following :
a) Project Title
b) Motivation and Applications
c) Working Idea
d) Time Span (Weekend/Semester/Long-Term)
e) Financial Requirements
f) Milestones and Possible Extensions
![Page 34: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/34.jpg)
SUBMISSIONS
Send the draft of your proposals to
The deadline is June 30, 2013
The selected entry(ies) will be chosen as
part of the Dream-A-Bot initiative and the
proposers will be the project leaders
![Page 35: Dream-a-bot](https://reader033.vdocuments.us/reader033/viewer/2022042901/568c2c2f1a28abd8328ca68a/html5/thumbnails/35.jpg)
THANK YOU!
LOOKING FORWARD TO YOUR IDEAS!