quadcopter navigation using aakash tablet with on board image processing

33
QUADCOPTER NAVIGATION USING AAKASH TABLET WITH ON BOARD IMAGE PROCESSING Garuda Control Station Principal Investigator Prof. D.B. Phatak

Upload: d-yogendra-rao

Post on 20-Jun-2015

664 views

Category:

Engineering


1 download

DESCRIPTION

Final Presentation for Team Garuda . This quadcopter and its ground control station(GCS) was built in the Integrated Development Lab during my summer internship at IIT Bombay . https://www.youtube.com/watch?v=0966YNqcisg.

TRANSCRIPT

Page 1: Quadcopter navigation using aakash tablet with on board image processing

QUADCOPTER NAVIGATION USINGAAKASH TABLET WITH ON BOARD IMAGE

PROCESSING

Garuda Control Station

Principal InvestigatorProf. D.B. Phatak

Page 2: Quadcopter navigation using aakash tablet with on board image processing

TEAM GARUDA

Project Team Members

Mr. Aaditya Hambarde

Mr. Ankit Kumar

Mr. D Yogendra Rao

Mr. Shubham Garg

Miss. Shuchi Sharma

Project Mentors

Mr. Sandesh PatiMiss Maitreyee MordekarMr. Sivakiran KodaliMr. Varun Madkaikar

Project In-Charge Mr. Rajesh Kushalkar

Page 3: Quadcopter navigation using aakash tablet with on board image processing

FEATURES

• Video Streaming

• Door detection

• GPS Tracking

• Ground Control Station on Aakash

Page 4: Quadcopter navigation using aakash tablet with on board image processing

Project Overview

Page 5: Quadcopter navigation using aakash tablet with on board image processing

YAW

Page 6: Quadcopter navigation using aakash tablet with on board image processing

ROLL

Page 7: Quadcopter navigation using aakash tablet with on board image processing

PITCH

Page 8: Quadcopter navigation using aakash tablet with on board image processing

YAW CONTROL

Page 9: Quadcopter navigation using aakash tablet with on board image processing

ROLL/PITCH CONTROL

Page 10: Quadcopter navigation using aakash tablet with on board image processing

‘IF YOU WANT TO GO FORWARD, PITCH FORWARD’

Page 11: Quadcopter navigation using aakash tablet with on board image processing

ALTITUDE CONTROL

Page 12: Quadcopter navigation using aakash tablet with on board image processing

PROPELLERS

• Two clockwise and two anti-clockwise

• Need a good balance on deciding length and pitch

Courtesy : www.atomikrc.com

Page 13: Quadcopter navigation using aakash tablet with on board image processing

ELECTRONICS SPEED CONTROLLER

• Generates signals for Brushless DC motor

• Pulse duration for 1000 us – 2000us

Courtesy : www.hangarone.co.nz

Page 14: Quadcopter navigation using aakash tablet with on board image processing

ACCELEROMETER & GYROSCOPE (MPU6050)

• Accelerometer :Sensitivity to vibrations

• Gyroscope : drift

Angular rate in three axes of space in deg/s

Courtesy : https://community.freescale.com/community/the-embedded

Page 15: Quadcopter navigation using aakash tablet with on board image processing

MAGNETOMETER (HMC5883L)

• Digital-output : angular movement , magnetic field intensity

• Reliable direction for magnetic north

Courtesy : https://community.freescale.com/community/the-embedded

Page 16: Quadcopter navigation using aakash tablet with on board image processing

PRESSURE SENSOR (MS5611)

• Altitude of quadcopter

• Temperature of the environment

Pressure is our 10th axis

Courtesy : https://community.freescale.com/community/the-embedded

Page 17: Quadcopter navigation using aakash tablet with on board image processing

GPS SENSOR (MT3329)

• Triangulation Method

• Location of quadcopter

• NMEA Protocol

(National Marine Electronics Association)

Courtesy : http://www.trimble.com/gps_tutorial/howgps-triangulating.aspx

Page 18: Quadcopter navigation using aakash tablet with on board image processing

SENSOR FUSION

• It literally means ‘fusing the data of two sensors’

• Accelerometer is noisy (has spikes).

• Gyroscope output has a time varying drift.

• Sensor Fusion-We take the best of both the worlds.

Page 19: Quadcopter navigation using aakash tablet with on board image processing

EXTERNAL AUTONOMOUS NAVIGATION

• Various Flight Modes-Stabilize, Acro, Alt Hold, Loiter, Auto Mode.

• For the AUTO mode, GPS is necessary.

• Waypoints can be set by our Application on the AAKASH tablet.

Page 20: Quadcopter navigation using aakash tablet with on board image processing

INTERNAL AUTONOMOUS NAVIGATION

• GPS fails in a closed-door environment.

• Detect a door/window and go out where GPS access is present.

• In future, we hope to design a controller for navigation of quadcopter from indoor to outdoor environs.

• SONARs will be used to create a depth map of the indoor environment and for obstacle detection.

Courtesy: http://www.scientificamerican.com/

Page 21: Quadcopter navigation using aakash tablet with on board image processing

DOOR DETECTION ALGORITHMS• Various alternatives like Training by Haar cascade, Feature matching by SURF

features were explored.

• To get a reasonable FPS, we had to settle on an algorithm which exploits the geometric properties of the door.

Page 22: Quadcopter navigation using aakash tablet with on board image processing

PID TUNINGProportional(P)Integral(I)Derivative(D)

Page 23: Quadcopter navigation using aakash tablet with on board image processing

1. NEED FOR PID TUNING

• For a stable and smooth flight of the quadcopter• To get the optimum or desired behavior from it•Without this, quad may topple, become sluggish or untamable

Page 24: Quadcopter navigation using aakash tablet with on board image processing

COMMUNICATION PROTOCOL : MAVLINK

• It is a protocol for communication between a Ground Control Station (GCS) and unmanned vehicles

• Each MavLink packet has a length of 17 bytes

6 bytes header + 9 bytes payload + 2 bytes checksum

Page 25: Quadcopter navigation using aakash tablet with on board image processing

RC INTERFACE

Fast Mode Access

Navigation Menu

RC Control

Connect Button to connect with

the quad

Mode Switch

Page 26: Quadcopter navigation using aakash tablet with on board image processing

INTERFACES

Planning Interface

Flight Data Interface

Page 27: Quadcopter navigation using aakash tablet with on board image processing

INTERFACES

Charts Interface

Camera Feeds

Page 28: Quadcopter navigation using aakash tablet with on board image processing

WHAT DID WE LEARN?

• Orientation algorithms of a quadcopter.

• Aerodynamics of a quadcopter.

• Explored Image Processing Techniques in detail.

• Streaming the video-feed of a USB webcam/RaspiCam over a local area network through MJPEG streamer.

• A new way of thinking and questioning things.

• A new communication protocol-MAVLINK.

Page 29: Quadcopter navigation using aakash tablet with on board image processing

CHALLENGES FACED

• Implementation of Haar training for door detection.

• PID tuning for stable flight.

• Overlapping the RC on the video feed.

Page 30: Quadcopter navigation using aakash tablet with on board image processing

FURTHER PROSPECTS

• Making ‘Garuda’ autonomous (using GPS based navigation).

• Designing a PID controller for internal navigation by door/window detection and SONAR.

• Face Recognition in the feed received at the AAKASH end.

• Recording the video feed on AAKASH tablet and processing it.

Page 31: Quadcopter navigation using aakash tablet with on board image processing

REFERENCES

• [1] https://github.com/AngusP/SkiTrack/blob/master/documentation/MS5611-01BA03%20datasheet.pdf

• [2] http://www.invensense.com/mems/gyro/.../PS-MPU-6000A-00v3.4.pdf

• [3] http://www.adafruit.com/datasheets/HMC5883L_3-Axis_Digital_Compass_IC

• [4] JoyStickView : https://code.google.com/p/mobile-anarchy-widgets/

• [5] MjpegStream : https://bitbucket.org/neuralassembly/simplewebcam

Page 32: Quadcopter navigation using aakash tablet with on board image processing

REFERENCES

• [6] HUD : https://code.google.com/p/copter-gcs

• [7] MAVlink : Mavlink for Dummies Part 1

• [8] Barton, Jeffrey D. "Fundamentals of small unmanned aircraft flight." Johns

• Hopkins APL technical digest 31, no. 2 (2012): 132-149.

• [9] Premerlani, William, and Paul Bizard. "Direction cosine matrix imu: Theory."DIY

• Drones.[Online][Cited: 1 7 2012.] http://diydrones. ning. com/profiles/blogs/dcmimu-theory-first-draft (2009).

• [10] http://dev.ardupilot.com/

Page 33: Quadcopter navigation using aakash tablet with on board image processing

THANK YOU