ieee robot team vision system project michael slutskiy & paul nguyen ece 533 presentation

12
IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Upload: brittany-wood

Post on 18-Jan-2016

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

IEEE Robot Team

Vision System ProjectMichael Slutskiy & Paul NguyenECE 533 Presentation

Page 2: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Mission Navigate 150lb Robot Through Obstacle Course

Page 3: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Vision System Objectives

Find parts of image that the robot should not drive into

Map these parts and send them to the artificial intelligence system

Attempt to distinguish between physical objects and 2 dimensional images on the ground

Page 4: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation
Page 5: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation
Page 6: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Success

Page 7: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Some Combinations

Page 8: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

•Get an image from the camera approx. 15fps

•Filter out orange

•Extract the blue plane for the dynamic thresh.

•Binarize (note the salt and pepper noise)

•Clean up image using a 5x5 Median filter

•Use Sobel edge extraction and Hough transform to pick out lines

Page 9: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Tarps

Page 10: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Pass Image to AI

This is the target location for the robot to navigate to in this frame.

Page 11: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Extensions Complete color segmentation

Aid with tarps and texture noisePotentially better than current threshold

Template matchingHelp separate objects from lines

Multi-image operations World mapping

Planning AI instead of reactionary AI

Page 12: IEEE Robot Team Vision System Project Michael Slutskiy & Paul Nguyen ECE 533 Presentation

Questions, Comments,

Suggestions?

Visit www.cae.wisc.edu/~ieeerobo for more info or send us an email at [email protected]