Ioannis Rekleitis

Introduction

WhyImageProcessing?

•  Whoherehasacamera?•  Howmanycamerasdoyouhave•  Pointwherecomputersfast/cheap•  Camerasbecomeomnipresent•  DeepLearning…

2 CSCE 590: Introduction to Image Processing

MajorTopicsCoveredinClass

•  imageacquisition•  digitalimagerepresentation•  Imageenhancement•  Imagerestoration•  Colorimageprocessing•  Imagecompression•  Imagesegmentation•  Morphologicalimageprocessing

CSCE 590: Introduction to Image Processing 3

HumanPercep<onVSMachineVision•  LimitedvsentireEMspectrum

http://www.kollewin.com/blog/electromagnetic-spectrum/CSCE 590: Introduction to Image Processing 4

ImageAcquisi<onandRepresenta<on

CSCE 590: Introduction to Image Processing 5

Examples

CSCE 590: Introduction to Image Processing 6

1. Brain MRI 2. Cardiac CT 3. Fetus Ultrasound

4. Satellite image 5. IR image

1 and 3. http://en.wikipedia.org 2. http://radiology.rsna.org 4. http://emap-int.com 5. http://www.imaging1.com

ImageRepresenta<on•  Discreterepresentationofimages–  we’llcarveupimageintoarectangulargridofpixelsP[x,y]–  •eachpixelpwillstoreanintensityvaluein[01]–  •0àblack;1àwhite;in-betweenàgray–  •Imagesizembynà(mn)pixels

CSCE 590: Introduction to Image Processing 7

Applica<onsofDigitalImageProcessing•  Digitalcameras,portabledevices•  Photoshop•  Humancomputerinteraction•  Medicalimagingfordiagnosisandtreatment•  Surveillance•  AerialDrones•  AutonomousCars•  ConvolutionalNeuralNetworks•  Virtual/AugmentedReality•  …•  Fast-growingmarket!

CSCE 590: Introduction to Image Processing 8

Computervisionalgorithms

•  Imageprocessing•  Geometriccomputervision•  Semanticcomputervision

•  ItisfundamentalQirsttounderstandimageformation

CSCE 574: Robotics 9

Difficultscenarios•  Incertainsettings,suchastheunderwater,roboticvisionisparticularlychallenging– Differentlightingconditions– Colorloss– Hazingandblur– Textureloss

10 CSCE 574: Robotics

doesn’tneedafullinterpretationofavailableimages

doesneedinformationaboutwhattodo...

• avoidingobstacles(orpredators)

• pursuingobjects

• localizingitself

• Mapping

• Qindingtargets

• reasoningabouttheworld…

“ThisisProf.XinhisofQiceofferingmeacupoficedtea.”

“RunAway!!”

reactive

deliberative

environmentalinteractions

Whatdoesarobotneed?

CSCE 574: Robotics 11

Keyproblems•  Recognition:– Whatisthatthinginthepicture?– Whatareallthethingsintheimage?

•  Sceneinterpretation–  Describetheimage?

•  Scene“reconstruction”:– Whatisthe3-dimensionallayoutofthescene?– Whatarethephysicalparametersthatgaverisetotheimage?

– Whatisadescriptionofthescene?

Notionofan“inverseproblem.”12 CSCE 574: Robotics

(1)ImagestreamssimpliQiedviagenerality

simpliQiedviaspeciQicity

(2)Stereovision (orbeyond...)

(3)Incorporatingvisionwithinrobotcontrol

Visual“servoing”3dreconstruction

Abriefoverviewofroboticvisionprocessing...

Robotvisionsampler

CSCE 574: Robotics 13

Thresholdedimage

CSCE 574: Robotics 14

Edgedetec<on

CSCE 574: Robotics 15

Tenta<veSchedule

16 CSCE 590: Introduction to Image Processing

Monday Tuesday Wednesday Thursday Friday

Week01 Introduction ImageGenerationPerspectiveTransformation

ColorSpaces ImageFormats,Compression

Week02 Statistics,Histogram,Thresholding

SingleImageOperations

Holiday Logical,ArithmeticOperations

A1

Week03 Correlation

Segmentation DeNoising Review

Week04 Midterm Convolution NeuronsandConvolutions

CNNs A2

Week05 AdvancedTopics:Stereo

AdvancedTopics:Flow

AdvancedTopics:Motion

AdvancedTopics:ShapefromX

A3

Week06 Features(Detection)

Features(Matching)

Opendiscussion

Review A4

Textbook

DigitalImageProcessingByR.C.GonzalezandR.E.Woods3rdedition

CSCE 590: Introduction to Image Processing 17

Evalua<on

Schedule,deliverables,andevaluation:•  Component Undergraduate Graduate•  Assignments(4) 12.5% 12.5%•  GraduateAssignments(4) --- 2.5%•  MidtermExam 15% 10%•  FinalExam(standardtime) 30% 25% •  ClassParticipation 5% 5%•  Total 100% 100%

18 CSCE 590: Introduction to Image Processing

Homeworks

•  UsingOpenCV– C++– Python

•  UsingMATLAB

CSCE 590: Introduction to Image Processing 19

Contact

•  http://www.cse.sc.edu/~yiannisr/•  http://www.cse.sc.edu/~yiannisr/590/2018

•  Email:yiannisr@cse.sc.edu

•  OfYicehours:byappointment

CSCE 590: Introduction to Image Processing 20