cs231a course project outline - stanford...
TRANSCRIPT
![Page 1: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/1.jpg)
Section 4- Project Discussion
CS231ASection:CourseProjectOutline
AmirSadeghianJanuary2018
1Amir Sadeghian
![Page 2: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/2.jpg)
Section 4- Project Discussion
Overview
• ProjectLogistics• TypesofProjects• ClassCoverageandIdeas• WheretoGetProjects• HelpfulResources
Amir Sadeghian 2
![Page 3: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/3.jpg)
Section 4- Project Discussion
ProjectLogistics
• Teamsof1-3:Numberofpeopleistakenintoaccountwhengradingproject
• Moremembersà Morework
• Suggestionsforprojectdirection• Replicate aninteresting paper• Comparedifferentmethods toabenchmark• Useanewapproachtoanexisting problem• Implement aninteresting system• Originalresearch
Amir Sadeghian 3
![Page 4: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/4.jpg)
Section 4- Project Discussion
SharingaProjectwithAnotherClass
• Sharingprojectsisgenerallyallowed• Specifyinreports• Mustbeapprovedbybothourstaffandtheothercoursestaff• Projectmustbeprofoundenoughthatyoucanclarifywhichpartsoftheprojectweredoneforwhichclass
• Eachpartmustbesubstantial enoughtoholdasasingleproject• Technical partsandexperiments shouldsufficient anddifferent• IfusingCNNforflowerclassification includesome othercomponents relatedtothiscourse(e.g.geometry,…)
• Willneedaseparatewrite-upforeachclass
Amir Sadeghian 4
![Page 5: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/5.jpg)
Section 4- Project Discussion
ProjectGrading- ImportantDates
• Courseproject:38%• Projectproposal1%(dueFeb1)• Midtermmilestone 5%(dueFeb26)• Presentation 7%(willbeheldonMarch19and21)• Finalreport25%(due March22,11:59pm)
Amir Sadeghian 5
![Page 6: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/6.jpg)
Section 4- Project Discussion
ProjectProposal
• Maximumof2pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:
• Title andauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.Technical Approach:Howdoyouproposetosolveit?• Sec.Milestones (datesandsub-goals)• References
• Youwillbeassignedaprojectmentor
Amir Sadeghian 6
![Page 7: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/7.jpg)
Section 4- Project Discussion
ProjectMilestoneReport
• Maximumof4pages• SubmitthereportasaPDFdocumentthroughGradescope• Includethefollowing:
• Title andauthors• Sec.Introduction:Problemyouwanttosolveandwhy• Sec.Technical Approach:Howdoyouproposetosolveit?• Sec.Milestones achievedsofar• Sec.RemainingMilestones (datesandsub-goals)• References
Amir Sadeghian 7
![Page 8: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/8.jpg)
Section 4- Project Discussion
ProjectPresentations
• ShortpresentationwithtimeforabriefQ&A• Includethefollowing:
• ProblemMotivation/Description• Technical Approach• Results• Maybedemo(+)!
Amir Sadeghian 8
![Page 9: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/9.jpg)
Section 4- Project Discussion
ProjectFinalReport
• Maximumof10pages• SubmitthereportasaPDFdocumentthroughGradescope• EmailyourcodetoTBA.• Includethefollowing:
• Title andauthors• Abstract• Sec.Introduction• Sec.Previouswork• Sec.Technical Approach• Sec.Experiments• Sec.Conclusions• References
Amir Sadeghian 9
![Page 10: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/10.jpg)
Section 4- Project Discussion
ClassCoverage:Geometry,Recognition
• Cameramodelsandcalibration• Singlecameraandhowwemodel it
• Singleviewmetrology• Estimating geometryfromasingle view
• Epipolar Geometry(StereoVision)• Estimating geometryfromtwoviewpoints
• StructurefromMotion• Usingmotion/several viewpoints toestimate structure
• VolumetricStereo• Usingmultiple viewstomap3Dpoints
Amir Sadeghian 10
![Page 11: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/11.jpg)
Section 4- Project Discussion
ViewMorphing
Amir Sadeghian 11
S. M. Seitz and C. R. Dyer, Proc. SIGGRAPH 96, 1996, 21-30
Image morphing techniques can generate compelling 2D transitions between images.
![Page 12: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/12.jpg)
Section 4- Project Discussion
ViewMorphing
Amir Sadeghian 12
![Page 13: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/13.jpg)
Section 4- Project Discussion
AutomaticPhotoPop-Up
Amir Sadeghian 13
A fully automatic method for creating a 3D model from a single photograph
Hoiem, D., Efros, A. A., and Herbert, M, “Automatic Photo Pop-Up”, SIGGRAPH 2005.
![Page 14: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/14.jpg)
Section 4- Project Discussion
PhotoTourism
Amir Sadeghian 14
Snavely, N., Seitz, S. M., Szeliski, R. “Photo Tourism: Exploring Photo Collections in 3D”, SIGGRAPH 2006.
Browsing and exploring large unstructured collections of photographs of a scene using a novel 3D interface
![Page 15: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/15.jpg)
Section 4- Project Discussion
NovelHardware
Amir Sadeghian 15
![Page 16: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/16.jpg)
Section 4- Project Discussion
MobileDevices
Amir Sadeghian 16
Can you take an existing vision algorithm and adapt it to a mobile device to make it more useful?
![Page 17: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/17.jpg)
Section 4- Project Discussion
CourseCoverage:Geometry,Recognition
• Fittingandmatching• Detectorsanddescriptors• Objectclassification• 2D/3Dobjectdetection• 2D/3Dsceneunderstanding
Amir Sadeghian 17
![Page 18: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/18.jpg)
Section 4- Project Discussion
RecognizingPanoramas
Amir Sadeghian 18
Brown, M. and Lowe, D. G., “Recognizing Panoramas”, ICCV 2003.
![Page 19: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/19.jpg)
Section 4- Project Discussion
ImageSegmentation
Amir Sadeghian 19
Partition an image into multiple segments (sets of pixels) in order to make it easier to analyze
![Page 20: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/20.jpg)
Section 4- Project Discussion
ImageCompletion
Amir Sadeghian 20
Hays, J and Efros, A. A., “Scene Completion Using Millions of Photographs”, SIGGRAPH 2007.
![Page 21: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/21.jpg)
Section 4- Project Discussion
2D/3DObjectRecognition
Amir Sadeghian 21
Or a 3D point cloud?
Can you recognize an object in a 2D image?
![Page 22: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/22.jpg)
Section 4- Project Discussion
Tracking
Amir Sadeghian 22
![Page 23: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/23.jpg)
Section 4- Project Discussion
FaceDetection– FaceIdentification
Amir Sadeghian 23
![Page 24: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/24.jpg)
Section 4- Project Discussion
OtherTopics
• PoseEstimation:Estimatetheskeletonanglesforapersonfromanimage/video
• ActionandGestureRecognition: Isapersonstanding,walking,orsittinginanimage/video? Ishe/shewaving?
• SceneUnderstanding:Canyouclassifyascene?Canyourecognizeand/orsegmenteachcomponentofthescene?
• TrajectoryForecasting• ...
Amir Sadeghian 24
![Page 25: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/25.jpg)
Section 4- Project Discussion
Negativeprojectexamples
• Projectswithoutcomponentsrelatedtothecourse• ApplyingAlexnet forimageclassification• FindingandrunninganexistingGithub code• OnlyrunningOpenCV librariesforatask• …
Amir Sadeghian 25
![Page 26: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/26.jpg)
Section 4- Project Discussion
WheretogetProjectIdeas
• CourseStaff:Officehours,alsopostedonwebsite• Computervisionpapersandconferences
• CVPR• ICCV• ECCV
• ComputervisionresearchgroupsatStanford• SilvioSavarese• Fei-FeiLi• JuanCarlosNiebles
• Lastyear’sprojects:Seecoursewebsite• Comeupwithyourown!
Amir Sadeghian 26
![Page 27: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/27.jpg)
Section 4- Project Discussion
Datasets
• Manyareavailableontheweb• Seethefollowingaggregators:
• CVDatasetsontheWeb• YetAnotherComputerVision IndexToDatasets(YACVID)
• Referencesfoundinpapers• CourseCA’s
Amir Sadeghian 27
![Page 28: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/28.jpg)
Section 4- Project Discussion
ProjectAdvice
• Chooseyourteamwell• Makesurethescopeofyourprojectfitsaquarter
• Setaminimumgoal,desired goal,andamoonshot
• Constrainyourproblemsmartly• Seewhatdatasetsareavailableifyouaredoingarecognitionproject
• Speciallyfordeep learningprojects
• Youmayneedtoplanahead/learnoutsidematerials• Usesoftwarewhenavailable
• OpenCV,MATLAB,Deep learningframeworks
• Comeaskquestions– We’rehappytotalk!
Amir Sadeghian 28
![Page 29: CS231A course project outline - Stanford Universityweb.stanford.edu/.../cs231a/lectures/CS231A_course_project_outline.pdf · Section 4- Project Discussion CS 231A Section: Course](https://reader031.vdocuments.us/reader031/viewer/2022022116/5c875a7209d3f2df188bfeaa/html5/thumbnails/29.jpg)
Section 4- Project Discussion
AnyQuestions?
29Amir Sadeghian