csci 599: digital geometry processing

84
CSCI 599: Digital Geometry Processing Hao Li http://cs599.hao-li.com 1 Spring 2015

Upload: lamkiet

Post on 11-Dec-2016

225 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: CSCI 599: Digital Geometry Processing

CSCI 599: Digital Geometry Processing

Hao Lihttp://cs599.hao-li.com

1

Spring 2015

Page 2: CSCI 599: Digital Geometry Processing

USC Graphics

2http://gfx.usc.edu

Page 3: CSCI 599: Digital Geometry Processing

Geometric Capture [Lab]

http://www.hao-li.com

3

Page 4: CSCI 599: Digital Geometry Processing

The Team

Instructor!• Hao Li, [email protected]

• Office: SAL 244 • Office hours: Tuesday 2-3PM

4

Assistants!• Kyle Olszewski, [email protected] • Pei-Lun Hsieh, [email protected]

Page 5: CSCI 599: Digital Geometry Processing

About Me

Page 6: CSCI 599: Digital Geometry Processing

Industrial Light & Magic

Page 7: CSCI 599: Digital Geometry Processing

Science, Engineering, & Art

Page 8: CSCI 599: Digital Geometry Processing

High Tech & Capital of Entertainment

Disney DreamWorks

Activision Google

Page 9: CSCI 599: Digital Geometry Processing

Introduction

9

Page 10: CSCI 599: Digital Geometry Processing

Target Audience

10

!

• PhD students, MSc students, Advanced undergraduates

• Computer Science, Computer Engineering, Mathematics, Physics, Game Program, Biomedicine, Bioengineering, etc.

• Computer Graphics, Computer Vision, Robotics, Machine Learning, Signal and Image Processing, Medical Imaging

!

Page 11: CSCI 599: Digital Geometry Processing

Prerequisites

11

!

• C/C++ Programming • Linear Algebra • Numerical Optimization !

• CSCI 420 Recommended

Page 12: CSCI 599: Digital Geometry Processing

Administrative

12

When and where?!• Tuesday, Thursday, 11:00 am - 12:20 pm • KAP 158 (Kaprialian Hall)

Credits!• 3 Units

Website!• http://cs599.hao-li.com/

Page 13: CSCI 599: Digital Geometry Processing

Exercises

13

Programming assignments!• based on OpenMesh (tutorial will be given Thursday next week) • cover some core stages of the geometry processing pipeline • C/C++ framework including 3D UI will be provided

Integral part of the lecture!• important for achieving course objectives

Page 14: CSCI 599: Digital Geometry Processing

Grading

14

• Best 5 out of 6 exercises contribute to 70% of the final grade • Each exercise counts 20 points • Late submissions: every 5 minute removes 1 point in each exercise

• Scope 2 months/person, Groups up to 2 • Implement a research paper around digital human capture but not

limited to it • Final presentation, code/documentation, contributes 30% of the final

grade

Exercises

Project

Page 15: CSCI 599: Digital Geometry Processing

Academic Integrity

15

• Do not copy any parts of the assignments from anyone

• Do not look at other student’s code • Collaboration only for the project • USC Office of Student Judicial Affairs and

Community Standards (Hell) will be notified

Page 16: CSCI 599: Digital Geometry Processing

Course Objectives

16

• Define and relate the basic concept, tools, and algorithms in geometric modeling and digital geometry processing

• Critically analyze and assess current research on surface representations and geometric modeling and apply the proposed methods in your own work

• Design and implement individual components of geometric modeling system

Page 17: CSCI 599: Digital Geometry Processing

Recommended Textbook

Botsch, Kobbelt, Pauly, Alliez, Levy: Polygon Mesh Processing, AK Peters, 2010

17

Page 18: CSCI 599: Digital Geometry Processing

Acknowledgement

18

Course material taught at:!• EPFL, Mark Pauly (My PhD Advisor) • Bielefeld University, Mario Botsch • INRIA, Pierre Alliez, Bruno Levy • RWTH Aarchen, Leif Kobbelt

Page 19: CSCI 599: Digital Geometry Processing

An Example

19

Page 20: CSCI 599: Digital Geometry Processing

Computer Graphics

Page 21: CSCI 599: Digital Geometry Processing

Performance Capture

Page 22: CSCI 599: Digital Geometry Processing

The Vision

Page 23: CSCI 599: Digital Geometry Processing

IMocap

Page 24: CSCI 599: Digital Geometry Processing

IMocap

Page 25: CSCI 599: Digital Geometry Processing

IMocap

Page 26: CSCI 599: Digital Geometry Processing

IMocap

Page 27: CSCI 599: Digital Geometry Processing

3 weeks for 10 seconds

Facial Perfomance Capture

Page 28: CSCI 599: Digital Geometry Processing

Geometry Capture

Motion can be Captured at the Same Resolution as the Geometry

Page 29: CSCI 599: Digital Geometry Processing

Realtime Facial Performance Capture

Page 30: CSCI 599: Digital Geometry Processing

Capturing Geometry

30

Page 31: CSCI 599: Digital Geometry Processing

Static 3D Capture Stanford 2002

Page 32: CSCI 599: Digital Geometry Processing

Dynamic 3D Capture Stanford 2002

Page 33: CSCI 599: Digital Geometry Processing

Commercial 3D Capture Artec Group

Page 34: CSCI 599: Digital Geometry Processing

3D scanner 3D acquisition

Full Body Capture

Page 35: CSCI 599: Digital Geometry Processing

Lee Perry-Smith, Infinite Realities + Agisoft

Multi-View Stereo

Page 36: CSCI 599: Digital Geometry Processing

Capturing Cities

Page 37: CSCI 599: Digital Geometry Processing

Google Earth

Page 38: CSCI 599: Digital Geometry Processing

Geometry!γεωµετρία

38

geo = earth metria = measure

Page 39: CSCI 599: Digital Geometry Processing

Geometry!γεωµετρία

39

Page 40: CSCI 599: Digital Geometry Processing

Geometry!γεωµετρία

40

x-ray diffractometer

microscopeMRI scanner

time-of-flight scanner

stereo camera

laser scanner

radio telescope

ultrasound

Page 41: CSCI 599: Digital Geometry Processing

Overview

Geometric Modeling!• Techniques and algorithms for representing and processing

geometric objects

We will focus on triangle meshes!• main questions:

• why are triangles suitable representations for geometry processing?

• what are the central processing algorithms? • how can they implemented efficiently?

Page 42: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

42

Page 43: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

43

Page 44: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

44

Page 45: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

45

Page 46: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

46

Page 47: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

47

Page 48: CSCI 599: Digital Geometry Processing

Geometry Processing Pipeline

48

Page 49: CSCI 599: Digital Geometry Processing

Impacting Science

Page 50: CSCI 599: Digital Geometry Processing

Cardiology

Page 51: CSCI 599: Digital Geometry Processing

Evolutionary Biology

Page 52: CSCI 599: Digital Geometry Processing

Cancer Treatment

Page 53: CSCI 599: Digital Geometry Processing

Digitized Future

53

Page 54: CSCI 599: Digital Geometry Processing

For Everyone

Page 55: CSCI 599: Digital Geometry Processing

For Everyone

Page 56: CSCI 599: Digital Geometry Processing

For Everyone

Page 57: CSCI 599: Digital Geometry Processing

Scanning@Home

54°

Page 58: CSCI 599: Digital Geometry Processing

Living Room Entertainment

Page 59: CSCI 599: Digital Geometry Processing

In Tablet

Page 60: CSCI 599: Digital Geometry Processing

In Laptops

Page 61: CSCI 599: Digital Geometry Processing

In Laptops

Page 62: CSCI 599: Digital Geometry Processing

In Smartphones

Page 63: CSCI 599: Digital Geometry Processing

From Capture to Fabrication

633D printing

Page 64: CSCI 599: Digital Geometry Processing

Realtime Future

64

Page 65: CSCI 599: Digital Geometry Processing

VFX/Game Production Virtual Avatars

Robotics AR/Virtual Mirror

Why Realtime?

Page 66: CSCI 599: Digital Geometry Processing

Realtime Game Engines

Page 67: CSCI 599: Digital Geometry Processing

Realtime Facial Animation

Page 68: CSCI 599: Digital Geometry Processing

Virtual Reality Reloaded Oculus VR 2012 / Crytek 2014

Page 69: CSCI 599: Digital Geometry Processing

Personalized Future

69

Page 70: CSCI 599: Digital Geometry Processing

3D Self-Portraits

Omote3D Shashin Kan

Page 71: CSCI 599: Digital Geometry Processing

3D Self-Portraits

Omote3D Shashin Kan

Page 72: CSCI 599: Digital Geometry Processing

3D Self-Portraits

Omote3D Shashin Kan

Page 73: CSCI 599: Digital Geometry Processing

3D Self-Portraits

Omote3D Shashin Kan

Page 74: CSCI 599: Digital Geometry Processing

3D Selfies

Page 75: CSCI 599: Digital Geometry Processing

3D Selfies

Page 76: CSCI 599: Digital Geometry Processing

Personalized Games USC/ICT

Page 77: CSCI 599: Digital Geometry Processing

Personalized Applications

digital garmententertainment fitness

MPI IS, Embodee

Page 78: CSCI 599: Digital Geometry Processing

Fashion Industry

Page 79: CSCI 599: Digital Geometry Processing

Summary

79

Reconstruction

Geometry Processing

Capture

Design

Analysis

Manipulation

Storage

Rendering

Simulation

Reproduction

Page 80: CSCI 599: Digital Geometry Processing

Classic Graphics

80

Reconstruction

Geometry Processing

Capture

Design

Analysis

Manipulation

Storage

Rendering

Simulation

Reproduction

Page 81: CSCI 599: Digital Geometry Processing

Modern Graphics/Vision

81

Reconstruction

Geometry Processing

Capture

Design

Analysis

Manipulation

Storage

Rendering

Simulation

Reproduction

Page 82: CSCI 599: Digital Geometry Processing

The Future: Big Data / Robotics

82

Reconstruction

Geometry Processing

Capture

Design

Analysis

Manipulation

Storage

Rendering

Simulation

Reproduction

AI

Feedback

Page 83: CSCI 599: Digital Geometry Processing

Next Time

83

• Parametric Approximations

• Polygon Meshes

• Data Structures

Page 84: CSCI 599: Digital Geometry Processing

http://cs599.hao-li.com

Demos!

84