probabilistic shape modelling -...

40
> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE Probabilistic shape modelling Marcel Lüthi Graphics and Vision Research Group Department of Mathematics and Computer Science University of Basel

Upload: vankhanh

Post on 15-Apr-2018

218 views

Category:

Documents


5 download

TRANSCRIPT

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Probabilistic shape modelling

Marcel Lüthi

Graphics and Vision Research GroupDepartment of Mathematics and Computer Science

University of Basel

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

People involved in this course

Ghazi Bouabene• Tutor• Main responsible

for Tutorials / Exercises and Project

Marcel Lüthi • Lecturer

(Gaussian processes / MCMC)

• Main responsible for the course

Thomas Vetter• Guest lecturer: Computer

Graphics, Face Image Analysis

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Anaysis of 2D Face photographs

Graphics and Vision Research Group

Medical image Analysis

Other image analysis projects

Model-based image analysis

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Probabilistic shape modelling

• An approach to model anatomical shapes

• An approach to explain images using thesemodels

• A software framework (Scalismo)

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Model of a face

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Analysis of an image using the model

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

What we are discussing today

• Probabilistic shape modelling• What is it?

• What are its applications?

• What will I learn?

• Why should I choose to study it?

• Course organization• What exactly is this online course?

• How do I get the credit points?

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Probabilistic Shape Modelling

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Statistical shape models in a nutshell

Learn from examples how to generate new shapes.

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Statistical shape models in a nutshell

Fundamental operations of probability distributions:

• Sampling• Computing probabilities• Conditioning

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Sampling

Source: www.zimmer.com

Animating 3D medical atlases Testing/validation of implants

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Sampling

Character creator for movie / game industry.

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Computing probabilities

Answer questions like:• It this nose still normal?• How abnormal is this nose?

Application: • computer aided diagnosis

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Computing probabilities

Prior knowledge for data analysis algorithms.

• What is the most likely face shape that explains this data?

• Which parts are unlikely tobelong to the shapeSource: Solcticlipse.com

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Computing probabilities

Prior knowledge for data analysis algorithms.

• How would the shape look like in 3D?

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Computing probabilities

Prior knowledge for data analysis algorithms.

• Which pixels are likely to belong to the ulna bone?

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Conditioning

P( | )

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Applications: Conditioning

Surgery planning Design of patient specific implants

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Relationship to other courses / subjects

• Gaussian processes

• Markov Chains

• Bayesian inference

• Model fitting

• Markov Chain Monte Carlo

• Implementing systems for imageanalysis• New language: Scala

Mathematics

Statistics, Machine Learning,

Data analysis

Programming / Algorithms

Probabilistic Shape

Modelling

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

What you will learn

+ + + …=

∼𝑁 0, 1

∼𝑁 0, 1

∼𝐺𝑃(𝜇, 𝑘)

𝜇 𝜆1𝜙1 𝜆2𝜙2𝛼1 𝛼2𝑢

• Understanding mathematics visually

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

What you will learn

• Understanding mathematics through experimentation / programming

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Course organization

Weeks1 2 3 4 5 6 7 8 9 11 12 13 131410

Online course (MOOC):Shape Modelling

Traditional lectures:Model fitting

• Basics of shape modelling• Basics of Gaussian processes• The scalismo framework

• Model-based image analysis• Markov Chain Monte Carlo• Face image analysis

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

What is a MOOC?

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Massive Open Online Course (MOOC)

• Illustration Till Hafenbrak

Massive: There is no limitation on the number of participants

Open: Everybody can access free of charge, independent of age / educational background. No formal enrollment procedure.

Online: It Is fully offered via the internet

Course: It is offered during a fixed period of time, where also mentoring/assistance is provided.

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Goal 1: Internationalisation

Marketing instrument for the university

Focus on research areas of international interest

Enhance visibility and teaching excellence in these areas.

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Goal 2: Teaching innovation

Benefits students from University of Basel

Research oriented education in an international context

Strengthening of the «Campus Basel» through complementary digital course offerings.

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Studying with international peers

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

MOOC Platform: FutureLearn

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

How does FutureLearn work?

https://www.futurelearn.com/about/how-it-works

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

How to register on FutureLearnYou need to provide

• First name / Last name

• email address

• Password

Do not use your university password!

You need to agree to the

• Terms and conditions

• Privacy policy

• Code of Conduct

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Your identity on FutureLearn

FutureLearn asks you to

• create only one account

• use your real name

You must not

• share the account with anybody else

• falsely state, impersonate, misrepresent your identity,

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Using generated content

• Learnes generate own content (profile pages, comments, etc)

• FutureLearn does not own user generated content• Content is licenced under a Creative-Commons-Licence BY-NC-MD

• Be aware that content is accessible worldwide, unlimited and free of charge.

• By agreeing to the terms and condition you guarantee that you created the content yourself.

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Data protection

• Data protection and privacy is important for Future Learn and the University of Basel. • FutureLearn is a British company and falls under the EU law.

• The data protection policy lists which information FutureLearn is collecting and what this information can be used for.

https://about.futurelearn.com/terms/data-protection-policy/

Slides curtesy of Dr. Gudrun Bachmann, Educational technologies

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Embedding of the MOOC into this course

• We do not check if you follow the course, but• it is a mandatory part of the lecture

• you will be asked about the theory taught in the course in the oral exams

• The University of Basel will not and cannot access data of individual learners.

• There is no data exchange between the study administration of the University of Basel and FutureLearn.

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

How to get the credit points

• FutureLearn does not award any credit points.

• The FutureLearn certificate does not translate into ECTS points.• You don’t need to buy the

Statement of Participation (unless you want to support FutureLearn)

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

How to get the credit points

1 2 3 4 5 6 7 8 9 11 12 13 131410Weeks

Online course:Shape Modelling

Traditional lectures:Model fitting

Project (part 1) Project (part 2)

Oral exam(50 %)

6 ECTS

• Exercises (alone or in groups of 2) need to be presented during exercise sessions

Exercise 1

Exercise 2

Report 1Graded (25 %)

Exercise 3

Report 2Graded (25 %)

Exam date:11 – 12 June, 2018

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Project 1: Shape reconstruction

• Challenge: Find best reconstruction for partial femur• Compete with researchers from all over the world

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Project 2: Segment a bone from an image

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

Next stop: Futurelearn

https://www.futurelearn.com/courses/statistical-shape-modelling

> DEPARTMENT OF MATHEMATICS AND COMPUTER SCIENCE

First exercise session

• Introduction to the exercises and project

• Tutorial: How to work with Scala• Part 1: Setting up Scalismo in an IDE

• Questions & Answer

Tuesday, 6. March, 16.15 – 18.00