sauli kiviranta - ar in action - mindtrek 2016

1

Fundamentals of Augmented Reality Past, Present and Future

SAULI KIVIRANTACO-FOUNDER, CTO, DELTA CYGNI LABS

SAULI KIVIRANTA

2

MY JOURNEY TO AR@sksauli

3

2008

WE KNOW WHAT IT IS…

BUT WHY IS IT?

Why AR exists?Modality 2Modality 1 Modality 3

???

13

▪ Sight (visual) ▪ Hearing (aural) ▪ Touch (somatosensory) ▪ Smell (olfactory) ▪ Taste (gustatory)

For human, visual information is dominant for perceiving and understanding this world...

Do not forget other senses!

5senses

FIRST PRINCIPLES: HUMAN PERCEPTION

500M years of evolution: Concrete Reasoning

Vision starts to developAudition starts to developProto language starts to developVisual acuity of modern eye

Human Evolution

Concrete Mental ModelsPerception

▪ Visual ▪ Auditory ▪ Touch

▪ Olfactory ▪ Gustatory

Sense of relations, location, motion, distance, proximity, color, taste, smell… e.g. Spatial Reasoning


Concrete Reasoning

??

Counting of items inventedNumbers for collections of items Proto writing for storytelling emergedMathematics & written language emerge

Aural language emerges


Human Evolution

100k years of evolution: Abstract Reasoning

Reference ▪ Visual ▪ Auditory ▪ Touch

▪ Olfactory ▪ Gustatory

References, Properties, Syntax, Grammar, Denotation, Abstracting abstractions...

Abstract Mental Models


Concrete Reasoning

Abstract Reasoning

?

Linear perspective invented by Filippo Brunelleschi




Human Evolution

Key insight fromProf. Dr. Giuseppe

Di Gironimo

Filippo Brunelleschi

Brunelleschi needed his perspective realism to be proven against Euclidean laws of geometric optics…

Looks familiar?

Augmenting factory under construction in 2010

Augmenting baptistery under construction in 1413

Brunelleschi demonstration was equivalent to modern Augmented Reality

Filippo Brunelleschi

Brunelleschi impact on visual simulation...

Parallax free view of graphics content

Optical principles for contextualised graphics

Linear perspective invented by Filippo Brunelleschi




Human Evolution

Ivan Sutherland1968

The Sword of Damocles

Augmented Reality – Thomas Caudell, Boeing 1990

Abstract and Concrete reasoning combined

Parallax free view of graphics contentLinear perspective invented by Filippo Brunelleschi




Dr. Thomas P. Caudell

Human Evolution

Terminator 1984

What did we learn?

Perspective drawing technology invented by Brunelleschi • Spatial reasoning unleashed for art and engineering

What is called Augmented Reality started to take shape • Technology to combine Concrete & Abstract reasoning


Concrete Reasoning

Abstract Reasoning

?

▪ Sight (visual) ▪ Hearing (aural) ▪ Touch (somatosensory)* ▪ Smell (olfactory) ▪ Taste (gustatory)

Human Sensors: Machine Sensors:

Gyroscope, Accelerometer, Magnetometer , Geophone, Hydrophone, Microphone, Seismometer, Hall effect sensor, MAP sensor, Mass flow sensor, Oxygen sensor, Speed sensor, Breathalyzer, Carbon dioxide sensor, Carbon monoxide detector, Electrochemical gas sensor, Fluorescent chloride sensors, Hydrogen sulfide sensor, Olfactometer, Smoke detector, Magnetometer, Geiger counter, Altimeter, Variometer, Capacitive sensing, Free fall sensor, Rotary encoder…

Human-Machine Systems Unity of Human and Machine

Human Augmentation with Transformational Reasoning

Modality 2Modality 1 Modality 3

Concrete Reasoning

Abstract Reasoning

Transformational Reasoning

Why AR exists?

LETS REVIEW THE 5 SENSESAugmented Reality with Concrete & Abstract reasoning

Augmenting Vision

Concrete Abstract

HoloLens

Google Glass

Augmenting Audio

Concrete Abstract

Augmenting Touch

Concrete Abstract

Augmenting Smell

Ethanethiol

Propane

Concrete AbstractNosulus Rift

Augmenting Taste

Concrete Abstract

HUMAN AUGMENTATIONConcrete, Abstract & Transformational reasoning

From sensors to sensations...

Yuta Takeuchi et al.


3D Studio Blomberg - www.3dstudio.fi

http://www.3dstudio.fi

Lance Corporal Craig Lundberg


What did we learn?

• Concrete Reasoning & Abstract Reasoning • Transformational Reasoning for “new” senses • Brain is very plastic and it will adapt to AR! • Human-Machine Systems

We have not even started to properly leverage the human potential...

Augmented Reality will change that!

45

Augmented Reality Business Foundation

LIBERATE TACIT (SILENT) KNOWLEDGE

47

When customer needs help…

Time is priceless!

4848

Customer:

System is not working, can you support us?

You:

First release the CMP piping next to the DLC pump…

Customer:

Where is the DLC pump located?

You:

It is square looking box and 5cm of it there are 4 bolts…

Customer:

Uhmmmm… Can you come visit us???

You:

OK, we will send someone next week!

Communication is the problem…

Phone support:Old way…

49

Augmented Reality is the solution…

Customer:

System is not working, can you Pointr us?

You:

For safety, do not remove the cables marked with red

Customer:

Ok, understood!

You:

Release CMP piping by opening bolts marked with green

Customer:

Great, that was easy!

You:

Happy to help!

Pointr support:New way…

Pointr is communication beyond voice and video

POINTRCOMMUNICATION AT THE NEXT LEVEL

Pointr is the best way to solve technical problems remotely

51

POINTR EASY REMOTE SUPPORT

WWW.POINTR.IT

http://www.pointr.it

COMMUNICATE SPATIAL REASONING

53

LEVERAGE 500M YEARS OF HUMAN EVOLUTION

AUGMENTED REALITY IN INDUSTRY

• Repair & off-nominal maintenance

• Ramp-up & commissioning

• Upgrades & retrofit

• On-the-job training

• Quality assurance

• Warranty period support

PRODUCTIVITY BOOST TODAY…

TOMORROW AUGMENTED REALITY WILL EMPOWER ALL OF MANKIND

55

www.deltacygnilabs.com@sksauli

THANK YOU!

BORISKRASSI, CEOFOUNDER

SAULIKIVIRANTA, CTO

FOUNDER

JOHANNAANIASALES

MARKUSMYHRBERG

BOARD MEMBER

TEEMUKUMPUMÄKI

DEVELOPMENT

NIRDHARSHSHETTY

DEVELOPMENT

IGORLEVOCHKIN

DEVELOPMENT

HARRIHYKKÖSALES

http://www.deltacygnilabs.com