Augmented Reality Roadmap

The 6 Elements of the AR Universe

ISMAR 2009

Robert Rice - Neogence Enterprises Ori Inbar - Ogmento

Everyone here would agree that AR is a jaw dropping technologyIt's so jaw dropping that most business people have no clue how to digest itRobert and I have spent most of this year educating folks in the business community about what the AR industry could become.The AR universe is very complex to explain. When you look at scientific papers - it has more like 6000 elements. So we realized that we have to dumb it down, the way you'd explain it to a 5 year old, which is always the hardest. So today we are proposing a simplified view that from our experience works pretty well.It is also a great way to categorize the pioneers and future players and to spur collaboration among the industry players.

Here it is: the 6 elements of the AR universe.

user

world

sense &interact

In the beginning...In the beginning there was the world and the user.The user would use her very naive 5 senses to sense what's going on in the world and interact, with hands, feet, voice, etc...Very simple, very limiting, very...human.

user

worldlens

Than came God AKA Ivan Sutherland and said: "let there be a lens"Lenses could be mobile devices, goggles, projectors, or even PC.

Since the lens is a "see-thru lens" the user can still interact with the world using her senses, but in addition -

user

worldlens

watch &interact

sense &track

The lens has a whole slew of new ways to sense the world, it knows where the real life objects are and therefore can track it and interact with it.And this lens allows the user to take advantage of these new senses - watch and interact with the world - using these senses - in a whole new way.

user

worldlens

sense &track

watch &interact

places

people

things

What are these "real life objects" that can be sensed in the world?You can simply categorize it into 3 groups: people, places, things.

In the last few years lots of data have been captured about these objects have: from location, descriptions, images, etc - and it's all being published into...the cloud.

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

...the cloud.Examples : wikipedia, google earth, facebook, twitter, trip advisor, flickr... The cloud is a subtle hint to... cloud computing. The AR cloud stores the data, provides the back end services, similar to virtual worlds, connectivity, multiuser support, dynamic worlds, security, etc.

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

delivercontent

So, now you want to deliver this content into your lens, But this information is not necessarily stored in a ready to use form, and since you don't want to clutter your lens...

filters

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

delivercontent

- various filters are created.different technologies or apps that allow you to see the world in different colors, different lights - depending on your need.

filters

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

delivercontent

This is of course not just a one way street. Users want to be able to deliver content back to the cloud: user generated content, or personalized content.

That completes the cycle. But what are we missing? Raw content is hard to digest. We know that people do not consume technology, but content, or experiences.We need editors, story tellers, interaction designers...we call this element...the content providers.

filters

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

delivercontent

contentproviders

...the content providers.The “game designers” of the AR universe.Who can it be? Who can it be? Whoever creates the stuff. In the game industry these are Game studios, in others itʼs entertainment companies, artists, or any company or individual that wants to give a special experience to its audience.

filters

user

worldlens

sense &track

watch &interact

places

people

things

cloud

publish content

delivercontent

contentproviders

Now that we have the full cycle is built out, the most efficient way for content providers to plug into it - is by publishing into the cloud.

And these are the 6 elements of the AR universe as explained to a 5 year old (or your grandma.)

Now Robert will deep dive into each element to give us a sense of whatʼs in it.[hand over]

user• my profile• my location• my field of view• my friends• my network• my preferences• my apps• my games• ...

personalize

lens

•geo location•compass •acceleration•6 dof pose•computer vision•radio signals•scene graph•tracking

• graphics rendering• sound • graphic user interface• input

(touch, gesture, gaze)• haptics • tagging/graffiti (ugc)• communications

watch & interact sense & track

• pulling data from cloud• os abstraction• hardware abstraction• networking• hardware (mobile, goggles, projection)

world

• people• places• things

sense &track

publish status

cloud

• community• massive multi user services• recommendation engines• content distribution • e-commerce • authoring tools• sdk• world database• dynamic mirror worlds• standards• network platform• open architecture• ...

store & deliver content

contentproviders

• real and digital goods• premium• private• residential• commercial• public access• government• ...

content types categories

• media• entertainment• games, toys• design, architecture• art • education• tour guides• personal, social• retail• training• maintenance• manufacturing• healthcare• military• advertising• ...

filters (apps)

created by content providers

run onthe lens

stored inthe cloud

12

3

filter the world

4personalize for the user5

user

worldlens

cloud contentproviders

peoplethingsplacesfilters

7

5

1

7

36

6

1 9low maturity level high

1 platform

hardware

software

worldlens

cloud

contentproviders

filters

Ogmento

software

hardware

people

places

thingsgames

apps

ads

Market

data pools

infrastructure

authoringtools

recommendation engines standards

3D Warehouse

AR shops

virtual worlds

learning

video games

theme parks

advertisers

web 2.0 services

distribution

tourism

entertainment

artists

Thank YouOri InbarOgmentoori@ogmento.comSkype: comogardTwitter: comogard

Robert RiceNeogence Enterprisesrobert@neogence.comSkype: rrice919Twitter: robertrice