1

Augmented RealityPast, Present and Future

Applications at VTT

Prof. Charles Woodward, VTT

Presentation at Haaga-Helia, 18 Oct, 2011

BackgroundAugmented Reality Team at VTT

AR core technology & applications, 8 peopleAdditionally supporting / application teams AR driven projects > 2 M€ annually

Leading edge technology First in the world with various AR applicationsLicensing for independent developers (ALVAR)See www.vtt.fi/multimedia

NetworksMulti-disciplinary VTT wide collaboration Strong industry relations and experienceInternational networks, incl. EIT ICTCustomers in Europe – USA – Far East

2

Augmented Reality (AR)Mixes virtual objects with view of real worldC.f. Virtual Reality (completely virtual worlds)Properties: real-time, interactive, 3D registration

<-> Challenges: tracking, accuracy, speed, mobile

IntroductionRelated technologies

Augmented Virtuality Mediated RealityDiminished Reality, …

<-> Mixed Reality (MR)

Reality / Video image

Virtual Reality / Computer graphics

Augmented Reality

Application Categories

Close range (markers, features, objects …)Location based (GPS, compass, gyro …)

3

History / Mobile AR

Pre-history: backpack & hand held PCs, PDAsIvan Sutherland, ARPA, "The ultimate display", 1965 -1968Tom Caudell, Boeing, industrial application using HMD, 1990Steve Feiner, Columbia University, first outdoors AR system, 1996Bruce Thomas, Univ. of South Australia, ARQuake game, 2000VTT ARonPDA, AROnSite, others 2003-2006

Recent history: mobile phones, tablets Mozzies shooter game on mobile phone, Siemens 2003Nokia MARA, first outdoors AR prototype on mobile phone, 2006AR browser Layar, first commercial mobile phone system, June 2009

TodayIn 2009, 20 mobile AR apps available for download In 2010, 500 mobile AR apps (2500 % growth)Layar 3 million downloads by Dec 2010Layar preinstalled on Samsung devices 2011

History / Print Media

Magic Book, Univ. of Washington, 2000ARCatalogue, Lappset (VTT), 2004Aliens & Ufos, Sci-Fi book, Oct 2008Esquire magazine, Nov 2009Zueddeutsche Zeitung, Aug 2010

4

Dibidogs – 3D animated children’s TV seriesBy Futurecode (Finland) and Blue Arc (China)Launched April 2010, MTV3 / SubTV Junior

Augmented TV magazine TV-magazines Katso and TVSeiska, March 20103D animations appear augmented from magazine

Augmented storybookKustannus Paasilinna, Aug 2010Photorealistic rendering etc.

Mobile phone implementationat ShanghaiWorld Expo 2010

Print Media Applications by VTT

Print Media (contd.)Flash implementation

No download requiredEasy 2,5 D content creationChroma key characters + videos

Public applications Seiska magazine: augmented movie trailersDNV (Det Norske Veritas): Technology Outlook 2020Augmented business cards

5

Mobile advertisingSparkly promotion campaign

The new Sparkly Brut drink, which is the newest line extension to Sinebrychoff's Golden Cap range, will be launched in October 2011Promotion by mobile AR advertisement in Elle Magazine (by Aller)Addressing target customer group for Sparkly & lot of iPhone owners

Features Download from AppStorePlay with 3D bottleStart AR gameKeep the 3D bottle standing for 15 seconds As reward get a mobile discount coupon for SparklyShare coupon with friendsRead product infoFind closest bar / restaurantUtilize your mobile discount coupon

Event PromotionITS (Intelligent Transportation Systems) Conference

This year in Orlando, Oct 16-20 To be held in Helsinki 2014

Augmented ”Raipe” lynx characterMascot for the Helsinki ITC EventAR promotion at Finnish stand in OrlandoInvites people to see Helsinki videos on iPad

Credits3D character: Pinata OyVideos: City of HelsinkiAR application: VTT

6

Interior DesignVividAR

Web based AR interior design system, based on VTT technologyCovering > 40 manufacturers, growing over 50% per year

Production SitesAugmented maintenance, operation, trainingPlant asset management: Simantics MobileRobot simulations in real environmentsPartners: Wärtsilä, Metso, Valtra, Cargotec, Fortum, ..

7

Building & ConstructionMobile construction site visualization

Compare project plans and time tables (4D BIM) with situation on siteProvide real time mobile feedback from site to BIM systemPhotorealistic visualization for architectural applicationsClient/server solution -> mobile phonesAlso, as Internet based webcam solutionPartners: Tekla, Skanska, Pöyry, Buildercom, …

Building & Construction (contd.)Visualization of architectural plans

New hotel being planned at historical Billnäs Ironworks site http://www.billnas.fi/en/Mobile AR visualization was presented to group of 20 municipal decision makers and civil engineersDevices: laptop PC (free viewing positions) and five N900 phones (predefined “hot spot” locations)Positive feedback from audience: viewing the models on site helped to understand the plans

8

Virtual WorldsMixed Reality teleconferencing between real people and Second Life avatarsGesture based avatar control, now as official patch in Second LifeImplemented in co-operation with IBM Corp. (USA)

Application Examples around the World

eBay Classifieds http://techielobang.com/blog/2010/12/16/ebay-classifieds-now-on-junaio-video-within/

iButterfly (Dantsu, Japan) http://www.youtube.com/watch?v=vEE6M0iW-Nw&NR=1

Samsung augmented product package (PC based) http://www.youtube.com/watch?v=2kGyR55dp8A

MakeUpLive http://augmentedrealityoverview.blogspot.com/2011/02/make-up.html

Carlsberg Can Catch http://www.youtube.com/watch?v=sdreyY1SKQk

StreetMuseum http://gizmodo.com/#!5547236/strolling-through-19th-century-london-today

9

Mobile AR Markets

Predictions“One of the one technologies to most likely to alter industries, fields of research, and the way we live” (Gartner, 2008 ... 2011)Market growing from $1,5 million to €1,5 billion 2010-2015 (Juniper Research, 2011)

ChallengesAddressable market size, public awarenessCritical mass requires over 50% of smartphone ownersCreate meaningful applications, offering rich services and real value to the users

Source: Mobile Augmented Reality 2011-2015, Juniper Research

AR App Titles split by categories, Dec 2010

Discussion: AR on Gartner's Hype Cycle

Source: Gartner, August 2011

10

Contact

Prof. Charles WoodwardVTT Technical Research Centre of Finland

Vuorimiehentie 3, Espoo, FinlandTel: +358 40 500 1514

charles.woodward@vtt.fi

http://www.vtt.fi/multimedia

VTT creates business from technology