mobile ar sdk tutorial - augmented world expo new york 2014

27
Mobile AR SDK Tutorial Augmented World Expo, NY, March 25, 2014 Patrick O’Shaughnessey @patchedreality patrick@patchedreal ity.com

Upload: patrick-oshaughnessey

Post on 09-May-2015

1.490 views

Category:

Technology


1 download

DESCRIPTION

A tutorial on how to develop using the latest mobile AR SDK's. This is an updated version of the talk from Augmented World Expo 2013, that I gave at the Augmented World Expo New York in March, 2014.

TRANSCRIPT

Page 1: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Mobile AR SDK Tutorial

Augmented World Expo, NY, March 25, 2014

Patrick O’Shaughnessey

@[email protected] http://patchedreality.com

Page 2: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Patched Reality

Custom Augmented Realityand Digital Eyewear Apps

http://patchedreality.com

Page 3: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Patched Reality

Using Best-in-Breed Technologies

http://patchedreality.com

Page 4: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Video and Slides from AWE 2013

http://bit.ly/SDKTutorialAWE2013

Page 5: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Notable Features Since June

Some Highlights:• Extended tracking• CAD model-based training• Text recognition and tracking• Digital eyewear support

Page 6: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

What’s the purpose of an AR SDK?

Simplifies one or more of:• Recognition – What to track• Tracking – Where it is (3D pose)• Content rendering – Your Interesting Stuff

Page 7: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tracking Types

• GPS + Compass + Gyro + Accelerometer• Marker (Fiduciary, frame, etc)• NFT (2D images)

• Pre-trained• Cloud recognized• User-defined

• 3D (Pre-trained point cloud)• Live 3D (SLAM)• Face, Fingers, Body• Robot

Page 8: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Mobile AR SDKs Short ListSDK Purpose Tracking Platform Graphics Cloud GPS License

QualcommVuforia

2D Images,Cylinders, Markers,Text

NFT+Ext,Cylinder, Marker,Text

iOS, Android Unity3D & Alt.

yes no Free$99-499/mo Cloud

MetaioSDK

2D Images, 3D, GEO,QR

NFT+Ext, GPS,3D, SLAM

iOS, Android, Eyewear

Unity3D & Proprietary

yes yes $0-5,500$235-680/mo Cloud

Total Imm. D’fusion

2D Images, Faces

NFT, Face iOS, AndroidDev: MS only

Proprietary no no $0-7,800

Wikitude SDK

2D Images,GEO

GPS, NFT iOS, Android, Blackberry, Eyewear

HTML, Proprietary

yes yes $0-2,300

Layar SDK 2D images,Geo

NFT, QR iOS, Android Proprietary yes no $3,250/app/yr + $60/page

AR Toolkit 2D Images, Markers

NFT,Marker

iOS, Android Unity3D &Proprietary

no no $1,500 / seat

Page 9: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Mobile AR SDKs Short ListSDK Purpose Tracking Platform Graphics Cloud GPS License

13th Lab Point Cloud

2D Images,3D, Anywhere

NFT, 3D,SLAM

iOS, Android Unity3D & Alt.

no no 0-$5,000

HPAurasma SDK

VFX, Videos on 2D Images

NFT iOS, Android Proprietary yes yes Per click

Obvious Engine

2D images, Cylinders

NFT,Cyl.

iOS, Android Unity3D & Alt.

no no $8000/app/plaform

String Framed 2D images

Framed Image

iOS Unity3D & Alt.

no no $499-$8000/app/year

Orbotix Robotic AR Sphero iOS, Android Unity3D no no Free

catchoom 2D Images NFT iOS Proprietary yes no $0-2000 +$135-835/mo

Page 10: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SDK Development On Ramp

1) Set up Dev Environment• Xcode (iOS)• Eclipse (Android)• Android SDK• Android NDK• Unity 3D

2) Download SDK3) Install and run samples

Page 11: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SDK Development with Unity

1) Create Project2) Wire up SDK - camera setup, licensing, etc3) Set up recognition and tracking configuration4) Add scene content and interactions5) Build, Run, Test6) Repeat 3-57) Ship

Page 12: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

NFT Setup - Vuforia

1) Import Unity package2) Create target using “Target Manager” at

developer.vuforia.com 3) Download and Import target package4) Replace MainCamera with ARCamera prefab5) Add ImageTarget prefab 6) Add content to ImageTarget7) Enable Data Set load on ARCamera8) Select Data Set and Image Target on ImageTarget9) Build and Run

Page 13: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

NFT Setup - Vuforia

Page 14: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Extended Tracking

Page 15: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Extended Tracking

Page 16: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SLAM Setup - metaio

1) Import metaioSDK.unitypackage2) Add metaioSDK prefab to scene3) Delete Main Camera4) Generate app signature

(mobiledeveloperportal.ar-live.de)5) Add app signature to metaioSDK6) Add metaioTracker prefab to scene7) Add scene root to metaioTracker object

Page 17: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SLAM Setup - metaio

1) Add GUI and script that calls metaio.MetaioSDKUnity.startInstantTracking("INSTANT_3D", "");

2) Add metaioCallback subclass (InstantTrackingCallback from TutorialInstantTracking) and replace the one on metaioSDK GameObject

3) Build and run4) Add missing libraries to Xcode project

Page 18: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SLAM Setup - metaio

Missing Libraries:metaiosdklibxml2.dylibAVFoundationSecurity

Page 19: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SLAM Setup - metaiohttps://mobiledeveloperportal.ar-live.de/index.php

Page 20: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

SLAM Setup - metaio

Page 21: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmerswww.metaio.com/products/creator/

Page 22: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmerswww.layar.com/creator

Page 23: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmersstudio.wikitude.com

Page 24: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmersstudio.aurasma.com

Page 25: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmershttp://catchoom.com

Page 26: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Tools for Non-Programmerswww.ar-code.it

Cloud Campaign Editor

Page 27: Mobile AR SDK Tutorial - Augmented World Expo New York 2014

Thank You!

Patrick O’Shaughnessey

@[email protected] http://patchedreality.com