samsung augmented reality image sdk (bada, android)

13
SARI Samsung AR Image SDK AR and Image Recognition Eduard Oks Samsung Telecom Research Israel

Upload: 3scalenet

Post on 29-May-2015

8.880 views

Category:

Technology


0 download

DESCRIPTION

This presentation gives an overview over the Samsung Augmented Reality Image SDK (SARI) for bada and Android. It was presented at the Augmented Planet event AP2011 in London on June 1.

TRANSCRIPT

Page 1: Samsung Augmented Reality Image SDK (bada, Android)

SARI Samsung AR Image SDK

AR and Image Recognition

SARI Samsung AR Image SDK

AR and Image Recognition

Eduard OksSamsung Telecom Research Israel Eduard OksSamsung Telecom Research Israel

Page 2: Samsung Augmented Reality Image SDK (bada, Android)

2

SARI OverviewSARI Overview SAMSUNG AR Image SDK

Allows development of different interesting AR use cases

Provides markerless 3D camera tracking and object recognition

Freely available for Android and bada phones

Page 3: Samsung Augmented Reality Image SDK (bada, Android)

3

SARI for DevelopersSARI for Developers

Build AR apps with underlying 2D and 3D models

Integrate video into AR apps with according rendering quality

Publish AR apps on Samsung Apps for bada and Android

Downloadable AR ApplicationDownloadable AR Application

SARISARI

Android / bada OSAndroid / bada OS

Page 4: Samsung Augmented Reality Image SDK (bada, Android)

4

SARI Use Case 1:AR Present App using 3D ModelSARI Use Case 1:AR Present App using 3D Model

Find a short video about the AR Present app on YouTube:

http://www.youtube.com/watch?v=t4mRVux02HI

Page 5: Samsung Augmented Reality Image SDK (bada, Android)

5

SARI Use Case 2:TeddyBear AppSARI Use Case 2:TeddyBear App

Find a short video about the TeddyBear app on YouTube:

http://www.youtube.com/watch?v=JmC0VUYWMhE

Page 6: Samsung Augmented Reality Image SDK (bada, Android)

6

SARI Use Case 3:EdiBear AppSARI Use Case 3:EdiBear App

Find a short video about the EdiBear app (without markers) on YouTube:

http://www.youtube.com/watch?v=98AT8DJqNOc

Page 7: Samsung Augmented Reality Image SDK (bada, Android)

7

SARI Use Case 4:AR Portrait AppSARI Use Case 4:AR Portrait App

CONFIDENTIAL

Find a short video about the AR Portrait app on YouTube:

http://www.youtube.com/watch?v=NTjZYkfD06s

Page 8: Samsung Augmented Reality Image SDK (bada, Android)

8

JNI (Android)

SARI API

Camera Tracking

Image Match Search in DB

OAF (bada)

SARI SDK – Summary SARI SDK – Summary

3D Camera tracking over planar objects over camera input No need for a-priori knowledge of tracking object

Object recognition based on image matching Can be used for recognition of tracking area

Can be used for object identification

Image search in image DB on phone

Page 9: Samsung Augmented Reality Image SDK (bada, Android)

9

SARI SDK – Mode 1SARI SDK – Mode 1

Markerless RT 3D camera tracking

Provides freedom to application developer – no predefined images

3D Camera tracking is not limited by specific reference area and can be

changed during run-time

Simultaneous Localization and Mapping based approach (SLAM)

Real time calculation (less than 40 milliseconds on Galaxy S)

Auto-correction based on global camera position calculation

Page 10: Samsung Augmented Reality Image SDK (bada, Android)

10

SARI SDK – Mode 2SARI SDK – Mode 2

Object recognition based on image matching

Matches between two images and provide similarity score

Feature based matching

Provides geometric transformation between 2 images

Invariant to illumination, scale, rotation (perspective projection*)

Image search in image DB on phone

Page 11: Samsung Augmented Reality Image SDK (bada, Android)

11

Contents of the SARI SDKContents of the SARI SDK

Reference applications for Android, bada and PC

Demonstrate 3D real-time camera tracking

3D object rendering using OpenGL 2.0

Synchronization between 2D camera input image and 3D model

PC simulator allowing development using PC environment

Developer guide

API reference documentation

Detailed developer how-to’s

SARI library for Android, bada and Win32 with relevant .h files

Page 12: Samsung Augmented Reality Image SDK (bada, Android)

12

ContactContact

For more information about SARI and access to SDK, contact:

Eduard Oks

[email protected]

+9725 4330 7055

Page 13: Samsung Augmented Reality Image SDK (bada, Android)

Thank You!Thank You!감사합니다감사합니다 !!