samsung augmented reality image sdk (bada, android)

SARI Samsung AR Image SDK

AR and Image Recognition

SARI Samsung AR Image SDK

AR and Image Recognition

Eduard OksSamsung Telecom Research Israel Eduard OksSamsung Telecom Research Israel

2

SARI OverviewSARI Overview SAMSUNG AR Image SDK

Allows development of different interesting AR use cases

Provides markerless 3D camera tracking and object recognition

Freely available for Android and bada phones

3

SARI for DevelopersSARI for Developers

Build AR apps with underlying 2D and 3D models

Integrate video into AR apps with according rendering quality

Publish AR apps on Samsung Apps for bada and Android

Downloadable AR ApplicationDownloadable AR Application

SARISARI

Android / bada OSAndroid / bada OS

4

SARI Use Case 1:AR Present App using 3D ModelSARI Use Case 1:AR Present App using 3D Model

Find a short video about the AR Present app on YouTube:

http://www.youtube.com/watch?v=t4mRVux02HI

5

SARI Use Case 2:TeddyBear AppSARI Use Case 2:TeddyBear App

Find a short video about the TeddyBear app on YouTube:

http://www.youtube.com/watch?v=JmC0VUYWMhE

6

SARI Use Case 3:EdiBear AppSARI Use Case 3:EdiBear App

Find a short video about the EdiBear app (without markers) on YouTube:

http://www.youtube.com/watch?v=98AT8DJqNOc

7

SARI Use Case 4:AR Portrait AppSARI Use Case 4:AR Portrait App

CONFIDENTIAL

Find a short video about the AR Portrait app on YouTube:

http://www.youtube.com/watch?v=NTjZYkfD06s

8

JNI (Android)

SARI API

Camera Tracking

Image Match Search in DB

OAF (bada)

SARI SDK – Summary SARI SDK – Summary

3D Camera tracking over planar objects over camera input No need for a-priori knowledge of tracking object

Object recognition based on image matching Can be used for recognition of tracking area

Can be used for object identification

Image search in image DB on phone

9

SARI SDK – Mode 1SARI SDK – Mode 1

Markerless RT 3D camera tracking

Provides freedom to application developer – no predefined images

3D Camera tracking is not limited by specific reference area and can be

changed during run-time

Simultaneous Localization and Mapping based approach (SLAM)

Real time calculation (less than 40 milliseconds on Galaxy S)

Auto-correction based on global camera position calculation

10

SARI SDK – Mode 2SARI SDK – Mode 2

Object recognition based on image matching

Matches between two images and provide similarity score

Feature based matching

Provides geometric transformation between 2 images

Invariant to illumination, scale, rotation (perspective projection*)

Image search in image DB on phone

11

Contents of the SARI SDKContents of the SARI SDK

Reference applications for Android, bada and PC

Demonstrate 3D real-time camera tracking

3D object rendering using OpenGL 2.0

Synchronization between 2D camera input image and 3D model

PC simulator allowing development using PC environment

Developer guide

API reference documentation

Detailed developer how-to’s

SARI library for Android, bada and Win32 with relevant .h files

12

ContactContact

For more information about SARI and access to SDK, contact:

Eduard Oks

eduard.oks@samsung.com

+9725 4330 7055

Thank You!Thank You!감사합니다감사합니다 !!