evaluation of augmented reality frameworks for android development
DESCRIPTION
Master defense at Graz University of Technology, 2014TRANSCRIPT
S C I E N C E T E C H N O L O G Y P A S S I O N
u www.iicm.tugraz.at
Evaluation of Augmented Reality Frameworks for Android Development
Iulia MarneanuJuly 3rd, 2014
Which is currently the best
open framework for developing
an Augmented Reality
mobile application?
July 3rd, 2014Iulia Marneanu
2
Agenda
• Motivation• Augmented Reality• AR Frameworks• Criteria• Test App• Scenarios
& findings
July 3rd, 2014Iulia Marneanu
3
Motivation
• Evolaris Next Level GmbH• growing in popularity on mobile devices [1]• 200 million mobile AR users worldwide by 2018 [2]• over 2.5 billion mobile AR apps by 2017 [3]• recent job market growth in Android development [4]
July 3rd, 2014Iulia Marneanu
4
Augmented Reality
July 3rd, 2014Iulia Marneanu
5
[5]
• Marker-based tracking• GPS tracking• Markerless tracking
Augmented Reality. Tracking Techniques
July 3rd, 2014Iulia Marneanu
6
AR Frameworks
Framework Development Availability
ARLab Spain (2006) Demo
ARToolKit USA (2001) Academic License
D‘Fusion France (1999) Watermark
Vuforia Austria (2011) Free
catchoom Spain (2011) Demo
metaio Germany (2003) Watermark
July 3rd, 2014Iulia Marneanu
7
Criteria
• Environmental criteria• Target criteria• Performance criteria• Usability criteria
July 3rd, 2014Iulia Marneanu
8
Criteria. Environmental Criteria
July 3rd, 2014Iulia Marneanu
9
Environmental Criteria Tests
Light intensity - Natural light- Direct light- Sudden change- Mirroring
Viewpoint 45° angle perspectives
Distance From 10 cm distance between testing device and target.
Visibility From 10% visible area.
Background Dark versus bright contrasts.
Noise From 10% noisy target image.
Target Criteria Tests
Grayscale Default size target image in grayscale.
Contrast Ratio Contrast value set to -50.
Size Four sizes: 5cm, 10cm, 15cm and 20cm.
Aspect Ratio Vertically or horizontally
Material - Glass- Laminated- Glossy photo paper
Criteria. Target Criteria
July 3rd, 2014Iulia Marneanu
10
Criteria. Performance Criteria
July 3rd, 2014Iulia Marneanu
11
Frameworks Flicker Motion Blur
Fast Moves Registration Occlusion
ARLab no no not supp. not supp. not supp.
ARToolKit min no partially supported
not supp. not supp.
D‘Fusion no no supported supported not supp.
Vuforia min no supported supported not supp.
catchoom no yes supported supported not supp.
metaio min no not supp. supported not supp.
Criteria. Usability Criteria
July 3rd, 2014Iulia Marneanu
12
Frameworks Face Tracking
Text Detection
Flash Camera
Front Camera
Extended Tracking
Multi Targets
ARLab yes yes
ARToolKit yes yes
D‘Fusion yes yes yes
Vuforia no yes yes yes yes
catchoom no no yes yes
metaio yes yes no yes yes yes
Test App
July 3rd, 2014Iulia Marneanu
13
Home Frameworks Criteria Scenarios Test Result
Test App. Tests
• Active tests „how much time does it need to…?“• Online criteria• Record the testing times
• Offline tests „is it supported or not?“• Offline criteria• Determine if a feature is supported or not
July 3rd, 2014Iulia Marneanu
14
Test App. Environmental Criteria Results
July 3rd, 2014Iulia Marneanu
15
Test App. Target Criteria Results
July 3rd, 2014Iulia Marneanu
16
Scenarios
• Interior Design• Magazine App• Bus Shelter• Supermarket Promotions• Tourist Translator• mCommerce
July 3rd, 2014Iulia Marneanu
17
Scenarios. Interior Design
Environmental Criteria Weight
Light Intensity 2
Viewpoint 5
Visibility 2
Distance 4
July 3rd, 2014Iulia Marneanu
18
Target Criteria Weight
Size 3
Performance Criteria Weight
Registration 5
Occlusion 4
Usability Criteria Weight
Multi-targets 3
Extended Tracking 4
Scenarios. Magazine App
Environmental Criteria Weight
Light Intensity 5
Viewpoint 3
Visibility 4
Noise 3
Distance 1
July 3rd, 2014Iulia Marneanu
19
Target Criteria Weight
Grayscale 4
Contrast Ratio 1
Size 2
Aspect Ratio 2
Material 3
Performance Criteria Weight
Registration 1
Flicker 1
Usability Criteria Weight
Multi-targets 3
Text Detection 2
Scenarios. Bus Shelter
Environmental Criteria Weight
Light Intensity 5
Viewpoint 5
Visibility 4
Noise 5
Background 4
Distance 3
July 3rd, 2014Iulia Marneanu
20
Target Criteria Weight
Size 2
Aspect Ratio 2
Material 3
Performance Criteria Weight
Fast Moves 4
Usability Weight
Text Detection 1
Extended Tracking 4
Flash 1
Scenarios. Supermarket Promotions
Environmental Criteria Weight
Light Intensity 1
Viewpoint 4
Visibility 5
Noise 2
Distance 2
July 3rd, 2014Iulia Marneanu
21
Target Criteria Weight
Grayscale 3
Size 3
Aspect Ratio 3
Material 4
Performance Criteria Weight
Motion Blur 4
Usability Criteria Weight
Multi-targets 5
Text Detection 1
Flash 1
Scenarios. Tourist Translator
Environmental Criteria Weight
Light Intensity 4
Viewpoint 4
Visibility 4
Noise 2
Background 1
Distance 3
July 3rd, 2014Iulia Marneanu
22
Target Criteria Weight
Contrast Ratio 5
Size 3
Material 2
Performance Criteria Weight
Flicker 5
Usability Criteria Weight
Text Detection 5
Flash 1
Scenarios. mCommerce
Environmental Criteria Weight
Light Intensity 5
Viewpoint 4
Visibility 4
Background 1
Distance 3
July 3rd, 2014Iulia Marneanu
23
Performance Criteria Weight
Flicker 2
Fast Moves 3
Usability Criteria Weight
Face Tracking 5
Front Camera 4
No AR framework is better than another, each has its advantages and
disadvantages.
In some circumstances, given a set
of constraints, a framework can
outperform others.
July 3rd, 2014Iulia Marneanu
24
References
[1] TechNavio - Infiniti Research Ltd. Global augmented reality market 2014-2018. A market research report.
[2] Juniper Research. Mobile augmented reality: smartphones, tablets and smart glasses 2013-2018. A market research report.
[3] Juniper Research. Over 2.5 Billion Mobile Augmented Reality Apps to Be Installed Per Annum by 2017. A market research report.
[4] Jennifer Lynn. iOS vs. OS: Current Job Market Is Growing Faster For Android Developers Than Apple.
[5] https://www.youtube.com/watch?v=Go9rf9GmYpM
July 3rd, 2014Iulia Marneanu
25
Thank you for your attention!
July 3rd, 2014Iulia Marneanu
26
July 3rd, 2014Iulia Marneanu
27