-
ENABLING SUCCESSFUL MOBILE AUTOMATION TESTING
-
INTRODUCTION
• Michael Pollino – Technical Test Consultant with Planit
• 8 years Automated and general Testing experience
• Planit provide Software Testing solutions. We are based in Melbourne, Sydney, Perth and NZ with a team of over 500 Testing Consultants
-
UNSUCCESSFUL MOBILE TESTING
-
OVERVIEW
Proliferation of Mobile Devices
The Mobile Difference
Mobile Landscape
Technology Targeting
Tools
Defining Success?
1
2
3
4
5
6
-
THE PROLIFERATION OF MOBILE
Smartphones are becoming indispensable to Australian daily life
• Australian Smartphone ownership:
- 52% in 2012
- 64.6% in 2013
• 7.5 million Australians used the Internet on a Mobile in June 2013.
• Increase of 33% from to June 2012 and 510% since June 2008.
Source: http://www.theaustralian.com.au/
http://www.ourmobileplanet.com/en/http://www.acma.gov.au
-
THE PROLIFERATION OF MOBILE
The bottom line:
• $8.5 Billion generated revenue from Apps in 2012 in the US
• iTunes experienced 81% growth in revenue in the US in 2013
• Overall spending on apps set to grow to $46 Billion by 2016
Source: http://www.streetinsider.com/
http://www.news.cnet.com/http://www.acma.gov.au
-
THE MOBILE DIFFERENCE
Question: What is the difference between a Mobile Development project and any other project?
Answer: Time. The rate at which things change on a Mobile App Project is far faster than your usual projects
-
THE MOBILE DIFFERENCE
Everything is faster:
• Changes in operating systems
• Changes in technology – Platforms and Standards
• Changes in devices
• Changes in user expectation
• Changes in business requirements
Nothing stands still – first to market is critical
-
THE MOBILE LANDSCAPE
Source: http://developer.android.com/
-
WHERE DOES AUTOMATION FIT?
• Why do we need it?
• What will it give us?
• When do we start?
• What do we Automate?
• How do we do it?
-
• User experience absolutely critical
• User expectations high
• Feedback is very visible
• Would you want to explain this:
ARE YOUR CUSTOMERS TRYING TO TELL YOU SOMETHING?
Source: https://play.google.com/store
-
• Test the technology your customers are using
• Analytics
• Create a Technology Cross section that represents your client base
• Get the most from your Test Effort - break down your traffic.
- Know what to support, more crucially – when to support it
- Map the user experience
• Standardised devices? Hero handsets? Tablets?
TECHNOLOGY TARGETING
-
• Emerging new technology
• Lower cost of ownership of actual physical devices
• Increased Handset diversity
• Easily shared resources for manual testing
• Geographical considerations
• Performance
• Security
• Object Recognition?
THE CLOUD ENVIRONMENT
-
• Free!
• Poor representation of real world
• iOS only simulates Software
EMULATORS AND SIMULATORS
Use for Development and Maintenance
-
• Real world hardware
• Real world provider
• Robust Object Recognition
• Concurrent Test Execution
• Emulators and Simulators used for development
• Cost and Maintenance
• Physical Security
PHYSICAL DEVICES
-
Mobile Automation is comparatively immature –Careful tool choice is critical
• Application under test is crucial for Tool selection
• Object Recognition – We must move past capture replay
• Device independent test cases
• Compiling third party code with your application
WHICH TOOL DO I CHOOSE?
-
• Mobile only functionality; camera, GPS, tactile buttons.
• Will I get support?
• Integration with existing Automation Suite
• Open Source
WHICH TOOL DO I CHOOSE?
-
• Higher quality
• Shorter Test cycles
• Defects Found Quicker
• Money Saved
• Happier Testers
SUCCESS!
-
• Improve
• Maintain
• Refactor
• Document
The mobile space changes rapidly – Adapting with to these changes is critical
NOW WHAT?
-
QUESTIONS?
-
How to Contact Us
Planit Sydney Michael Pollino Technical Test Consultant
Tel: 02 9464 0600
Email: [email protected] Mobile: 0408 574 226
Email: [email protected] Melbourne
Tel: 03 9099 1313
Email: [email protected]