phonegap / cordova developer day - automated app testing
TRANSCRIPT
Automated App Testing: A pain or cure?
Martin Poschenrieder Founder testmunk
mposchenrieder
http://www.html5rocks.com/en/tutorials/tooling/synchronized-cross-device-testing/
~80% of apps are only used once and then deleted.
http://www.digitaltrends.com/mobile/16-percent-of-mobile-userstry-out-a-buggy-app-more-than-twice/
mposchenrieder
Increasing pressure on company and development.
mposchenrieder
CSS Rendering issues Pixel density difference
Elements are cut off Crashes
Loading time on specific devices
5 common testing challenges for hybrid apps:
We want to build the best apps in the shortest time.
Goal:
mposchenrieder
Development Testing Develop. T.
Release
“We don’t have enough time for testing”
“Let’s check what we can automate”
mposchenrieder
Development Testing Develop. T.
Release
TestingDevelopment
“Our tests are breaking”
“Automation doesn’t fit us because we are shipping so fast”
T
Automation beginners often only use automation at the end of the release. This results in several consequences…
“We can’t keep up with maintaining our tests”
“We can’t rely on our tests”
“We still have heavy manual testing”
mposchenrieder
I save some hours, but I have to deal with:
Learning new skills Maintenance
Flakiness Coordination
Coverage
mposchenrieder
Isn’t this guy running a test automation company?
…there are successful implementations!
But:
mposchenrieder
Effective test automation means changing your process.
mposchenrieder
5 lessons learned
mposchenrieder
Development
Release
Automated tests are most powerful when they are used as part of your
continuous development.
1
Development and test have to work together.
2
https://s-media-cache-ak0.pinimg.com/736x/aa/58/b1/aa58b18449869811a413b37d73b79b89.jpg
Build a robust, solid test suite.
3
Set up a good framework that is easy to maintain.
For example: Page Object Framework
mposchenrieder
Have rather less, but stable tests.
4
“Our tests are flaky”
mposchenrieder
Aim for Continuous Integration on a Pull Request Level.
5
Daily runs are okay, but are not as effective.
mposchenrieder
Have a test case that simply goes through the whole app and takes screenshots1
Your first steps into automation….
mposchenrieder
Run a ‘munkey test’ (link)2
Build a simple smoke test3
Your first steps into automation….
Have a test case that simply goes through the whole app and takes screenshots1
