mobile quality assurance
DESCRIPTION
An overview of how Pivotal Labs performs quality assurance on mobile. We have over 1300 mobile devices on all platforms - iOS, Android, Windows, BlackBerry and more. We perform automated and manual testing using various tools and methodologies to ensure a bug-free app for our clients.TRANSCRIPT
Pivotal Labs Toronto
PIVOTAL LABS QUALITY ASSURANCE
PLATFORM COVERAGE
OUR TEAM AND APPROACH
DEVELOPMENT START
PROJECT MANAGEMENT FOR QA PLANNING
QA INTEGRATED CYCLES
FEW WEEKS BEFORE PROJECT ENDS
BUILD
FIX QA
RC
DEVELOPMENT END
BUILD
FIX QA
PIVOTAL LABS THE QA PROCESS
THE TESTING PROCESS
Initial Setup Testing Review Final Checklist
THE TESTING PROCESS
THE TEST DOCUMENT
PIVOTAL LABS TEST COVERAGE
ESSENTIAL
FUNCTIONAL• Verifying specific actions or
functions of the code, usually based on the BRDs
GUI• Verifying the user interface to
ensure that it meets specification (functional and non-functional)
ACCEPTANCE• Part of handoff process towards
the end of the project
STRESS• Deliberately intense or thorough
testing used to determine the stability of the application
USABILITY TESTING• Evaluating the user experience of
a product by testing it on users
CAPABILITIES
ADVANCED
BETA TESTING• Testing with beta users using
techniques such as Configuration, In-the-wild, Dog food, and Discovery
APP SUBMISSION CHECKLIST• Validating the app meets generic
app store requirements
REGRESSION• Seeks to uncover changes to
previous functionality due to new updates
STABILITY• Testing for stability of the system
with large workloads
SMOKE• Preliminary testing to reveal
simple bugs severe enough to reject a release
INTEGRATION TESTING• Testing the integration of the
mobile application along with other existing components of the larger application suite
CAPABILITIES
PIVOTAL LABS CI AND DEVICE AUTOMATION
• Currently utilizing an advanced Jenkins environment - Builds over 40 active projects - Implemented for Android, BB10, Windows and iOS - Performs build verification, TDD, automation
• Defines many custom build environments
• Able to perform device automation for Android and iOS
• Upon code change and successful build, Jenkins will install the application to a connected device and run an automated test if available
JENKINS CI
PULSE MONITOR
TRAVIS CI•For TDD projects we utilize Travis CI for private repositories
•Travis is a cloud-based CI solution that is optimal for TDD by performing build verification and running tests
•Builds are performed on VMs that are installed with the latest packages and SDK’s: no maintenance required.
•Currently using Travis for nearly 15 active projects
THANK YOU!
Pivotal Labs Toronto