overcoming test automation obstacles

05/01/2023 1© 2016, Perfecto Mobile Ltd. All Rights Reserved.

7 key recommendations for building a solid test automation suiteMay 2016

Eran KinsbrunerDirector, Tech. Evangelist

Perfecto

Uzi EilonTechnology Director

Perfecto

Daniel KnottMobile Senior Test Engineer

Xing AG

Webinar Agenda

05/01/2023 2© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Mobile Test Automation Challenges

Strategy for defining the right digital test coverage

Practices For Robust Test Automation

The 7 Keys for Unattended Mobile Test Automation

Live Demo!

Q & A

05/01/2023 3© 2015, Perfecto Mobile Ltd. All Rights Reserved.

I SAIDI WAS FINE.

I LIED.

Poll – Mobile Test Automation Challenges

05/01/2023 4© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Code / Test – Common Challenges

1) Execution of One script across platforms

2) Automating build/deploy and acceptance testing during CI

3) Test results analysis

4) Object id Identification

5) Does it work over time ?

6) Maintenance of scripts and Objects

7) Matching Dev/Testers skill set

DevOps – challenges

Tools

Reports

Flows

Time Stability

False negatives

Collaboration

The Test Coverage Conversation – What To Answer?

Which Devices? Which OS Versions? How Many platforms are Enough? When Should I refresh my test lab? Who is in charge of coverage?

05/01/2023 7© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Mobile Test Coverage Method

Recommended OS – Usage & Quality Rationale

Usage & Quality Issues

Wi-Fi IssuesBattery Drain

Latest REF Android OS

Recommendations Leverage market calendars and stay updated Refresh/Review your test lab once a quarter Beta versions are no longer an option

Chrome, FireFox, iOS Leverage analytics but validate and calibrate using market trends Real user conditions extends your test coverage Assign an owner for digital test coverage but keep the conversation open to all

teams Mix your mobile test lab with the 4 device types

05/01/2023 10© 2015, Perfecto Mobile Ltd. All Rights Reserved.

WHY AUTOMATE?

UI

Integration

Unit Testing

Performance Security

Digital Transformation Requires Changes Around Test Automation

Target Devices

TargetEnv.OS

OS versionsForm factorsCPU & MemoryManufacturersWearablesIOT

NetworksOrientationLocationNotificationsEventsDevice events

Object Identification Is Key For Robust Automation

05/01/2023 13© 2016, Perfecto Mobile Ltd. All Rights Reserved.

• Selenium• Appium• XCTest• UIAutomation• Perfecto

• Abby OCR• Applitools• Perfecto

14

Device/System Level Control is Critical

15

Assure Proper Error Handling

System level control

Application control

Device control

3 Layers Involved In Test Automation Optimization

05/01/2023 16© 2016, Perfecto Mobile Ltd. All Rights Reserved.

App• Info.Plist (iOS)• Manifest.MF (Android)

Test Cases• Define Desired Capabilities

Device• Supports Feature• Doesn’t Support

Facebook App Testing Diversity

05/01/2023 17© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Test Scenario iPhone 6/iPhone 5S iPhone 6S/6S Plus iPad Tablets

Login YES YES YESWrite Post (FB UI) YES YES YESWrite Post (FB Force Touch) NO YES NOUpload Photo/Video(FB UI) YES YES YESUpload Photo/Video(FB Force Touch) NO YES NOTake Photo/Video(FB UI) YES YES YESTake Photo/Video(FB Force Touch) NO YES NO

More Examples: Android Doze & Multi Window

05/01/2023 18© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Android 6 and Above

Android N and Above

Validate Feature Compliance & Test Accordingly

05/01/2023 19© 2016, Perfecto Mobile Ltd. All Rights Reserved.

IOS Developer Library

INFO.PLIST

7 Keys for Successful Unattended Automation and CI

05/01/2023 20© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Start small & Grow Accept that not every test enters CI

Debug & Debug Again across few platforms Make your script reusable

Validate within and between the tests Plan for unexpected events Keep channel between Engineering,

Ops and Biz opened

Zero Effort Automation Demo

More Example

05/01/2023 22© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Smart Monkey Automation

05/01/2023 23© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Smart Monkey Automation

05/01/2023 24© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Webinar Agenda

05/01/2023 25© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Mobile Test Automation Challenges

Strategy for defining the right digital test coverage

Practices For Robust Test Automation

The 7 Keys for Unattended Mobile Test Automation

Live Demo!

Q & A

Thank You