appium & selenium in the cloud & seleniumi… · appium & selenium in the cloud...

Appium & Selenium in the CloudChallenges and Solutions

2

We will send you a recording of this session after the webinar

Please write your questions in the Q&A pane

Before we start

Start testing for free

www.experitest.com

Speakers

3

Elad Dotan

VP Operations

Ruth Zamir

Director of Marketing

Agenda

4

Why test in the cloud?01 5 min

Summary & Q&A03 10 min

02 Key challenges and solutions 30 min

5

Digital transformation requires

DevOps speed

6

7

Let someone else worry bout logistics

• Its complex

– Build, configure, maintain, manage

• What you need, when you need it

– quick access to large device, OS and browser matrix

• Speed and scale: realize the grid promise

• Team alignment and code reuse

– developers, business users, testers

• Anytime, anywhere global collaboration

• No downtime: availability and utilization

Why test in the cloud?

8

Poll

Agenda

9

Why test in the cloud?01 5 min

Summary & Q&A03 10 min

02 Key challenges and solutions 30 min

10

Low Performance

& Latency1

11

Continuous testing requires feedback within minutes

• False positives

• Low automation reliability

• Low productivity

• User frustration

Speed is your key objective

Your checklist for high performance

12

❑ Local datacenter

❑ Tier 4 datacenter

‒ Redundant capacity components

‒ Dual powered components & Multiple links

‒ All components fault tolerant including

power, uplink, Storage, chillers. HVAC etc.

‒ Staff onsite

❑ Tier 1/2 ISP

‒ More bandwidth

‒ Fewer hops

Datacenter requirements

❑ High availability architecture

❑ Continuous testing in production

❑ Live monitoring

Testing solution

13

Security &

recovery2

14

Deal with perceived and real challenges

Leading security objections:

• Malicious attacks

• Data breach and data loss

• Regulation

Security concerns one of the key barriers to cloud migration

Real security challenges:

• Connection to staging and backend

systems

• User authentication

• Project and user management

• Regulation

Your security checklist

15

• ISO 27001 and SOC 2 certification

‒ Datacenters

‒ Vendor software

• VPC (Virtual private cloud)

‒ Network level - firewall

‒ Application level – IPS, virus detection…

• Network Security

‒ Communication over HTTPS

‒ VPN Site to Site

‒ Whitelisting

‒ Network tunnel

Solution Security

• Hybrid solution: cloud / on-prem

‒ Ability to retain certain applications on premise

• Security Features

‒ Project management

‒ Cleanup procedures

‒ SSO and MFA

• Onsite backup

• Encrypted backup

• CloudOps competency

• Fully isolated environment (not multi-tenant)

Security Features

16

Support for entire

DevOps team3

One team, different tools and needs

17

< / >

Developer TesterBusiness user

XCode, Android Studio,

XCUITest, Espresso,

Live testing, codeless

tools, Cucumber

Appium, Selenium

Development, unit

testing, debugging

Exploratory testing,

acceptance testing

Exploratory testing, test

automation,

performance testing,

API testing

Decision

maker

Quality decisions

Dashboards, reports

18

• Framework support

– Open source, native tools

• Live screen sharing

• Code sharing

– Application / website, test

– Testing code in local / staging environments

• Consolidated reports

• Advanced analytics

Your DevOps team checklist

19

Use case

support 4

20

Use case becoming complex

21

Evaluate your needs and use cases, make sure cloud vendor can support them

• Special device support and availability

– Scanners (Zebra)

– IoT

– SIM switchers

• System and 3rd party apps

– Voice

– Text message generation

– GPS integration

• Complex scenarios that span several devices

– Multi device reports reflecting a single end to end test scenario

• Commitment to latest device, OS, browser support

– Including beta versions

Coverage checklist

22

Scale &

Cost5

23

High scale parallel execution

DevOps speed

More people

testing

wider

device / browser

matrix

Shorter

timeframe* *

=

Thousands of tests

per minute

24

Plan for fast feedback and coverage

• Evaluate vendors’ ability to meet requirements

– Run thousands of tests per minute

– Intelligent test queuing and distribution

– Resource availability

• Calculate your cost structure for growth

Your checklist for scalability

Agenda

25

Why test in the cloud?01 5 min

Summary & Q&A03 10 min

02 Key challenges and solutions 30 min

SeeTest Continuous Testing Cloud for web and mobile applications

Full offering for testers, developers, and executives

26

Digital

LabWeb, Mobile,

IoT

Integrations with CI

• Jenkins

• Bamboo

• TeamCity

• Hudson

• Circle CI

• HP QC

• Jira

Integrations with test env.

IDEs and languages

Test creation:

• Appium studio for Eclipse

• Appium studio for IntelliJ

• Selenium

• Codeless tools

(Tricentis, Worksoft, etc.)

Developer tools:

• Espresso

• XCUITest

• XCode

• Android Studio

• Local testing

• Debugging on remote devices

Non-functional

• Device monitoring

• Performance

• Network virtualization

• Eclipse

• IntelliJ

• JUnit

• TestNG

• Cucumber

• Nunit

• Visual Studio

• C#

• Perl

• Ruby

• Java

• Javascript

• Python

• React

• Angular

• React native

• Ionic

• Phonegap

• Cordova

SaaS datacenters worldwide with real devices & desktop browsers

All datacenters ISO 27001 and SOC 2 certified, additional datacenters planned

27

Fremont, CA

Bracknell, UK

Tel Aviv, Israel

Frankfurt, Germany

New Delhi, India

NYC, NY

Toronto, Canada

Sydney, Australia

Tokyo, Japan

Singapore

Questions?Thank you!