mobile web testing - success through automation

30
Mobile Web Testing: Success Through Automation By: Sivakumar Anna Wed. June 29, 2011 All trademarks are the property of their respective owners. ©2004-2010 InfoStretch Corporation. All rights reserved. InfoStretch Webinar

Upload: durgesh-kaushik

Post on 25-May-2015

2.650 views

Category:

Technology


0 download

DESCRIPTION

Learn About: best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices With the growing penetration of HTML5 , mobile web is being seen as the future of mobile applications. However, developing or expanding your mobile web solutions can be challenging due to rapid changes in technology; diversity of the device environment; variations in platforms, hardware, networks and form factors that can affect performance, compatibility and usability; attaining a secure mobile Web experience; and certifications and app store approvals. In this live Webinar, Sivakumar Anna, InfoStretch Director of Enterprise Services, will present a comprehensive overview of the Web mobility landscape and testing systems, and best practices to leverage test automation to overcome the challenges of testing Websites on mobile devices. Siva’s presentation will include: 1. Diversity of the mobile device environment including mobile phones, smartphones and iPads, and how to identify your device list for target customer base. 2. Managing the challenges of hardware configurations, networks, carriers and platforms. 3. How to build a framework to conceptualize, automate and regress hundreds of test cases on mobile devices without requiring a significant investment in device acquisition. 4. Managing usability in the event of exceptions or interrupts, and how to handle unknowns for connected applications due to carrier restrictions. 5. Demonstration of a framework for automating mobile Web testing using commercial and/or open source tools.

TRANSCRIPT

Page 1: Mobile Web Testing - Success Through Automation

Mobile Web Testing: Success Through Automation

By: Sivakumar AnnaWed. June 29, 2011

All trademarks are the property of their respective owners.©2004-2010 InfoStretch Corporation. All rights reserved.

InfoStretch Webinar

Page 2: Mobile Web Testing - Success Through Automation

1. InfoStretch Overview2. Enterprise Mobile Web Landscape3. Enterprise Mobile Web Testing4. Mobile Web Automation Demo

Agenda

INFOSTRETCH CORP CONTACT INFORMATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Page 3: Mobile Web Testing - Success Through Automation

AboutInfoStretch1

Elevating Confidence

INFOSTRETCH CORPORATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Page 4: Mobile Web Testing - Success Through Automation

Organization HQ in Silicon Valley Offices in New York, Seattle 105+ Clients and 160+ Projects Well Established Recruitment, retention and training

programs

People Average 6 years experience 350+ Engineers/Consultants Industry Expertise in Finance,

Retail, Mobile and Healthcare Strong Project Mgmt. team

Infrastructure Extensive Platform

Compatibility and Performance Test Labs

2000+ Mobile Handset Test Lab ISO 9000-2001 Certified High Availability and 24 hours

secure offshore centers with ISO 27001 Audited

InfoStretch Overview

INFOSTRETCH CORPORATE(p) (408) 727-1100 | (w) ww.infostretch.com | (e) [email protected] | Presenter: Rutesh Shah©2004-2011 InfoStretch Corporation. All rights reserved.

Awarded Inc 500/5000 company

of the year 2010

Tot 20 QA Services Provider

Market Mover for Software TestingRecognitionsKey Partners

Page 5: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORP CONTACT INFORMATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

EnterpriseMobile Web

2

Page 6: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Global Mobile Data

50Percent

120Billion

40Percent

4Years

internet users worldwide

Smartphone US Population

Mobile internet users will over take desktop internet users

100+Countries

With more than 10 million internet requests4

2Billion

Mobile Payment by 2014

Mobile E-Commerce Market by 2015

Page 7: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Mobile Web Growth

Page 8: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Mobile In Enterprise

Financial Services

Retail Services

CRM Services

Page 9: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Enterprise Mobile Web

New presentation layer

Utilize existing infrastructure

Leverage Standards and Technologies

Page 10: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

EnterpriseMobile WebTesting Models

3

Page 11: Mobile Web Testing - Success Through Automation

The difference

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

New Presentation Channel

Fully working backend exists

Knowledgebase available

Reduced Time to Market

Testing Challenges

Generating device specific traffic

Single set of scripts across multiple devices / platforms

Page 12: Mobile Web Testing - Success Through Automation

The difference

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Channel Integration

Information Sync across different channels

Alerts and Notifications

Features dependent on multiple channels

Testing Challenges

Co-ordination with other channels

Setting up environment

Validation on multiple systems

Page 13: Mobile Web Testing - Success Through Automation

How to test?

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

1. Simulators / Emulators

3. On Real Devices

2. On Real Devices using Remote Access Services

70%

20%

10%

Page 14: Mobile Web Testing - Success Through Automation

Mobile Web Test approach

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Type of Testing

Unit Testing

Integration Testing

System Testing

Regression Testing

Compatibility Testing

Usability Testing

Server Performance

TestingSecurity Testing

Interrupt Testing

Simulator/Emulator YES YES YES YES YES NO YES NO NO

Remote device YES YES YES YES YES YES YES YES YES

Real Devices YES YES YES YES YES YES YES YES YES

Page 15: Mobile Web Testing - Success Through Automation

What is Simulator testing?

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Simulators - Software that duplicates the mobile internet traffic

Generate browser request by sending device specific HTTP Header details

Vendors provide platform specific simulators / emulators

Browser plug-ins available to generate the HTTP traffic

Page 16: Mobile Web Testing - Success Through Automation

Conceptual diagram of enterprise architecture

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Database Layer

Application Layer

Web Presentation Layer

Mobile Web Presentation Layer

Web Presentation Layer

Page 17: Mobile Web Testing - Success Through Automation

Benefits of Mobile Simulators Testing

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

High Return on Investment

Test at early stages of dev cycle

Ability to do end-to-end automation

Leverage existing infrastructure

Over-the-air (OTA) is possible

Page 18: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Limitations of Mobile Simulators Testing

Can’t do peripheral connectivity testing

Not possible to perform any carrier imposed restrictions

Cannot test the device interruptions

Page 19: Mobile Web Testing - Success Through Automation

Mobile Website Samples - simulated

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Mcdonalds.com

Page 20: Mobile Web Testing - Success Through Automation

Mobile Website Samples - simulated

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Cars.com

Page 21: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Automation Architecture (Deployment)

Application Under Test

Web Proxy

Browser

Automation Lab

1. Update proxy with device configuration

3. Browser Intercepts HTTP Request

4. Proxy Massages HTTP Request with Device Header Information

5. AUT assumes the request came from Mobile Device

1

34

5

2

2. Automation tool invokes test step

Page 22: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Mobile Web Automation Demo

4

Page 23: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Device Execution Summary Report

Page 24: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Device Execution Summary Report

Page 25: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Mobile Web Automation - Remote Devices

Page 26: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Perfecto Mobile and InfoStretch

Host Private Mobile Cloud for Enterprise Customers

Provide Automation Implementation and Training

Provide device inventory based on the customer need

Page 27: Mobile Web Testing - Success Through Automation

phone: (408) 727-1100 | website: www.infostretch.com | email: [email protected]

©2004-2010 InfoStretch Corporation. All rights reserved.

Sync Text Browser Open

Image Select

Virtual Function Library

Schedule Payment Sync Text Quick Links Nick Name

Text Select Send SMS Make Call ZIP ATM Search Sign On Make

PaymentConfirm Payment

Perfecto Library

Test Case Automation Architecture

Virtual Functions

QTP TestcasesDevice Implementations

Browser Open

Browser Go To Sign On Make

PaymentConfirm Payment Sign Off

Make Payment Test caseQTP / Web IDE

iOS Android HTC Aria

Android HTC Droid BB Torch LG CU620 LG VX9000

Device Implementations for Sign On (10+)

BB 8520

Devices

Text Verify

Page 28: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION WEBINAR(p) (408) 727-1100 | (w) www.infostretch.com (e) [email protected] | presenter: Sivakumar Anna

Demo – Real Device using Perfecto Mobile

Page 29: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Any questions?

Page 30: Mobile Web Testing - Success Through Automation

INFOSTRETCH CORPORATION(p) (408) 727-1100 | (w) ww.infostretch.com | presenter: Sivakumar Anna

Headquarters2880 Lakeside Drive, #200Santa Clara, CA 95054(408) 727 1100

Partners

New York17 Tanglewood Rd,Scarsdale, NY 10583(703) 395-9791

Seattle2550 3rd Ave, #712Seattle, WA 98121(206) 402-2426

Ahmedabad5th Floor , Regency Plaza, Anand Nagar, Ahmedabad-15, Gujarat, India91-79-40266266

MumbaiVashi InfoTech Park ,B103,Tower # 1, Vashi Rail Station, New Mumbai, Maharashtra, India91-22-6947900

Website: www.infostretch.com