new generation record/playback tools for ajax testing

13
New Generation Record/Playback Tools for AJAX Testing Frank Cohen, +01 (408) 871-0122, [email protected] September 13, 2011

Upload: appvance-inc

Post on 16-May-2015

1.709 views

Category:

Technology


2 download

DESCRIPTION

While some in the test community talk about record/playback technology as dead-end test automation approach, a new generation of open source record/playback test tools that every tester should consider is now available. Tools like Sahi and TestMaker Object Designer were built for AJAX environments and support thousands of web objects and the asynchronous nature of AJAX. Frank Cohen shows you how to install and use these free tools in your environment and record test scripts of a complicated AJAX application in IE, Chrome, Firefox, Safari, and Opera. Learn how to data-enable applications without coding, use branching and looping commands, construct advanced element target locators without using XPath, and package tests as reusable test objects to share with other testers.

TRANSCRIPT

Page 1: New Generation Record/Playback Tools for AJAX Testing

New Generation Record/Playback Tools for AJAX Testing

Frank Cohen, +01 (408) 871-0122, [email protected]

September 13, 2011

Page 2: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

The Death of Capture/Playback‣ “It's no secret that using capture / playback as the sole

automation technology leads to failure,” Edward Kit at PSQT Conference, 2002

‣http://tinyurl.com/43dvq84

‣And that was before...

2

WebKit

Page 3: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

3

Open Source Testing (OST)

Page 4: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

Why An OST Alternative?‣HP QuickTest Professional does a great job for testing a small part of

the Internet

‣Functional Testing (Smoke, Regression, Integration)

‣Windows using ActiveX

‣Flash, Flex

‣MS Internet Explorer

‣Web 2.0 with Coding Effort

‣Best Money Can Buy

4

Page 5: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

OST For Everywhere Else‣Open Source Testing Tools

‣TestMaker Object Designer

‣Selenium

‣Sahi

‣Unit Tests (Java, Ruby, Python, PHP)

‣Record in WebKit based browsers (Chrome, Safari, Opera),IE, Firefox

‣Agile Testing, Agile Performance Testing and Production Monitoring

‣Rich Internet Applications (RIA,) Mobile, Pads

‣OST For Everyone (Developers, Testers, Business Managers)

5

Page 6: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

OST Architecture

6

Functional

Test

Production

Monitor

Load Test

Continuous Integration

Repository Bug TrackerTest

ManagementMonitoring

Test Authoring

SoapUI (Pro)

Sahi (Pro)

JUnit Class Framework

Eclipse Java IDE

Fitness

Languages: Java, Python

Wiki Collaboration

Application Under TestWeb, RIA, BPM, SOA

PTTMonitorCPU, Net, Memory

Test Injector

BundlesMySQL, HtmlUnit

ScriptRunnersSahi, Selenium, SoapUI, Java

Data Production Librariescsv files, rdbms queries

Test Operation Console

RepositoryMySQL RDBMS

Results AnalysisBusiness Intelligence Tool

DesignerRecord/Playback

Grid and CloudTest Deployment

Page 7: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

Browser Compatibility Tests

7

Application Under Test

TestMaker Console

TestNode

Selenese Test

Selenium RC SeleniumHtmlUnit

Page 8: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

8

ScriptRunnersScriptRunner Type Name (langtype)

Designer Script IE, Htmlunit designerscript

Selenium HtmlUnit Browser selenium

Selenium RC IE, Firefox, Chrome seleniumrc

Sahi IE, HtmlUnit sahi

HTTP Archive Page Optimization HAR

Selenium RC IE, Firefox, Chrome seleniumrc

SoapUI SOAP and REST soapui

TestGen4Web Web 1.0 Tests testgen4web

Mozmill Mozilla XUL Tests mozmill

Unit Tests jUnit TestCase Java, Jython, JRuby, PHP, Perl, Groovy

DotNet .NET Tests dotnet

Visual Basic VB tests vb

Command Line Desktop and utils commandline

Page 9: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

Your cloud or mine? Or both!

9

SOAP

TestNode

test

PTTMonitor

TestNode

test

PTTMonitor

Application or Service

SOAP SOAP SOAP

HTTP REST AMF AJAX

TestMaker Console

TestNode

test

PTTMonitor

TestNode

test

PTTMonitor

Test RunTime

Page 10: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

You’re Such A Geek!

Lots of Possibilities

10

Seattle, DatacenterTestNode

TestMaker

Dallas, TexasDatacenter

Generating Load

Test Sent

Page 11: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

Let’s Talk About...‣How To Record/Playback Rich Internet Applications

‣Repurposing Test Objects To Be Functional Tests, Load and Performance Tests, and Production Monitors

‣Adding Verification Steps to Tests

‣Data Enabling Tests

‣Object Repository for Sharing Test Objects

‣Operating Selenium, Sahi, and soapUI tests in Grid and Cloud Environments

‣Running Root Cause Analysis Reports

11

Page 12: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

What’s Missing in OST‣Desktop Record/Playback

‣QTP VB Script Conversion (see PushToTest Global Services)

‣Keyword/Expert Mode (see Designer’s Export menu)

‣HP Quality Center (QC) Integration (Requires TestMaker Enterprise)

‣Object Repository (OST depends on svn, CI)

‣Time-based Recording

‣HP Mercury Reporting Is Better, OST Catching Up Fast

‣HP Mercury Add-ons

12

Page 13: New Generation Record/Playback Tools for AJAX Testing

Open Source Test Automation

Where To Go From Here‣Download And Learn TestMaker Object Designer

‣http://www.pushtotest.com

‣Watch A Screencast and Tutorial

‣http://www.pushtotest.com/screencastcentral

‣Tell Your Followers

‣http://twitter.com/fcohen

‣Attend An Open Source Test Workshop

‣http://workshop.pushtotest.com

13