what’s new hp automation tools
DESCRIPTION
HP Unified Functional TestingHP Functional Testing (QuickTest Pro)HP Service TestTRANSCRIPT
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
1
Heather Taylor – Sr Product Marketing [email protected]
HP Software Test Automation Tools
What’s New
HP Unified Functional TestingHP Functional Testing (QuickTest Pro)HP Service Test
22
Modern Applications bring new Testing Challenges
3
What does the business want?
Base: 206 IT decision makers with insight into budgeted modernization activities. Source: Clearing Your Path to Modern Applications and Business Agility, Forrester Research, April 6, 2010. A Forrester Consulting thought leadership paper commissioned by Hewlett Packard.
Agility…
Innovation…
Lower cost…and a better application
experience
4
What does application modernization mean to QA?
Technology• Complex integrated
systems• Distributed components• Test GUIs, APIs, web
services and vertical integration
• RIA, Web 2.0
Process• Agile, iterative hybrids• Automate early without
GUI• Accommodate fast-paced
changes
People• Global, distributed teams• Pressure to expand skill
set or risk being outsourced
• More BA participation• Increase collaboration with
development
Asks• Shorten test cycles• Improve planning
estimates• Test more with less• Take on more technical
tasks• Improve collaboration• Align testing objectives
with overall business objectives
5
Test and Automate early for best outcome
C1 C1
C2
C1
C2
C3
G2
C1
C2
G1 G1
C3
C1
C2
G1
G3
G2
C3
C1
C2
G1
… …BP1
BP2
G3
G2
C3
C1
C2
G1
Regression test at the end of each iteration or as part of continuous build
Automate tests when available
components become stable
C GUI-less component
G GUI element
BP business process
stable component
6
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Interact with modern GUI interfaces, Web 2.0
7
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
8
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
9
Modern Applications have many layers
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Report on the quality of the entire end to end process
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
10
Modern Applications have many layers
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Report on the quality of the entire end to end process
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
11
HP Software solutions multi-layer testing
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
HP Unified Functional Testing
HP Unified Functional Testing includes the ability to test the GUI layer + the Headless layer + the end to
end process.
12
Unified Functional Testing
HP Service Test
HP Functional Testing
(QuickTest Professional& all the add-ins)
Call activities from the other
productTransfer data Unified report
HP Unified Functional Testing 11.00
13
HP QuickTest Pro script to call HP Service Test HP Unified Functional Testing integration
HP Service Test call in QTP
14
Unified report showing HP Service Test step
Shows activities from bothHP Functional Testing & HP Service Test
Multiple views of the flow
Full traceability for easier debugging
1515
HP Functional Testing (QTP)
16
What’s new with HP Functional Testing 11.00? (QuickTest Pro)
GUI and headless testing with Unified Functional Testing
Visual Object Identification
Web 2.0 and RIA support
Dev-QA collaboration with application log verification
Enhanced Reporting
Data Awareness to help Prepare and Manage Test Data
And More….
HP Restricted | Date or Rev. #17
Visual Identification of Objects
HP Functional Testing 11.00
18
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
19
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Ferrari
Fiat
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
20
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!
– QTP allows you to identify “key” and “fragile” objects and express a geometric relationship between them
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Ferrari
Fiat
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
21
Schematic Representation
Visual Identification of Objects
22
New Complex Visual Relationship IdentifierVisual Relation Identifier – object details
New VRI Object
Property
Clickto Add
23
Configure Relation
Visual Identification of Objects
Object Relation Preview on AUT
‘Static’ object
HP Restricted | Date or Rev. #24
Collaboration between Dev and QA using AUT Log Verification
HP Functional Testing 11.00
25
Leverage application log into the Functional Testing effort
Application Under Test (AUT) Log Verification
Detects issues of the AUT internal state
Supports Log4Net and Log4J
Enhances the test reports
Pass/fail a test according to log errors
Detailed defect description
26
Log Tracking Pane
Log tracking Report in the Run Results Viewer
HP Restricted | Date or Rev. #27
HP Functional Testing & HP Quality Center Integration
Data Awareness Capability
HP Functional Testing 11.00
28
Improved data management capabilities with HP Quality Center + HP Functional Testing
Share test data across tests and test scenarios
Run tests on a subset of the data; reporting is granular to the data row level
Requirements coverage can be granular to the test data level
Data source
Req 1
Req 2
Req 3 Test 3
Test 2
Test 1 Data set 1
Data set 2
Data Set 3
HP Restricted | Date or Rev. #29
Testing Web 2.0 and RIA
HP Functional Testing 11.00
30
Out of the box support
Community
Testing Web 2.0 and RIA
• Simpler & faster• Harness the power of
community• Aimed for Web 2.0 controls
Extensibility Accelerator
RIA
Ajax Toolkitsand more…
Extensibility
31
Out of the box support
Community
Testing Web 2.0 and RIA
• Simpler & faster• Harness the power of
community• Aimed for Web 2.0 controls
Extensibility Accelerator
RIA
Ajax Toolkitsand more…
Extensibility
32
Opening web extensibility to the online community: Extensibility Accelerator
33
Easy, wizard-like interface
Extends HP Functional Testing fast; uses Intellisense
Automated deployment
Free download from www.hp.com
Opening web extensibility to the online community: Extensibility Accelerator
34
Improved debugging capabilities
35
Additional Web support
– Support for Firefox on web extensibility objects−Run, Record, Learn, Spy
– Identify object according to the XPath and CSS– Automatically identify control using Xpath
HP Restricted | Date or Rev. #36
Enhanced Reporting
HP Functional Testing 11.00
37
Enhanced reporting and Run Results Viewer
Executive Summary
38
Enhanced reporting and Run Results Viewer
Executive Summary
Data
39
Enhanced reporting and Run Results Viewer
Executive Summary
DataPrevious
Run
40
Enhanced reporting and Run Results Viewer
Customizable panes
Quick high level overview
Collaborative report viewer – No need for a FT license
Recovery for corrupted reports
Executive Summary
DataPrevious
Run
HP Restricted | Date or Rev. #41
And more…
HP Functional Testing 11.00
42
New Menu and EvaluatorImproved regular expressions
New Regular Expression Evaluator
aids in writing and validating regular
expressions.
Works with the Object Repository,
Checkpoints and Recovery Scenarios
43
Object Spy Enhancements
Highlight the selected object
in the application
Copy object description
Add test object to current
repository
4444
HP Service Test
45
GUI
Why focus on testing the headless layer?
46
GUI
AquaLogic
BPMS
Tibco
TradingLogistics
Rules Engines
Reservations
JMS
Java.Net
WCF
XML JSON
Fix / Swift
Web servicesSOAP
Why focus on testing the headless layer?
47
• Bugs discovered earlier are cheaper and easier to fix
• Shorten late-stage testing cycles
Test earlier in the lifecycle
• Reduce test cycle time for services and consuming applications
Another opportunity for
automation
• Harden the building blocks of your applications
• Reduce risk in all layers of the application
Independent validation of services &
components
• …like performance, security, integrations, standards compliance and more
Can’t test all aspects through
the GUI…
Why focus on testing the headless layer?
48
HP Service Test 11.0
Services testing made easy
• Visual, intuitive test design
• Ready-to-use test activities
• Features for both technical and non-technical users
• Test headless layer without programming
• Powerful data driving• Simple security config.
Integrations with HP Software
• Multi-layer testing with HP QuickTest Professional
• Integration with HP Loadrunner
• Industry-leading test management with HP Quality Center
• Enhanced component test management using HP Service Test Management
Technology support
• Activities for HTML, WSDL, REST, JMS, Java, WS-Security, and more OOBox
• Add custom event handlers with .NET, C# and auto-completion
• Based on standard .NET framework
• Add support for additional technologies not supported out of the box
49
HP Service Test visual test designer
50
Visual Test Flow Designer
drag & drop canvas
51
Extensive Toolbox(Almost) codeless
testing
52
Activity Properties
53
Powerful Data Handling!
Supports text-based data tables, Excel,
XML
54
Configuring security
Straightforward security config for most common standards including WS-Security and WCF scenarios
55
Data driving Map fields in the property sheet to columns in the data table
Auto generate from the structure of the activity, or drive manually with existing file
56
Creating custom events
Choose from a list of events, or create custom event handlers
57
Custom event handlers
Auto-complete makes it easier to create custom event handlers
58
Custom event handlers
Auto-complete makes it easier to create custom event handlers
59
Custom event handlers
Auto-complete makes it easier to create custom event handlers
60
Custom event handlers
Auto-complete makes it easier to create custom event handlers
61
Custom event handlers
Auto-complete makes it easier to create custom event handlers
62
Custom event handlers
Auto-complete makes it easier to create custom event handlers
63
Custom event handlers
Auto-complete makes it easier to create custom event handlers
64
Join the community!
– www.hp.com/go/swcommunity
– The Future of Testing blog (swcommunity)
– www.hp.com/go/functionaltesting for more product information and product availability matrix
– LinkedIn groups for QC, BPT, QTP and Service Test (new!)
65
Thank you!