application testing suite 12.3 new features & · pdf fileats 12.3 new features and...

1

Application Testing Suite

12.3 New Features & Updates

Karilyn Loui

ATS Senior Product Manager

Oracle Enterprise Manager - ATS

2

ATS 12.3 - New Features and Updates: OpenScript for Functional

Testing and General Enhancements

• OpenScript - Chrome Browser Playback Support • Support for Chrome browser playback on Windows machine for Web, ADF, and JDE functional test modules.

• OpenScript - Enhanced Script Encryption • Scripts can be encrypted and password protected to protect sensitive data that may be contained within the script code.

• Input different passwords for separate scripts in an OLT scenario for a running load test.

• Script encryption password can be passed through the command-line and to OTM.

• Script passwords can be saved in OLT and OTM's database and OpenScript users can store the encryption passwords to a specified

OLT server.

• OpenScript-Only Installation • Oracle Technology Network (OTN) Download site includes a new ose-quick-install-<version>.zip file to install only the OpenScript

application.

• Oracle Flow Builder (a.k.a. Keyword Driven Testing) • Generate scripts based on keywords or actions without recording against the application.

• Two ways of creating scripts:Web UI or XLS UI.

• Pre-built components and flows shipped with Oracle Flow Builder.

3

ATS 12.3 New Features and Updates: OpenScript – Chrome Browser Playback

Support

• Supports playback of Web, ADF, and JDE functional test scripts on the Chrome browser on Windows machines.

• Chrome browser playback is supported from OpenScript UI, Command line, Oracle Load Testing, and Oracle Test Manager.

• Scripts must be recorded with Internet Explorer or Firefox.

• Go to View > OpenScript Preferences > General > Browsers and select Chrome in the script playback preferences.

4

ATS 12.3 New Features and Updates: OpenScript – Enhanced Script Encryption

• OpenScript users can encrypt sensitive data in the script by entering an encryption password for security purpose.

• Password is required during playback in order to decrypt sensitive data.

• Password is stored in OpenScript process memory or in OLT/OTM database but never in an external file.

• Users can set/reset different password for different scripts instead of setting a global password.

http.form(26,

"window[@index='1']//form[((@id='j_id_id3' and @name='j_id_id3') or

@action='http://slc01flh.us.oracle.com:7011/medrec/loginPatient.action') and @index='0']")

.submit(null,http.postdata(

http.param("j_id_id3:usernameInput","[email protected]"),

http.param("j_id_id3:passwordInput","{{@deobfuscate(eTRifWf5WIQM4DBsu7SCHw==)}}"),

http.param("j_id_id3:j_id_id19","{{web.input.jidid3jidid19,Submit}}")),

null, true, null, null, null, null, null);

Before Script Encryption

http.form(26,

"window[@index='1']//form[((@id='j_id_id3' and @name='j_id_id3') or

@action='http://slc01flh.us.oracle.com:7011/medrec/loginPatient.action') and @index='0']")

.submit(null,http.postdata(

http.param("j_id_id3:usernameInput","[email protected]"),

http.param("j_id_id3:passwordInput","{{@decrypt(FzadPFrGww4jI9QxTLHpdA==)}}"),

http.param("j_id_id3:j_id_id19","{{web.input.jidid3jidid19,Submit}}")),

null, true, null, null, null, null, null);

After Script Encryption

5


• After script encryption password is set, OpenScript will encrypt the following literals in APIs found in the script.

• When re-encrypting a script, OpenScript will re-encrypt the literals wrapped in "decrypt()" API and the "@decrypt()" function.

Module/Service API Parameter

WebDOM textBox.setPassword password

loginDialog.clickOK password

HTTP(Web mode) form.submit

form.multipartSubmit

http.param(“password”, value)

Forms FT logonDialog.setPassword password

textField.setPassword password

Siebel FT text.setPassword password

HTTP addAuthentication password

loadKeyStore keyStorePassword

SharedData setConnectionParameters password

Database databank asset.xml DB connection password

Basic callEncryptedFunctionByPath scriptPassword

runScript scriptPassword

Web Service security password

6


• The Input Scripts Password dialog box opens when a password protected script is added to the Build Scenarios tab in OLT.

• User can store the script password to OLT database, which will be linked to the current OLT logon account. If a user logons on with another OLT account,

he/she cannot get this script password.

• Different passwords can be used for different scripts in an OLT scenario for running the load test.

If checked, OLT will store the script password to DB.

Checks if the password is correct. If the password is incorrect a

‘Wrong Password’ message will appear.

If checked, OLT will apply the same password to the other

scripts listed in the dialog window.

Multiple rows are displayed in “Input

Scripts Password” dialog window when:

1) User adds a script which has script

assets and two or more of them are

encrypted.

2) User opens a saved scenario which

includes multiple encrypted scripts.

7


• Password is required when adding an encrypted script to OTM. If password is incorrect the script will not be added.

• Password is encrypted and stored in the OTM DB for each test.

• During playback OTM will retrieve the password, decrypt it, and hand it over to the Agent Manager for further processing.

8


• New Command Line Interface arguments are added to allow users to playback an encrypted script from the command line.

• More information is found in OpenScript User's Guide Section A.2.3 (Encryption Settings).

Command Line Argument Description

-encrypt.password Specify script passwords from the command line for encrypted scripts.

-encrypt.password.global Specify a global password that can be applied to any encrypted scripts.

-encrypt.password.prompt Enables interactively entering password for encrypted script one by one using the

console.

-streamProperties This argument can be used with any script, whether it is encrypted or not. It enables

a way of passing arguments to the CLI by reading from STDIN. If specified, the CLI

reads arguments from STDIN until \endStream plus a line separator is entered.

-streamCharset charset This argument can be used with any script, whether it is encrypted or not. It enables

a way to specify a charset that will be used to decode the byte array read from

STDIN to a string. Used only when -streamProperties is specified.

9

ATS 12.3 New Features and Updates: OpenScript–Only Installation

• Oracle Technology Network (OTN) download site includes a new ose-quick-install-<version>.zip file that can be used to install the

OpenScript application standalone.

• For OLT/OTM agent installation use the Micro Install or Complete Install zip file.

• The Upgrade Install file will no longer be available. Please use the Micro Install file for Upgrading OATS.

10

ATS 12.3 New Features and Updates: Oracle Flow Builder (OFB)

• Keyword-driven test script generator which generates scripts based on keywords or actions without recording against the application.

• Scripts can be created via Web UI or Excel UI.

• Pre-built components and flows shipped with Oracle Flow Builder. OFB is a separate download from ATS.

• A dedicated Oracle Flow Builder training will be made available at the Oracle Learning Library.

11

ATS 12.3 New Features and Updates: OpenScript for Load Testing & Oracle Load

Testing

• OpenScript Fusion/ADF Correlation Library Enhancements • New Fusion/ADF Correlation Library rules to provide enhancements to Web/HTTP load testing scripts.

• OpenScript Hyperion Load Testing Module Enhancements • New Hyperion Correlation Library rules to provide enhancements to Web/HTTP load testing scripts.

• Error Recovery Settings for Server Response Error Message.

• New Hyperion load test APIs provided for a more robust scripting experience.

• New Step Group Creator for Hyperion load test scripts.

• OpenScript PeopleSoft Correlation Library Enhancements • New PeopleSoft Correlation Library rules to provide enhancements to Web/HTTP load testing scripts.

• Oracle Load Testing Enhanced Command Line Execution • Additional options for running scenarios from the command line, giving users the flexibility to pass a number of new

arguments for the scenario.

12

ATS 12.3 New Features and Updates: OpenScript Fusion/ADF Correlation Library

Enhancements

• The OpenScript ADF Correlation Library is updated to provide a more reliable way of correlating ADF application

component ids and attributes for variables from ADF Rich Responses.

New ADF correlation library provides:

• Simplified list of correlation rules.

•Two NEW correlation rules to provide

more reliability in the script playback:

"setContextId"

"newWindowId"

12.2 ADF Library 12.3 ADF Library

New Rules in 12.3

13

ATS 12.3 New Features and Updates: OpenScript Hyperion Load Testing Module

Enhancements – New Correlation Library Rules

• The OpenScript Hyperion Correlation Library is updated to provide a more reliable way of correlating Hyperion application

session ids and attributes, which provides more automation to reduce scripting time.

12.3 Hyperion Library New Hyperion correlation library provides

many NEW correlation rules: "ssoTokenStar"

"ssoTokenAtSign"

"ssoTokenCRLFS"

"ssoTokenBNToLF"

"ssoTokenBNToCRLF“

"ora_epm_ctg header encoded"

"X-ORACLE-BPMUI-CSRF_v2"

"instanceId"

"uuid"

"unique“

"PageHash"

"rtrnID"

"uuid_v2“

"transformerActionId"

"Dom correlation"

"Client Set Cookie"

"frameDialogID"

"PDF_ID

"BQY_Wizard_ID"

"SQR_out_ID"

"formId"

"dimId"

"Tab Index"

"J_Id"

"CI"

"GI"

"TASK_ID"

"SOURCE_ID"

"selectedMembers"

"selectedMembers_URL"

"randomNFToken"

"jsRandomToken“

14


Enhancements – New Error Recovery Settings

• OpenScript preferences now has an Oracle Hyperion Load Test section to configure Server Error Message handling.

• Go to View > OpenScript Preferences > Playback > Error Recovery to select an option.

15


Enhancements – New Hyperion Load Test APIs

• New Hyperion load test APIs to encode/decode strings and validate server response.

• Refer to OpenScript Programmer’s Reference (<Install Dir>\docs\en\OpenScriptProgammersReference.pdf) for code

examples.

API Purpose Method Description

hyperion.getAtSignEncoder() Convert LF to @ Gets an implementation class of IEncoder, providing an encode method

of replacing '\n' to '@'.

hyperion.getBNToCRLFEncoder() Convert \n to CRLF Gets an implementation class of IEncoder, providing an encode method

of replacing '\' plus '\n' to "\r\n".

hyperion.getBNToLFEncoder() Convert \n to LF Gets an implementation class of IEncoder, providing an encode method

of replacing '\' plus '\n' to '\n'.

hyperion.getCRLFSEncoder() Convert LF to CRLF* Gets an implementation class of IEncoder, providing an encode method

of replacing '\n' to "\r\n*".

hyperion.getStarEncoder() Convert LF to * Gets an implementation class of IEncoder, providing an encode method

of replacing '\n' to '*'.

HTTPService.solve(String varName,

String pattern, String errorMsg, boolean

isOptional, Source sourceType, Integer

resultIndex, IEncoder encoder))

Use when there is a customized encode

option.

Param encoder: an Encoder implements IEncoder interface specifying

the encoding or decoding operation to perform on the variable's value

after solving the variable.

16


Enhancements – Step Group Creator • New Step Group Creator for Hyperion Load Test scripts.

• OpenScript parses for 4 patterns during recording for the 'Title' from Hyperion Contents. This is used to generate step groups & step

names.

12.3 Hyperion Step Group Setting

Pattern Example

HTML <title> Tag <title>Oracle Enterprise Performance

Management System Workspace, Fusion

Edition</title>

<BpmModule.Title>

Tag

<BpmModule.Title>Logon</BpmModule.Title>

<BpmModule> Tag

'title' attribute

<BpmModule id="cas.defaultmodule"

title='Application Management‘>

SetTitle API oHandler.getModule().getContent().setTitle(Bp

mStringBundle.getStringBundle("cds").getStrin

g("CustomUpdateLabel"));

17

ATS 12.3 New Features and Updates: OpenScript PeopleSoft Correlation Library

Enhancements

• The OpenScript PeopleSoft Correlation Library is updated to provide a more reliable way of correlating PeopleSoft

application session ids and attributes, which provides more automation to reduce scripting time.

12.2 PeopleSoft Library New PeopleSoft correlation library provides

many NEW correlation rules for reliable

playback:

"setRefreshPage"

"dom Correlation"

"currentDate"

"new_amount"

"change_amount"

"userLang"

"showModal"

"hnewpers_v1"

"hnewpers_v2"

"ICStateNum_v3"

12.3 PeopleSoft Library

New Rules in 12.3

18

ATS 12.3 New Features and Updates: Oracle Load Testing - Enhanced Command

Line Execution

• In 12.2 and previous releases, running scenarios from the OLT command line is limited to starting and stopping the scenario.

• Starting with 12.3, user can start/stop a scenario in addition to specifying Agent, Run, Export/Import, Report, and many more settings.

• See Appendix C of the Oracle Load Testing User’s Guide for more information and examples.

19

ATS 12.3 New Features and Updates: Oracle Test Manager

• Oracle Test Manager Test Set Execution Enhancements • The Test Execution tab has been enhanced to include new features for executing Test Sets during a test run.

• Oracle Test Manager Tests Tab Right Click Menu • Changes and Additions to the Right Click Menu.

• Oracle Test Manager Autosave Manual Tests • Automatically save changes made in the Run Manual Test window.

• Oracle Test Manager Administrator: Clone Project

• Clone an existing project data and structure to a new project in the database.

20

ATS 12.3 New Features and Updates: Oracle Test Manager Test Set Execution

Enhancements • UI Changes: New section layout along with options to execute a test set.

• New Features: Create multiple test runs, execute multiple test runs, pause & resume a test set, progress bar indicator, set

test results.

12.1 and 12.2 12.3

Test run status removed from the header section

'Execute Test Set' is renamed to 'Create Run'

Expand/Collapse buttons in each section

Launch & Set result buttons

Progress bar in Run History section

Owner & Status displayed for each test case during a test

set run

21


Enhancements – Create Multiple Test Runs

• Create a test run for a test set and specify run name and run parameters.

• Creating a run does NOT kick-off any tests, which is different from 12.1 & 12.2.

• You can create more than one test set runs to represent different test cycles.

Users can select which test set run to view

22


Enhancements – Execute Multiple Test Runs

• Both Manual & Automated test cases within a test run can now be executed individually from within a test set.

• Automated test cases can be executed sequentially by clicking on the Launch link.

• Once the Run button is clicked, the automated test cases will run in the order it is listed.

Click on Launch link to run Automated test cases

sequentially

Run individual test cases by clicking on the Green

arrow icon

Select which automated test case to execute and click Run

• Test cases added AFTER a test run has been created will

not be included in the test run.

• To run automated test cases in parallel, go to the Tests

tab and schedule them to run at the same time (on

different OTM agent servers).

23


Enhancements – Execute Multiple Test Runs

• Test set run details & results can be viewed by clicking on the test run link under the Run History section.

• Test set run summary is displayed in the header section.

• Test case results can be viewed by clicking on the test name.

Test set run summary

Click on an Automated test case to view the result report

Click on a Manual test case to view the result details

24


Enhancements – Pause & Resume a Test Set

• Manual Tests: Same as in previous releases. Clicking on the Save Run button will save the current test results.

• Manual Tests: Click on the Green arrow icon next to the Manual test case to resume the run.

Test run status is Incomplete until all test cases have been

executed

Click on Green arrow to resume the test

25


Enhancements – Pause & Resume a Test Set

• Automated Tests: Clicking on the Pause button will instruct OTM to pause the Automated test case execution AFTER the currently running

test has completed.

• Automated Tests: User can resume run by clicking on the Green arrow icon next to the test case or by clicking on the Launch link again.

Click on Green arrow to resume the test

Test run status is Incomplete until all test cases have been

executed

26


Enhancements – Progress Bar Indicator

• Progress bar indicator shows Green for Passed, Yellow for Warning, Red for Failed, and Purple for User-defined statuses.

• Floating tool tip displays the number of test cases Not Run (i.e. 2/6 (33.33%)).

27


Enhancements – Set Test Results

• A new permission called ‘Set/Override results’ was created in 12.3 to control who is allowed to set test results.

• By default the Test role contains this permission.

• ‘Set result’ link will be grayed out for users who do not have this permission.

• Users with this permission can click on ‘Set result’ link and enter or override results for the test run.

28

ATS 12.3 New Features and Updates: Oracle Test Manager - Tests Tab Right

Click Menu

• 'Quick Run' has been renamed to 'Run Test'.

• The following menu options were added: Add Test as child, Multi Edit Tests, Rename Test, Paste as child

12.1 and 12.2

Menu Option Description

Add Test as child Adds a new test case as a child of the currently

selected test case.

Multi Edit Tests Not a new feature as this functionality exists in

12.1 & 12.2. This menu option was added to make

users aware that you can hold down SHIFT key

and select multiple test cases > right click > select

‘Multi Edit Tests’ to bulk edit test cases.

Rename Test Allows user to rename the test case without the

option to edit other fields in the test case.

Paste as child Pastes a copy of a test case as a child of the

currently selected test case.

12.3

29

ATS 12.3 New Features and Updates: Oracle Test Manager - Autosave Manual

Tests

• A backup copy of test steps data is saved when the Run Manual Test window opens to run a manual test case.

• Changes are posted in the database when any test step data (either comments or result) is changed.

A blue check mark indicates the last change to the test step

status has been saved. A green check mark with a timer icon indicates the autosave for the current test step status is pending.

30

ATS 12.3 New Features and Updates: Oracle Test Manager Administrator –

Clone Project

• Allows Oracle Test Manager administrator to clone an existing project data and structure to a new project in the database.

• Prior to 12.3, only the project structure (Users, Roles, and Fields) was cloned.

• All data is cloned by this feature. Cloning is only possible within the same database schema.

31

Thank you!

application testing suite 12.3 new features & · pdf fileats 12.3 new features and...

Documents