what's new in ca agile requirements designer?

World®’16

What'sNewinCAAgileRequirementsDesigner?Huw Price– VP,ApplicationDelivery,andProductManagerCAARD- CATechnologies

DO5X27S

DEVOPS

2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD

ForInformationalPurposesOnlyTermsofthisPresentation

©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.Thepresentationprovided atCAWorld2016isintendedforinformationpurposesonlyanddoesnotformanytypeofwarranty.Someofthespecificslideswith customerreferencesrelatetocustomer'sspecificuseandexperienceofCAproductsandsolutionssoactualresultsmayvary.

CertaininformationinthispresentationmayoutlineCA’sgeneralproductdirection.Thispresentationshallnotserveto(i)affecttherightsand/orobligationsofCAoritslicenseesunderanyexistingorfuturelicenseagreementorservicesagreementrelatingtoanyCAsoftwareproduct;or(ii)amendanyproductdocumentationorspecificationsforanyCAsoftwareproduct.Thispresentationisbasedon currentinformationandresourceallocationsasofNovember1,2016,andissubjecttochangeorwithdrawalbyCAatanytimewithout notice.Thedevelopment,releaseandtimingofanyfeaturesorfunctionalitydescribedinthispresentationremainatCA’ssolediscretion.

Notwithstandinganythinginthispresentationtothecontrary,uponthegeneralavailabilityofanyfutureCAproductrelease referencedinthispresentation,CAmaymakesuchreleaseavailabletonewlicenseesintheformofaregularlyscheduledmajorproductrelease.SuchreleasemaybemadeavailabletolicenseesoftheproductwhoareactivesubscriberstoCAmaintenanceandsupport,onawhen andif-availablebasis.Theinformationinthispresentationisnotdeemedtobeincorporatedintoanycontract.


Abstract

ThissessionwillprovideanoverviewofthenewfunctionalityinCAAgileRequirementsDesignerandhoworganizationsareusingittorealizevalue.Putsimply,alothaschangedsinceCAWorld2015,andourvisionforsoftwaredevelopmenthaschangedwithit.

Joinustofindoutabout:• Anextendedrangeofintegrationscoveringprojectmanagementtools,versioncontrol

systems,testautomationframeworksandmore.We’verecognizedthatmanuallyinterveningtomoveassetsbetweentoolsandformatsistooslow,introducesdefectsandstandsinthewayofthefullyautomatedpipelinewhichisDevOps,andwe’veworkedtoresolvethispressingissue.

• Aninnovativeapproachtotestautomation,whichenablestestscripts,testdataandvirtualendpointstobegeneratedautomaticallyforpotentiallyanyscriptorkeyword-drivenframework.

• Moreaboutrisk-basedtesting,wheretheprobabilitythatcertainpartsofthesystemwillbeexercisedbyausercanbereverse-engineeredfromlivesystemdataandusedtogenerateoptimizedpaths.

HuwPriceCATechnologiesVP,ApplicationDelivery,andProductManager,CAAgileRequirementsDesigner


Agenda

CREATINGAUTOMATIONSCRIPTS,DATAANDVIRTUALDATAALLATONCE

RISK-BASEDTESTING

INTEGRATIONS,THENEWMACVERSIONANDWIREFRAMING

EXTENDEDINTEGRATIONS:JIRA,CAAGILECENTRAL,HPEALM

DATABUILDER ANDETL

CAAGILEREQUIREMENTSDESIGNERSEVER– BIGDATACLOUDSTORAGE

1

2

3

4

5

6

New

in2015-16

Ontheroadm

ap

COGNITIVEADAPTIVETESTING7


What’sNew2015-16


CreatingAutomationScripts,DataandVirtualDataAllatOnce


UsingCAARDasanAcceleratortoTestAutomation

Therequirementsortestcasesstoredasan“active”flowchart

Anautomationengineer/testercreatesaconfigurationfileand

overlayscodesnippets

Nomoremanual,linearscripting,andallthebenefitsoftheoptimizer:§ Systematicallyandautomaticallyderiveoptimizedtests§ Maximumtestcoveragewithnoover-testing§ “Oneinput,manyoutputs”– createandmaintaintestdata,virtualendpointsandexpectedresultsasa

partofautomation§ Reacttochange– auto-updatethetestsandcreateare-usablelibraryoftestcomponents

Theoptimizercompilesthescripts,completewithdata

Thetestscanbecreatedforanyscript-drivenframework

Changesmadetothemodelareautomaticallyreflectedinthetests


CAAgileRequirementsDesigner– AutomationLayers

§ CAAgileRequirementsDesignercannowgenerateautomationScriptsdirectly.Youcan:– CreateCodeSnippetLibraries– LinktheSnippetstoVariables– MaptheSnippetstofunctionallogicinflows

§ GeneratemultipletypesofautomationscriptsbasedonoptimizedTestCases

§ RegenerateAutomationScriptswheneverthelogicchanges§ CreateRequest-ResponsePairsatthesametimeasscripts


Risk-BasedTesting


WhatIsRiskBasedTesting

Risk-basedtesting(RBT)isatypeofsoftwaretestingthatfunctionsasanorganizationalprincipleusedtoprioritizethetestsoffeaturesandfunctionsinsoftware,basedontheriskoffailure,thefunctionoftheirimportanceandlikelihoodorimpactoffailure.Intheory,thereareaninfinitenumberofpossibletests.

Wikipedia

RiskAssessmentProductRisk


DigitalRisk

Focusattentiononaparticularaspectofthebehaviourofthesystem.Thesemightbecriticalorriskyfeatures,technicalaspectsoruseroperationsofinterest,orparticularaspectsoftheconstructionorarchitectureofthesystem.

Pocketbook

ChiefDigitalOfficer ChiefRiskOfficerDigitalAssurance


DigitalAssurance

DigitalAssuranceenabledsolutionsmodelcomplexecosystemsofecosystemstovisualizestheapplicationsecologyandleveragesconnectedintelligencetechnologytooverlaybusinessdata,riskandbehavioursofsystems(systemicandepistemic).

Pocketbook

ArD

DesignOpsAppEcology


CAAgileRequirementsDesigner

Requirements

DigitalManagement

DigitalRisk

DigitalTesting


DigitalTesting

Atthemostfundamentallevel,thepurposeoftestingistogatherinformationtolearnaboutsomeaspectofasystemandpotentiallymakeadecisionbasedontheoutcomeofoneormoretests.

Pocketbook

ShiftRightShiftLeft ConnectedIntelligence


ExtendedIntegrations:JIRA,CAAgileCentral,HPEALM


ManyGoodProjectManagementToolsDeliverImmenseValuetoTestandDevelopmentTeamsPMTools:

1. Supportdecisionmaking:bothproductandprojectdecisions

2. Provideacentralizedstoreforassetswithanorderlyfilestructure

3. Allocatetaskstoavailableteamsorteammembers

4. Visibilityandtraceabilitybetweenteams’tasks

5. Helpwithproductroadmapping andmoreinformeddecisionmaking

6. Offerdashboards,forecasts,monitoring

7. Includetime,costorcomplexityestimates


Visibility InformeddecisionmakingTrackability

Communication Traceability

TrackabilityCollaborationCross-functionalteams Cross-functionalteams

Tests

Defects Stories

Epics

Manageriallevel


Communication Traceability

TrackabilityCollaboration

Tests

Defects Stories

Epics

HastheRequirementsorTestDesignProcessFundamentallyChanged?

Visibility InformeddecisionmakingTrackability


Tocreateperfecttest

cases

Designandprovisiontestdata

Tomanagechangeintestcases

Tocreateautomation

scripts

Fromoneinput

Createmultipleoutputs

=

Fewerlanguagehops

Fewerproducthops

Toestimatecomplexity

Populatestoryboardsandbacklogs

WhereDoesCAAgileRequirementsDesignerFitinWithPMTools?

Tobuildbetterrequirements

Toimprovemyexistingtestcases

DesignandprovisionSV

Impactanddifferences


Systemundertest

TestScript

CAAgileCentralCAARD

Flow Testassets

CAAgileCentralObjects

Defects

Environments/Opsteam

AutomationLibraryTestData

AutomatedTest,

LinkedtoTestData

VirtualEndpoints

Optimizedtestcasesareexportedbackoutandlinkedtoexpectedresults.Thesemighthavevirtualendpointsandresolvedtestdataattached.

11

3

4

5

6

2

Changerequest

7

1

ExampleInfrastructure:CAAgileCentral


OntheRoadmap


DataBuilder


CAAgileRequirementsDesigner- DataBuilder

DataBuilder – anewsetoffeaturesinsideArD tohelpdesignandmanufacturecomplexdatausingtheTDMDataGenerationengine.

Itcreatesscriptstocreatethedata,whichcanbemovedontoCImanagedimages– DockerimageincludetheDatabuilder scriptstofindandmakethedataappropriatefortheautomatedtests.

Thetargetschemai.e.wherethedatawillbecreatedhasasetofCAmetatables.Thesetablescontrollocaltestmatchingi.e.finding(notestmartisrequired).

YoucanalsodoafindandIFNOTfounddoamake.

Wealsotrackkeysforcheckingactualvsexpectedresults.

Thepublishissplitintothreeparts:§ Buildthekeys§ Dothepublish§ Doanypostactions,SUM,AVGetc.

ThetimeittakestocreatecomplexpublishescomparedtousingoldCATestDataManagerhasgonefromhourstominutes.Itwillgotoseconds.EventuallywewillhopetoparseSQLandautobuildthedataneededtotestit.

Anintegratedtooltocreaterequirements,automation,testdataandvirtualization.


CAAgileRequirementsDesigner- DataBuilder

DataBuilder hasmanyapplications:

§ ETLTesting

§ BigDatatesting

§ MigrationTesting

§ BusinessIntelligenceTesting

§ ComplexEDIFileCreation

§ Plusgeneraldatacreationtosupportdevelopment,testingandautomation

§ Couldalsobedeployedasadocker applianceonAWS,etc.


CAAgileRequirementsDesignerSever–BigDataCloudStorage


RunResults

TypicalBuildProcess

ExecutionEngine

BuildEngineDevelopment/

Code

DifferentvisualrepresentationsofPass/Failresults.

TrafficLights Dashboarding Email(Jenkins)


CurrentWorldOrder– Bottlenecks– NoIntelligence/Dependencies

Testing– Grayarea


Stage1– RunResultFeedbackLoop(CloudStorageforResults)

ExecutionEngine

BuildEngine

Development/Code

Model

Runresults


Step2– MoveAllArtefactsIntoCloudStorage->BigDataStorageforFlowsTestresultsbounddirectlytotheirroutesthroughthesystem.


Step3– PinPointTesting/DetectFaultAfterafailurethemodelcanbeusedtogeneratememoretest

casesbypinpointtesting– testcasesfocusedondiscoveringmoreknowledgeaboutthefailure.


Step4– RiskAnalysis/DependencyMappingUsemeta-deta assignedtothemodeltoperformriskanalysis.Aretheeffectedroutesthroughthesystemaboveasetthreshold?

=63%ofUserActivity

Can’tRelease


Step5– DependencyMappingofCodeWe’vefoundtheprocess(es)responsible– nowwecantracebacktotheresponsibleteams!

DevelopmentPinpointedFailure

Defectcreated


Stepx,y,z– RunninginParallel

§ Onlineoptimisationinthecloud

§ Predictiveanalysis

§ Dashboards

§ Reports

§ Insight


Integrations,theNewMACVersionandWireframing


IntegrationWithSV

§ CreationofRRPairsinARD

§ AbilitytopostdirectlytoSVandcreatevirtualserviceon-the-fly

§ EmbedappropriatelinkstoserviceinAutomationscripts

Scripts

VirtualService


IntegrationWithRA


IntegrationWithRA

§ GoingtouseRAtobuild,deploy,test,andreleaseARDwithinourowneco-systemindevelopment

§ Allowustodevelopacomprehensivesetofdemo’sofhowwetestARDwhichcanbeusedtodemonstrateARD.

§ We’llmakethisavailableviaanimagedVMeveryrelease-Realdata,realscenarios,realtests.


EggPlantIntegration– KeywordDrivenAnexampleusecase:1. OpenyoureggplantsuitefromAgileDesigner:allimages

areavailableinalistonapane.2. Whenmodifyingablockdescription/oranycode

completion-enabledfield,thoseeggplantimagesareavailableasentriesforcodecompletion.

3. Youchooseaanactionfromthecodecompletion,andwhenenteringthevariablenames,haveeggplantimagesavailableinyourcodecompletion– buildingautomationfornontechnicalteams


MACVersion– ARD– AvailableforBeta


Telerik– ReportingandAutomation

§ Reportingtool§ Create

automationscripts§ FullAPILayer


Wireframing - DevelopRapidPrototypesFromRequirements

Transformmodelbasedrequirementsintoarealscenarios– earlyrealizationofrequirements

• Mapuserinputactionstoprocesses• Addconditionsforoutputstooccur• Applytestdatafunctionswhichareresolved

persteptogooffandhuntdatabasedontheexecution

• Fullintegrateddebuggingenvironmenttovisualizetheflowandcorrespondingdataduringexecution


CognitiveAdaptivetesting


Questions?


RecommendedSessions

SESSION# TITLE DATE/TIME

DO5X29SModel-BasedTestingforAchievingMaximumCDPipelineAcceleration

11/17/2016at3:00PM

DO5X40S CaseStudy:WhyRabobankWasInspired 11/17/2016at3:45PM

DO5X42STechVision:TestDataonDemand:DeliveringtheRightData,totheRightPlace,attheRightTime

11/17/2016at4:30PM


MustSeeDemos

UseModelBasedTesting

CAAgileRequirementsDesigner- 515-DevOpsTheatre5

DevOps5Theatre

AchieveMaxTestCoverage

CAAgileRequirementsDesigner- 516DevOpsTheatre5Theatre

ImproveDataCompliance

CATestDataManager512- DevOpsTheatre5

DevOps5Theatre

DeliverTestDataFaster

CATestDataManager511- DevOpsTheatre5


Thankyou.

Stayconnectedatcommunities.ca.com


DevOps– ContinuousDelivery

FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu

what's new in ca agile requirements designer?

Technology