moving from load runner to open source: increase performance test coverage 10x-100x through...
TRANSCRIPT
World®’16
TechVision:MovingFromLoadRunnertoOpenSource—IncreasePerformanceTestCoverage10x-100xThroughShift-LeftandDemocratizationDaveKarow- Sr.PrincipalProductMarketingManager- CABlazeMeter
DO5T54S
DEVOPS
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
Haveyoubeenwonderingabouttheriseofopen-sourcealternativestoLoadRunner andotherlegacyperformancetools?PerhapsbecauseofthefactthatHPErecentlytransferredpowerofLoadRunner toMicroFocus,nowisaperfecttimetolearnhowyoucanplayaleadershiproleinthisnewapproachthatfitsinbetterwithmodernsoftwaredeliverypractices.LegacytoolcomplexityandlicensingforcedallperformanceengineeringworktoqueueupforatripthroughtheperformancetestingCenterofExcellence(CoE).Thatledtobottlenecksanddrovenewlyformingagiledevelopmentteamstoseekoutopensourcetoolstomeettheirneeds.Now,teamsatfirmsundergoingdigitaltransformationsareturningtheCoE insideoutbydoinglesstestingthemselvesandfocusingonfacilitatingthescale-upofthisdemocratizedmodel.ThistransitionisoneofthereasonswhyCArecentlyacquiredBlazeMeter®,theleaderinenterprise-scale,opensourceperformancetestfacilitation.Inthissessionyou’llbeintroducedtothekeyconceptsthatwillallowyoutomakethetransitionfromLoadRunner toJMeter andotheropensourcetools.You’llseehowasmallCoE teamcandrivea10xor100xincreaseintestingbyhandingoutloginstoself-servicetoolsinsteadofbeingafiniteresourcefortestpreparationandexecution.
DaveKarow
CATechnologiesSr.PrincipalProductMarketingManager-ContinuousDeliveryBusinessUnit
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
LEGACYTOOLSCREATEDTHECOE BOTTLENECK
AGILEMEANSELIMINATINGHANDOFFS&BOTTLENECKS
WHY OPEN-SOURCEPERFORMANCETESTING?
COE2.0:FACILITATINGSHIFTLEFT/DEMOCRATIZATION
GETTINGSTARTEDWITHOUTREINVENTINGTHEWHEEL
1
2
3
4
5
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
LegacyToolsCreatedtheCOEBottleneck
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ComplexityWorld®’16©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD6
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RestrictiveLicensing
World®’16©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD7
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
TheCenterofExcellence(COE)WasBorn
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Smallnumberofexperts+scarcityofinfrastructure
=aqueue
§ InContinuousDelivery:– 15Minutes?– FiveMinutes?– 30Seconds?
§ Image:frontofline.Nowaiting.Bottlesonassemblyline?
©2016CA.ALLRIGHTSRESERVED.
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AgileMeansEliminateBottlenecksandHandoffs
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CorePrinciplesUnderlyingDevOps
§ Flow(smallbatchsizes,eliminationofconstraints)
§ Feedback(fastdiscoveryofdefects,swarmingtoresolve)
§ ContinuousExperimentation(localdiscoveriessharedglobally)
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
HowFlowisAchievedinAgile
§ Manysmallteamsworkinginparallel
§ Teamsareselfcontainedtoavoidcostlyhandoffs
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhyOpen-SourcePerformanceTesting?
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhyOpenSourcePerformanceTesting?
§ Self-service,pain-driven,zerofrictionmodel– Justdownloadandstart– LearnonYouTube– SpinuponPublicCloud– Openmarketofshared
knowledge,plugins,designpatterns
Image:Hugecrowd
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhatDoesn’tComefor“Free”withOpen-Source
§ Provisioning
§ Reporting
§ Collaboration
§ TestManagement
§ Support
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
COE2.0:FacilitatingShiftLeft/Democratization
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Self-Service
§ WebUIforfaston-boarding,ad-hoctesting,richreportingandcollaboration
§ OpenAPIsandCLIsforfastautomation,integrationwithoutneedinga“plugin”
HandOutLogins,APIKeysandInterfaces,LetThemDotheRest
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Parallelize“Everything”
§ Compresstestcyclestominutes
§ Growcoveragewithoutaddingcycletime
§ Thebestqueueisaqueuewithjustonetestinit
TheEntireTestTakesOnlyasLongasTheSingleLongestComponent
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AmplifyOpen-Source,Don’tConstrainIt
Provideanexecutionenvironmentthatamplifies,ratherthanconstrainstheuseofopen-sourcetools
§ Scalability
§ Reporting
§ Collaboration
§ Integration
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
GettingStartedWithoutReinventingtheWheel
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DEMOCRATIZINGPERFORMANCETESTINGINTHECONTINUOUSDELIVERYERA
CABlazeMeterisanext-generation,SaaS andOn-Premise,continuousapplicationperformancetestingsolutiondesignedtohelpDevOpsandAgileteamsbeginweb,mobile,microservices,and
APItestingearlyintheSDLCandre-usethesetestsallthewaythroughtoproduction.
PureSaaS,NoSetup
100%Open-Source
Compatibility(“LoadandGo”)
Public Cloud,VirtualPrivateCloudand/orBehindTheFirewall
MassivelyScalable
– 2Million+virtualusers
PerformanceTest
OrchestrationusingTaurus
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD World®’16
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CABlazeMeter HasOnlyEverExistedInaDevOpsWorld
Source:https://www.google.com/trends
§ Interestin“DevOps”KeywordOverTime
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MustSeeDemos
Jmeter/SaaSPerformanceTestingCABlazeMeterDevOpsTheater5
TransformationwithDevOps
DevOpsSimDevOpsTheater5
MigratetoCATechnologies
CABlazeMeterDevOpsTheater5
ModernizeAppDelivery
CDIntegrationDevOpsTheater5
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Stayconnectedatcommunities.ca.com
Thankyou.
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DevOps– ContinuousDelivery
FormoreinformationonDevOps– ContinuousDelivery,pleasevisit:http://cainc.to/PiTFpu