market leading continuous testing and service ...published:15 november 2016 ibm strengths...
TRANSCRIPT
![Page 1: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/1.jpg)
1 |
Stuart FeaseyIBM Hybrid Cloud - Test and Virtualization Specialist
Market Leading Continuous Testing and Service Virtualization Capability for WebSphere
![Page 2: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/2.jpg)
2 |
Whatdoesanenterpriseenvironmentmeantoyou?
![Page 3: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/3.jpg)
3 |
Today’sRealityforTesters
28%ofTestersarenottesting50% (ormore) ofthetime!
40%ofTestersarenottestingatleast1dayper
week!
![Page 4: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/4.jpg)
4 |
MiddlewareChanges
4 InternalSoftwareUpgrades
§ Standardsbodyupdates
4 NewInitiatives
§ Regulatorychanges
4 VendorChanges
§ Stackupgrades/EOLdates
§ Fromonevendortoanother
4 Consolidation
§ CorporateM&A
![Page 5: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/5.jpg)
5 |
Today’sRealityforTesters
TesterswanttospendMORE time
TesterswanttospendLESS time
![Page 6: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/6.jpg)
6 |
TheRoleofTestingintheContextofDevOps
Top15challengesidentifiedafteranalysisofaround20IBMDevOpsworkshopreports:
• FlexibleenvironmentprovisioningrequiredbyDevOpsteams(67%)• ThereisalackofcollaborationbetweenBus,DevandOps(58%)• Thereisnocoordinationofthedeliveryenvironmentelements(e.g.aDevOpsCoE)(58%)• GovernancewhenapplyingDevOps(50%)• Deploymentsarelargelymanual(anderrorprone)(50%)• TherearenoorlimitedDevOps-specificmetricsinplace(50%)• Insufficientandinconsistenttestautomation(42%)• Testdatamanagement(42%)• Testingisnotperformedearlyusingcapabilitiessuchasservicevirtualisation (33%)• Thereisnointegratedtoolsarchitectureinplace(42%)• NoDevOpsvocabularyisinplace(33%)• NoDevOpsvisionorstrategyhasbeendefined(33%)• Missingorinconsistentmechanismsforgettingfeedback(33%)• ApplyingDevOpsinaregulatedenvironment(33%)
![Page 7: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/7.jpg)
7 |
Presentation layer
Integrations, data and business logic
Traditional UI testing:
Automated Integration Testing and Service Virtualization:
The majority of risk in modern systems is seldom tested as it is unseen.
![Page 8: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/8.jpg)
8 |
Shiftingleft;Testingsmarter
UNIT SERVICE UI
Automated Integration Testing
Service Virtualization
Traditional UI Tools
Development Testing Staging Production
![Page 9: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/9.jpg)
9 |
![Page 10: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/10.jpg)
10 |
Gartner - Magic Quadrant for Software Test AutomationPublished: 15 November 2016
IBM STRENGTHS•IBM's test automation tools can give many enterprises a jump-start in their continuous testing efforts. They are strongest as an integrated solution, delivering a combination of products and services.•IBM provides automated testing support for many technologies and applications, including legacy systems, client/server applications, packaged applications, and Web and mobile applications. It offers integration across the development and delivery life cycle.•IBM is well-positioned for cloud-based testing and advanced cognitive analysis to aid in adaptive testing and decision making.IBM CAUTIONS•IBM's portfolio is comprehensive and can be perceived as too complex, especially in the early stages of investing in test automation or for simpler testing needs.•While IBM provides a powerful portfolio, it is not optimized for nontechnical users and may require additional services to set up and implement.•IBM supports packaged application testing, but relies on partners for business process analysis and validation.
![Page 11: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/11.jpg)
HTTP(S)Web Services / RESTJSON / SwaggerXML (XSD, WSDL)SOAP
![Page 12: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/12.jpg)
JDBC
WASMQ
z/OS SI BUS
IIB
RR
HTTP(S)WebSphere MQJMS (multiple)RESTS/MIMEJava RMI (virtualization)JVM (virtualiazation)SAP IDOC, BAPI, RFC, XI 3.0Software AG’s IB & ISTCP/(S), IP, UDPCICS TGCICS IPICCICS DPLIMS ConnectTIBCO Rendezvous, Smart Sockets & EMSActive MQEmail (SMTP, IMAP)FilesFTP/S
Websphere Application ServerIBM Integration Bus (WSMB)Websphere MQWebsphere SI BusWebsphere RRUDDIWeb Services / RESTWSDL / WADL / SwaggerSystem z (CICS and IMS)Software AG IS, BrokerOracle FusionTIBCO ActiveMatrixDatabasesLog FilesCentraSiteSCA Domain
XML (XSD, WSDL, WADL)SOAPJSON / SwaggerCOBOL CopybookPL/1ASC X12UN/EDIFACTDFDLISO8583ISO20022Fixed WidthJava ObjectsAS2Software AG Broker Docs.Net ObjectsBytesSWIFTCHIPSFedWireFIXTIBCO ActiveEnterpriseCustom
![Page 13: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/13.jpg)
13 |
IBMDevOpsSolutionforContinuousTesting
Presentationlayer
Middleware,Data, Services
Systems of Recordcomponents
Functional Tester
Web UI Tester
Rational Test Workbench
Integration Tester
Rational Performance Test Server
Performance TesterRational Test
Virtualization Server
RPTonCloud
RPTVTPacks
![Page 14: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/14.jpg)
14 |
MiddlewareTestingChallenges
4 Whatisitthatneedstesting
§ Unknownsystemcomponents
§ Wherearethesystemendpoints
§ Variationfromdocuments
4 Whatmessagesarebeingexchanged
§ Goodsourceofdata
§ Mirrorrealliferatherthanhistory
4 Identifyingchanges
§ Helptargettesting
§ Optimizecreationofnewtestassets
![Page 15: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/15.jpg)
15 |
ContinuousTesting
Execute test assets in headless mode§ Regression test new code quickly§ Continuous test cycles§ Build / Deploy / Test / Virtialize / Report�
Integrate into new or existing process§ Urban Code Plugin§ ANT task integration with Jenkins, CruiseControl, Bamboo, etc§ Command line execution§ Native integrations RTC, RQM, HP QC etc
Integration Tester reports served through a web browser (via Control Panel)
15
![Page 16: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/16.jpg)
16 |
TopologyDiscovery
Clients
Web Services
Database
Mainframe
HTTP Proxy
JDBC Driver
CICS TG Exit
![Page 17: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/17.jpg)
17 |
Synchronization
![Page 18: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/18.jpg)
18 |
Buildingasystemmodelfromrecordedevents
Queue.A.Reply
Queue.A
Application servers
Clients Queue.B.Reply
Queue.B
Queue.C.Reply
Queue.C
![Page 19: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/19.jpg)
19 |
WebSphere
4 RationalIntegrationTestercansynchronizewith:
§ IBMIntegrationBus
§ WebSphereApplicationServer
§ WebSphereRegistryandRepository
4 Discover:
§ HTTPEndpoints,MQconnections,JMSproviders,WSDLs,Databases,CICSandIMSconnections
4 Import
§ DFDLschemas
§ WSDL,WADL,XSD,Swagger
§ Copybooks,ProtocolBufferDefinitions
§ FromAPIConnect,Z/os ConnectEnterpriseEdition
![Page 20: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/20.jpg)
20 |
SiftandpassthroughwithMQ
MQQueueManager
Queue
RealTestSystem
MQExit
Clientthatinitiatestransaction(orRIT)
MQExitisinstalledontheMQQueueManager.Directsinboundandoutboundtrafficforexecutionpurposes.
Stub
MQExitInterceptsmessagebeforeithitstheinboundqueue.
Ifstubisdown,thenMQExitdirectsmessagetoLivesystem.
Passthroughroute.
![Page 21: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/21.jpg)
21 |
TypicalScenariosEncountered
![Page 22: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/22.jpg)
22 |
BUSINESSWORKS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
MostOrchestrationEngineshavetheirownproprietaryruntime(unlikeJ2E)whichmeansmigrationbetweenvendorsisariskpropositionasdevelopmentisrequired.Testenvironmentsareexpensiveanditisextremelydifficulttofault-findinanenvironmentwithmanymovingparts
Scenario1:AMigrationChallenge
![Page 23: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/23.jpg)
23 |
IntegrationTestingandServiceVirtualizationcansignificantlyde-riskthemigrationandreducethetimerequired.
Development/testteamscanbuildagainstvirtualservicesandtestearlyandtestcontinuouslyusingmessagescapturedfromtherealsystems.Exception/edgecasetestingismucheasiertodo.
RITunderstandsawiderangeoftechnologiesandmessagingprotocols(includingDFDL)makingitwell-alignedtoIIBusers
Scenario1:FromTIBCOtoIIB
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
![Page 24: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/24.jpg)
24 |
Step1– Recordrealmessages(usingRITAgents)
Step2– Createtestsandvirtualservices
Step3– Enhancetestsandvirtualservicestoincludeedge/errorcases
Step4– Migrationteamusetests/servicestobuildIIBsolutionandgainconfidence
Step5– Swapvirtualservicesforrealtestenvironmentsoneatatimeandre-runtests
Step6– Endtoendtest(confidentoflessriskofexpensiveerrorsatthisstage)
Scenario1:Details
IBMINTEGRATIONBUS
SAPPI
CICS
DATABASE
APP SERVER
SWIFT/MQ
HL7/TCP
X12/SOAP
JSON/REST
![Page 25: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/25.jpg)
25 |
Scenario2:IncreasingBuild/DeliveryVelocity
4 FinancialServicesCompany
§ AModernEnterprise
4 Complexity
§ Business
§ Technology
§ Organization
4 Getnextversionofweb/mobileofferingstomarketASAP
4 Maintainqualitywhilstprogressingtowardscontinuousdelivery
![Page 26: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/26.jpg)
26 |
Scenario2:MeetthatChallengewithDevops Capabilities
4 Understandtheissuesandfindopportunitiestoimprove
4 Automate andsimplify toenablecontinuousintegration
§ Openinterfacestotesttools
• ANTscripting
• Comand line
• RESTinterface
• UrbanCode plugins
4 LeadingtoasmoothpathtoContinuousTestingandultimatelyContinuousDelivery
![Page 27: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/27.jpg)
27 |
Scenario2a:CICSRegionunavailable
4 AppdevelopmentandtestteamuseUItestinginRationalTestWorkbench
4 AccessesrecorddataandservicesthroughCICSviaTransactionGateway
4 Resourceconstraints- won’tbeavailablefor2weeks
4 DevelopmentteamuseServiceVirtualizationtosimplify
§ PrototypetheservicewithRationalTestVirtualizationServer
CICSTransactionGateway
TestAutomation
VirtualService
New
![Page 28: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/28.jpg)
28 |
Scenario2b:DependentProgramNotAvailable
4 Exposedfunctionalityinvokesprogramcross-LPARoverDPL
4 DevelopandunittestinisolationusingRationalDevelopmentandTestEnvironmentforSystemz
4 UseRationalTestWorkbench toautomatefunctional/regressiontests
4 BeforelinkedprogramavailableuseServiceVirtualizationtosandboxonmainframe
RationalDevelopment&Test(RD&T)
VirtualService
![Page 29: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/29.jpg)
29 |
Adoption
![Page 30: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/30.jpg)
30 |
Thejourney– continuousintegration
Successivepracticesbuildoneachother,witheachpracticeaddinggreaterandgreaterbusinessvalueandhavinggreaterscopeoverthesoftwaredevelopmentprocess.
• Instant feedback to developers on quality issues• Supports Agile development• Unit test automation & more• Pre-cursor to Continuous Delivery and DevOps
![Page 31: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/31.jpg)
31 |
Multiple technologySome Open Source
Provide Virtual
Services
TESTER
Continuous deployment to
test environments
OPS
API TestingPerformance Testing
UI Automation
TESTER
Design & Build
DEVELOPER
Shippingcodefasterwithouttestingmeansthatbadcodecanbeshippedfaster.TestingisanintegralpartofDevOps.
Usingservicevirtualizationincreasestheabilitytotestearly,whiletestautomationprovidesrapidfeedbackonthequalityofthesoftwarebeingshipped.
WithoutContinuousTesting,thereisnoDevOps
![Page 32: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/32.jpg)
32 |
Resources
ContinuousTestingondeveloperWorks athttps://developer.ibm.com/testing/ContinuousTesting:AnIBMpointofview:http://www.ibm.com/developerworks/library/d-continuous-testing-shift-left-trs/index.htmlDevOpsROI:https://developer.ibm.com/urbancode/docs/devops-managers-organization-leaders-making-roi-case-executives/TheForresterWaveModernApplicationFunctionalTestAutomationTools,Q42016:https://reprints.forrester.com/#/assets/2/581/'RES123866'/reportsGartnerMagicQuadrantforSoftwareTestAutomation:https://www.gartner.com/doc/reprints?id=1-3NWQQJB&ct=161214&st=sgGartnerMagicQuadrantforApplicationReleaseAutomation:https://www.gartner.com/doc/reprints?id=1-3FNG0BR&ct=160822&st=sg
![Page 33: Market Leading Continuous Testing and Service ...Published:15 November 2016 IBM STRENGTHS •IBM's test automation tools can give many enterprises a jump-start in their continuous](https://reader034.vdocuments.us/reader034/viewer/2022042307/5ed2e93d9e7a331a5e62bb4c/html5/thumbnails/33.jpg)
33 |
ThankYou