transforming the world through quality trissential... · 2017. 12. 14. · §enterprise frameworks...
TRANSCRIPT
sqs.com
TransformingtheWorldThroughQuality
Agenda
§ HowDidWeGetHere?§ TheFundamentals§ Approach(BestPractice)§ TheTechnology§ MeasuringSuccess§ Q&A
2©SQSUSAInc.|Dec 2017|
TraditionalApproaches
DigitalDisruption
Lean/AgileConcepts
ContinuousQuality
3©2017TrissentialLLC– AnentityofSQSGroup|
MC/DCMCCMBDDHFWaterfall
IoTMobileSocialCloudBigData
ContinuousImprovementBusinessValueUXSpeed
ShiftLeftEmbeddedQATotalQualityEngineering
DigitalTechnologyTransformation
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
The Fundamentals
5
TDD
BDDATDD
BART
TestDrivenDevelopment
BehaviorDrivenDevelopmentAcceptance
TestDrivenDevelopment
BusinessAgilitythroughRisk-basedTesting
©SQSUSAInc.|Dec 2017|
GoldenCirclesofAgileQuality
6
-PrioritizeRiskAreas-DefinetheRiskTolerance-FititintoSprints-ReportonRisks
UnderstandingYourRiskisImportant
-EasilyIdentifyWhattoTest-DecideHowMuchtoTest-UnderstandWhentoTest-ActiveMitigation(Anticipate)-CollaborateonResolution
©SQSUSAInc.|Dec 2017|
QualityEssentials
7
§ ProductQuality(ISO25010+ISO16085)o 31QualityAttributesThatRequireaStrategyo MostOrganizationsareFocusedonFunctionalStability(3of31)o OurFocusisonEnablementoftheQualityOrganizationo MostOrganizationsareLinearinTheirTestingApproacho WeAssessRiskinOrdertoDeliverBusinessValueo ShiftLeftisaMind-set
§ QualityinUse(ISO25010):o Effectivenesso Efficiencyo Satisfaction(Usefulness,Trust,Comfort,Pleasure)o FreedomfromRisk(Economic,Safety,Environmental,Competitive)o ContextCoverage(Completeness,Flexibility)o Real/SimulatedUse(Real-WorldE2E)
§ DataQuality(ISO25012):o 15QualityAttributesThatRequireaStrategyo DataatRest,DatainMotion,HighlyAvailable,Confidential,Accurateo DataCreatedinReal-Time(DataasaService– DaaS)o EasilyReplicated,Utilized,andCleanedupo ExponentialTestCoveragewithMinimalAdditionalWork
©SQSUSAInc.|Dec 2017|
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Agile Quality Approach
9
Pre-planning
• QAchecksstoriesofNextSprint –FeatureFiles
• QAchecksstoriesofNextSprint -Automation
• QAchecksstoriesofNextSprint -AcceptanceCriteria
GroomingSessions
•WhatdoIneed:•Technology(Sean/Chad)•TestData(BSAs)•E2E(Team)
•Strategy:•How•Highlevelestimate
SprintPlanning
•Story•ExplainStrategy•DetailEstimate•RiskAssessment•Questions
Shift-LeftPlanning
DoingtheworkpriortotheSprintisjustasimportantasdoingtheSprintactivities.Thesepre-SprintactivitieshelpQAachievehighershift-leftvalue.
©SQSUSAInc.|Dec 2017|
10
Pre-Sprint
•RiskRecommendation•GroomingfutureSprintwork
SprintPlanning(Day1)
•RiskAcceptance•TestStrategy•TestPrep•GroomingfutureSprintwork
TestPrep&Run(Day2-4)
•AutomationScripting•TestData•FeatureTesting•Functional/RegressionPrioritization•SmokeTestingExecution(CI)
TestExecution(Day5-7)
•SmokeTesting•AutomatedTesting•FeatureTesting•Functional/RegressionTesting•DefectManagement•QASign-off(Story)•AcceptFeature•StatusReporting
SprintCompletion(Day8-10)
•FeatureTesting•End-to-endTesting•PerformanceTesting•DefectManagement•UAT•Demo•Sign-off(Sprint)•Retrospective
QATimeline
Withourguidance,clientsareabletoalignthetestingeffortwithinthesamesprintasthedevelopmentteam.Thisapproachsupportsspeedandagility,andenablesthepotential“shiftleft”valueofagile/Scrum.
©SQSUSAInc.|Dec 2017|
11
Analyst(Any)
• Story• TestData• Functional/RegressionPrioritization
• FeatureTesting
• Transparency,updatestosprintgoals
Shared
• RiskRecommendation• BacklogMaintenance• RiskAcceptance• TestStrategy• DefinitionofReady• DefinitionofDone• Sizing• DefectManagement• CommitmenttoSprintgoals
• End-to-endTesting• QASign-off(Story)• Demo• Retrospective
Engineer(Any)
• AutomationScripting• SmokeTesting• AutomatedTesting• Functional/RegressionTesting
• PerformanceTesting• Alignmenttoarchitecture
SharedQAResponsibility
©SQSUSAInc.|Dec 2017|
ThePowerofWorkflows
12
WorkflowA
Transaction1b
UI/UX
DataManagement
Integration
Risk
Transaction2b
UI/UX
DataManagement
Integration
Risk
Transaction3b
UI/UX
DataManagement
Integration
Risk
Transaction1a
UI/UX
DataManagement
Integration
Risk
Transaction2a
UI/UX
DataManagement
Integration
Risk
Transaction3a
UI/UX
DataManagement
Integration
Risk
©SQSUSAInc.|Dec 2017|
PairedTesting
Who:§ Analyst– SME§ SDET– Technicalsolutions
What:§ Knowledgetransfer§ Peerreviews§ Testcasedesignsessions
Why:§ Morecompletetechnicalsolutions§ Bettertotalquality§ Collaboration
How:§ Onehouraday,everyday§ Rotatethefocus§ Keepalog
BestPractices:§ RotatepartnerseveryotherSprint§ Communicationshouldbedialogues§ Becustomer-driven§ Thinkoperationally§ Createacommunityofpracticeforum
§ Encourage“natural”synergies
13©SQSUSAInc.|Dec 2017|
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Technology
15
§ Vision&Strategy§QualityasaService§ BestPractices§ EnterpriseFrameworks§QualityinUse§ DataasaService§ AnalyticsServices(Metrics)§ Innovation(AI,MBL,BI)§ PredictiveQuality§ DevOps§ ToolsConsolidation
UtilizingIntelligentTestArchitectureUnderstandingNeeds,BuildingStrategies,andPragmaticallyExecuting
CORE COMPONENTS
LIBRARIES
CI\O
rche
stra
tion
WEB
SCM
IDE\
Lang
uage
\Too
ls
PACKAGEMANAGER
FRAMEWORK
CHROME FIREFOXIE SAFARI
EXECUTION
©SQSUSAInc.|Dec 2017|
EnterpriseAutomationFramework
16
CORE CLIENT LIBRARIES EXECUTION
API BDD
OPTIONAL
CORE CLIENT LIBRARIES EXECUTION
DesktopDatabase
APICORE CLIENT LIBRARIES EXECUTIONMOBILE
©SQSUSAInc.|Dec 2017|
Pleasecopyaslidewithasuitablepicturefromthefile„TitleSlides_EN.pptx“(changetopresentationmodetodownload)
andpasteithere.Ifnecessary,applythecorrectformattingbyright-clickingandchoosing“Layoutà TitleSlide“.
Measuring Success
TheQualityMission
1000
1700
020040060080010001200140016001800
Distributionofthe2,700errorswithEED
135 135
675
1080
675
0200400600800100012001400
Distributionofthe2,700errorswithoutEED
Costsfordetecting2,700errors: $314,040
Analysis: 1000x112.20x1= $112,200
Design: 1,700x112.20x4= $762,960
Total $1,189,200
Analysis: 135x112.20x1= $15,147Design: 135x112.20x4= $60,588Implementation: 675x112.20x12= $908,820Acceptance: 1080x112.20x48= $5,816,448Deployment: (675x112.20x90)/4= $1,704,038Total $8,505,041
§ HeavyrelianceonUATisthemostexpensiveandinefficientstrategyfortesting.§ Realcostishiddenwhensupportcostsaresplitfrombuildcostsandtestinglateinlifecycleisseenas“businessasusual”
§ TestingconsistencyisanacceleratorforEEDandautomationisthekeydriverforconsistency18
TypicalPractice BestPractice
©SQSUSAInc|Nov2017|
MeasuringSuccess
19
CostofQualityisnotjustaboutthemoneysaved,itisalsoaboutwhereitissavedandwhatitenabledbythesavings
©SQSUSAInc.|Dec 2017|
MeasuringSuccess
QualitythroughputisjustasimportantasCostofQualitybecauseifyourenterpriseautomationframeworkdoesn’tenableyoutoincreasethroughputthenyouhaven’tbeensuccessful.
20©SQSUSAInc.|Dec 2017|
MeasuringSuccess
Makingsureyourenterpriseautomationframeworkenables“shiftleft”byyourQAteamsisalsoimportanttotrack.Keepinganeyeonwheredefectsarediscoveredisagreatindicatorofshiftleft.
21©SQSUSAInc.|Dec 2017|
Thank you for your attention