successful co-ordinaon of integraon tes1ng of global
TRANSCRIPT
SuccessfulCo-ordina1onofIntegra1onTes1ngofGlobalRetailProgram
across6Countries
PresentedBy:MichaelWeiner 1www.accuteque.com
Presenta1onOverview! Topicstoinclude
– Projectbackground– Geographyimplica1ons
– Func1onaloverviewofthesolu1ons– Tools/ar1facts– Communica1ons– DefectCo-ordinator– Planning– TestEnvironment(s)– RegressionTes1ng– Conclusion
11/20/16 www.accuteque.com 2
ProjectBackground! GlobalrolloutforERPandPOSpackages! CommonGlobalbusinessprocesses! Countyspecificlocalisa1ons(e.g.BankEFTPOSinterfaces,supplierordering/receip1ngetc)
! 24,000servicesta1onsin26countries.1400servicesta1onsinAUand298inNZ.
! Solu1ontosupport24x7Retailopera1ons
11/20/16 www.accuteque.com 3
Integra1onTes1ngScope! TestscopeincludedSystemIntegra1onTestandUATforERPandPOSandlocalapplica1ons
! Integra1onTestTeamlocatedinAU(peakof7)andIndia(upto6)
! Mul1pleReleasesoffunc1onalityover2years– Ini1alReleasetoAustralia(Globalpilot)– RegressionTestwhenimplementERPinUK– UK+AUReleaseinAU(includingsiteupgrades)– NewReleaseinNewZealandandUSAinparallel
11/20/16 www.accuteque.com 4
Timezoneimplica1ons! Difficulttoschedulemee1ngsinworkinghoursthatsuitmul1pleloca1ons
! Aderhourscallsveryfrequent(2-31mesperweekformanagementplusdefectmee1ngs)
! Needcommieedteamascri1cal“overnight”ac1vi1es(e.g.defectReleases)thatrequiremonitoringwillrequireaderhourswork
! Integratedtestscantakedaystocompletedependingonsystemarchitecture
11/20/16 www.accuteque.com 6
TestAr1facts! GlobalTestStrategy! TestApproachperRelease! UpdatedMasterCondi1onList(requirements)! MasterScheduleperRelease/TestPhase
! BatonSheet(intertestteamcommunica1on)! TestStatusFramework! Defectsin2tools(defectsperPackage)! HPQualityCenterexecu1on&results
11/20/16 www.accuteque.com 7
Requirements! OverallrequirementsframeworkdevelopedwithProcess“Chains”.Allrequirementsmappedtothese
! RequirementslistupdatedbyeachgeographicTestTeamfromsourcedocuments
! Challenges– Integratedrequirementsacrossapplica1ons
– LocaladjustmentstoGlobalrequirements– Managementofrequirementsmasterlist
11/20/16 www.accuteque.com 8
TestTools! HPQualityCentrewasavailableglobally.Companyinfrastructureissueshinderedacceptanceandproduc1vityasatestexecu1ontoolinspecificloca1ons.Alternateprocessesadopted.
! Dedicatedtestlabwithequipment/POStosimulatemul1pleservicesta1on“sites”
11/20/16 www.accuteque.com 9
RetailPOS
11/20/16 www.accuteque.com 10
EFTPOSMachine
ScannerTicketPrinter TouchScreen
ManualCardSwipingMachine CashDrawer
Touchscreen
11/20/16 www.accuteque.com 11
ThePOSTouchScreenisdividedintothefollowingareas:
Virtual Pumps
Virtual Ticket
Items
Item Groups
TestScheduling
! Testsdefinedandallocatedper“stream”(startofDay1)
! StatusupdateddailybyeachTestTeam! Contentsofthisautoma1callyupdatedstatuscharts
11/20/16 www.accuteque.com 13
BatonSheet! Newtermforproject–Athle1csanalogy
! Informa1onfromoneTestTeamwaspassed(baton)fromoneteamtoanother
! Contentsexample– Specificproductsandpricingandeffec1vedatesofpromo1onsasenteredinERPsystem
– SalesofitemsandtendersinPOS– Helpedtoprovidevisibilitytodatatoenableverifica1onofresults
11/20/16 www.accuteque.com 14
TestProgressRepor1ng
! Repor1ngframeworkautoma1callyproducedSchedulestatusbySystemProcessSequence
11/20/16 www.accuteque.com 15
TestProgressRepor1ng
11/20/16 www.accuteque.com 16
! Repor1ngframeworkautoma1callyproducedcomple1onstatus(Passed)byBusinessProcess
Communica1on
! Communica1onscanbedifficultonGlobalProjects
! Followingvideoclipgivesaninsight….
11/20/16 www.accuteque.com 17
Communica1on(cont.)
! Ourobserva1onsforsuccess:– Needtoconstantlyreviewandrefineapproaches– Mul1pleVendorswithdifferentprac1cesandtoolscaninfluencetestprac1ces
– Understandculturaldifferencesandimplica1onstoproject
– Establishrela1onships/buildrapport(arrangeonsitevisitsifpossible)
– Pa1ence–accent,culture,telephonevs.inperson
11/20/16 www.accuteque.com 19
Communica1on(cont.)! MSN–ausefulbusinesstool
! OngoingConferenceLines! GetadecentSpeakerPhone! Document“WaysofWorking”forallTestTeammembersacrossgeographies–roles,responsibili1es,commonstandardsandprocedures
11/20/16 www.accuteque.com 20
DefectCo-ordinatorrole! HighLevelJobDescrip1on:
– Defineandmanageconsistentprocess– Communicatefixpriori1estoteams– Constantfollow-upforfixes– Facilitateregulardefect/triageteammee1ngs– Strongpresence,personalityandpersistencetoinfluence/guideprocess
– Understandsupportteamresourcing&priori1es! Geography/loca1oncaninfluenceeffec1veness
11/20/16 www.accuteque.com 21
Planning! Planningtestexecu1onacrossteamscanbedifficult
! Personalleaveandpublicholidaysacrosscountriesmakeitevenharder
! FollowingslidesshowsPublicHolidaysforseveralmonthsforcountriesinvolved
! Understand“home”loca1onofpersonnel(commu1ng,holidays,conf.callsetc)
! TestManagers–factortheseintoschedules!!
11/20/16 www.accuteque.com 22
April2008
11/20/16 www.accuteque.com 23
FirstDayofPessah(Passover)
LastDayofPessah(Passover)
Israel
INDIA
DrBabaSahabJayan1+BengaliNewYr(Pune/Mumbai,Kolkaea)
MahavirJayan1(Pune/Mumbai)
AnnualClosingDay(Banglore)
ChandgramanaUgadi(Banglore)
NZ
ANZACDay
Australia
ANZACDay
Slovakia
UK
August2008
www.accuteque.com
SummerBankHoliday
IndependenceDay
ParsiNewYear(Pune/Mumbai)
SlovakUprisingDay
Israel
INDIA
NZ
Australia
Slovakia
UK
11/20/16 24
September2008
www.accuteque.com
RoshHashanah
GaneshChathuri(Pune/Mumbai/Banglore/Hyderabad
Cons1tu1onDay
LadyofSorrow’sDay
CloseofACC(Hyderabad/Banglore)
Israel
INDIA
NZ
Australia
Slovakia
UK
11/20/16 25
October2008
11/20/16 www.accuteque.com 26
RoshHashanah
YomKippur
FirstDayofSukkot
SimhatTorah
MahatmaGandhi’sBirthday(ALL)
Dussera(ALL)
Deewali(Pune/Mumbai,Hyderabad)
Bahubeej(Pune/Mumbai)
Deepavali(Banglore)
DurgaPuja-Saptami(Kolkata)
DurgaPuja-Astami(Kolkata/Hyderabad)
DurgaPuja-Nabami(Kolkata)
LaxmiPuja(Kolkata)
LabourDay
Israel
INDIA
NZ
Australia
Slovakia
UK
TestEnvironments! LocalTestEnvironment
– POSsolu1onmanagedlocallyinMelbourne,supportedbyLondon,Slovakia&Israel
– EFTsolu1onmanaged&supportedlocallyinMelbourne
– ERPsupportedbyLondon,Germany&India
– NZLoyaltysolu1onsupportedinMelbourne&NZ
11/20/16 www.accuteque.com 27
TestEnvironments! POSupdatesconsistedof:
– newvendorsodware– Updatedtechnicalconfigura1on– Sta1csitedata(e.g.name,numberofpumpsetc)
! POSupdatesdeliveredviaautomatedscriptsini1atedinSlovakia
! Errorsintransportscausedoutagesunabletobefixedun1loffshoreteamcameintowork
11/20/16 www.accuteque.com 28
TestEnvironments! Needlesstosay–environment&supportcomplex!!
! Understandconnec1vityrequirements,delivery1meframesandconstraints–planearlyandexpectproblems– DifferencesinTelcoinfrastructureacrosscountriescanaffectTes1ng
! Understanddataalignmentrequirementsacrosssystems
– Nothingnewbuthardertoarrangeinmul11mezoneandmul1-vendorenvironment
11/20/16 www.accuteque.com 29
RegressionTestStrategy! OneERPlandscape–onesetofsourceforallcountries.MaintainedbySIteam
! OnesetofPOSsodware–maintainedbyvendor.Configurableitemswerepercountryplussitedata.
! Changestosupportgeographicrolloutsposedrisktoeachcountyonsameplauorm
! RegressionTeststrategycri1cal-planforpersonnelifusemanualapproachorinvestinautoma1on.Decideapproachandplanaccordingly
11/20/16 www.accuteque.com 30
Conclusion! GlobalProjectsarechallenging! Tyrannyofdistanceaffects:
– Communica1onstoolsandmethods– Workinghours
– DefectManagement/co-ordinatorapproach
– NumberofPublicholidaysaffec1ngschedule
! Successrequires:– BuildingofRela1onshipsbetweenteams
– Understandingandrespec1ngotherculturesandbeliefs– Hardwork,flexibilityandpa1ence
11/20/16 www.accuteque.com 31