Download - Advanced DBA – High Availability for Data
World®’16
AdvancedDBA– HighAvailabilityforDataKevinShumaVP,ProductManagementCATechnologies
MAINFRAMEANDWORKLOADAUTOMATION
MFX65E
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
ThissessiondescribestheavailableoptionsforsitesthatneedtokeeptheirCADatacomdatauseraccessibleforextendedperiodsoftime.Thisincludefunctionalitytoreorganize,compressandmovedatawithoutinterruptinguseraccess.
ThissessionwillprimarilycoverthenewfeaturesavailableintheCADatacom®/DButilityprocessingthatallowsuserstocontinuetoaccessdatatableswhiletheDBAisperformingneededdatabasemanagementactivities.
KevinShuma
CATechnologiesVP,ProductManagement
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
WHATISHIGH-AVAILABILITYFORDATA?
FUNCTIONALITYAVAILABLETOKEEPDATAAVAILABLE
CURRENTLYPLANNEDFUNCTIONALITY
SUMMARY
1
2
3
4
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Whatishigh-availability?
“Highavailabilityisacharacteristicofasystem,whichaimstoensureanagreedlevelofoperationalperformance,usuallyuptime,forahigherthannormalperiod.”
“Ifausercannotaccessthesystem,itis- fromtheuserspointofview– unavailable.Generally,thetermdowntimeisusedtorefertoperiodswhenasystemisunavailable.”
AccordingtoWikipedia
24x7
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Whatishigh-availabilityfordata?
§ Theabilityforuserstoaccesstheirdata(tables)anytimetheDatacomenvironment(MUF)isup– Donotinterruptuserdataaccessfor
§ Datasetexpansions§ Datareorganizations§ Indexreorganizations(defragmentation)§ Indexchanges(addingordeletingkeydefinitions)§ Changingcompressionalgorithms§ DASDrestructuringanddatarowrestructuring§ JustabouteverythingaDBA“does”tomanagethesystem
FromaCADatacomperspective
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Functionalityavailabletokeepdataavailable
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetexpansions
§ CADatacomsupportsmultiplewaystoexpanddataandindexareaswithoutanoutage– Dynamicextend(dictionaryattributes)
§ Canbeupdatedtoexistingdatabasedefinitions§ ProvidestheMUFtheabilitytotriggerarequestforanewextentwhenthecurrentextent(s)arefull
– Ondemandextend§ ConsolecommandthattriggersaMUFtorequestanewextent
– CanbeplacedinaDBUTLTYbatchjob
§ Doesnotrequiredynamicextendtobeturnedon
Weneedourdataandindexareastoexpand(fornewentries)withoutanoutage
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetexpansions- OnlineAreaMoveprocess
§ DeliveredinV14.01
§ Usedforcaseswhereoriginaldataset(indexorarea)nolongermeetsthecurrentneed
§ Extentstoosmall– maximumnumberofdynamicextendsbeingreached§ Notenoughvolumesallocated– canonlyextendonallocatedvolumes§ Needtomovetoanewer,larger,fasterDASDdevice§ Sitesdoesnotwantdatasetswithmultipleextentstoremainforlongerperiods
§ Otherneeds
Weneedourdataandindexareastoexpand(fornewentries)withoutanoutage
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetexpansions- OnlineAreaMoveprocess(cont’d)
§ DefineandPREINIT(DBUTLTY)new“.new”targetdataset– Createwiththe“new”requirementsforextentsandvolumes– Sameblocksizeassource
§ WhenreadyissueaconsolecommandtodoONLINE_AREA_MOVE– Opens“.new”datasettoMUF– EstablishesanIOdirectortomanagewhichdatasethascurrentblock– Beginscopyblockforblockfromolddatasetto.new– WhendoneusesanI/Ogatetopausethesystem
§ Scratchorrenamecurrenttooldandrename“.new”tocurrent
Weneedourdataandindexareastoexpand(fornewentries)withoutanoutage
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations
§ Determineifareorganizationisneeded– Datarowreuseallowsspaceindatasetstobereused
§ Defaultre-useisrandom(DSOP=1)§ Newdatarowsbeingaddedmaybeplacedoutof(nativekey)sequence§ Withcompressionormulti-tableareassomefragmentationoffreespaceinthedatablocksmayoccur
– Withgoodbufferingand/orMRDFalotofthedis-organizationishidden
– Manyreorganizationsaredonewithoutrealneed§ Don’timproveperformanceoraffectfragmentation
Weneedourdataputbackintonativesequence(forbatchperformance)
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ Usingthehistorydatabase(DBID1007)todetermineif– Thereissignificantsequential(nativekey)processing
Weneedourdataputbackintonativesequence(forbatchperformance)
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ Usingthehistorydatabase(DBID1007)todetermineif– Thereissignificantreductioninsequentialefficiency
Weneedourdataputbackintonativesequence(forbatchperformance)
Re-orgdoesnotimproveefficiency
Re-orgimprovesefficiency
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ UsingtheDBUTLTYDATANEreporttodetermineifthedataisoutofsequence
Weneedourdataputbackintonativesequence(forbatchperformance)
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ UsingtheDBUTLTYDATASPreporttodetermineifthedatablockshavealotoffragmentedspace
Weneedourdataputbackintonativesequence(forbatchperformance)
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ OfflineReorg(causesanoutage)– DBULTYBACKUP(SEQ=Native),INIT,LOAD– DBUTLTYREORG(parallelreorg)– AREAcontrolscanbeusedtodojustoneareaofadatabase
§ OnlineReorg– TriggeredbyDBUTLTY,butrunsinMUF(availableforzIIP)– Allowsuserstocontinuetoaccessdata– Movesrowswithintheexistingdataarea– Someindexspacewillbeused(MovedRecordIndex)– Fullyrecoverable/restart-able
Choosingtherightmethod
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Datasetreorganizations(cont’d)
§ OnlineReorg(cont’d)– DBUTLTYOLREORGREFGROUP=nn(greaterthanzero)
§ Reorganizesbymovingrowsfromoneblocktoanother§ Makessequence“better”
– DBUTLTYOLREORGREFGROUP=0(RequiresDSOP4or5)§ Reorganizesbymovingrowsinordertoemptyblocks§ Requiresapercentageofempty(notin-use)blocks§ Allnewblocksarefullyloaded§ Typicallyresultsinsmallerwellorganizeddatatable
Choosingtherightmethod
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexreorganizations(defragmentation)
§ OfflineRETIX(causesanoutage)– DBULTYINITandRETIXoftheindex– AREAcontrolscanbeusedtodojustoneareofadatabase
§ OnlineDEFRAG– TriggeredbyDBUTLTY,butrunsinMUF(availableforzIIP)– Allowsuserstocontinuetoaccessdata– Defragments/combinesDXX(low-level)ofindex– Reducesin-useblocks,improvesperformance– Fullyrecoverable/restart-able– Doesnotreduce“levels”
Choosingtherightmethod
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexreorganizations(defragmentation)(cont’d)
§ OnlineDEFRAG(cont’d)– Lowcost,runsinMUF– Compressesindexes(reducesin-useblocks)– Improvedperformanceofbuffers
Useitfreely
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexchanges(addingordeletingkeydefinitions)
§ PriortoV15– OnlyonlineabilityisthroughSQLALTERtable
§ Causessignificantdatarow“lock”iflargenumberofrows§ Notrecommendedforproduction
§ DeliveredinV15– Onlinefunctionality
§ Abilitytoremoveakey§ Abilitytoaddakey
Addorremovingindexesfromexistingtableswhileprocessing
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexchanges(cont’d)
§ Removingakey– Logicallydeleteakey(index)foratable
§ Internalindexstillmaintainedwhenrowsaddedordeleted§ Canbere-instatedifusersdetectthatthekeywasneeded
– Physicallydeleteakey(index)foratable§ Locksinlogicaldelete§ Removesindexentriesfromtheindexarea(IXXorInn)
– Spaceavailableforotherindexestouse
Removingindexesfromanexistingtablewhileprocessing
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexchanges(cont’d)
§ Addinganewkey(index)foratable– AddskeytoDirectoryCXX– Keyenabledtomaintenancecommands– Internaltaskstartedtoreadallrows,addnewindex
§ Whencompletekeyismadeavailable– Canbeaddedintoindex–
§ IXXarea§ ExistingInn area(multi-datasetindex)§ BrandnewInn area(multi-datasetindex)
Addingindexestoanexistingtablewhileprocessing
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Indexchanges(cont’d)
§ Swapwhereakey(index)resides– Addaparallelkeytoonebeingusedin
IXXorInn– Swapusageforuserapplicationsfrom
oldtonew– Deleteoldkeyandreclaimspace– LesslevelsreducesI/O– AllowsCOVEREDtobemuchmore
effective§ CoverthespecifickeyIDsthataremost
‘timecritical’
Movingindexeswithinanexistingtablewhileprocessing
Multi-datasetindex
IXX
I01
I01
IXX
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Changingtablecompression
§ Datarowcompressioncanbeusedto– Reducedatarowfootprint(saveDASD)– Improvebuffer,memoryandzIIPutilization– Makedataless“readable”byexternalviewers
§ TSO,DITTO,SORT,etc.
§ OnlineCompress(TA24)– AllowstheDBAtoadd/remove/changecompression
specificationswithoutinterruptinguserdataaccess– FullsessionatCAW2016discussingthisnewcapability
AllowingtheDBAtochangecompressionwithoutadataaccessoutage
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
OtherchangesinV15
§ MUFRESTARTinparallel,muchfaster
§ DynamicanddirectedextendVIRTUALbasearea– IncludestheCBSindex– IncludestheTTMindex
§ ExtendthelogareaLXX
§ ExtendtheDirectoryCXX
§ UniqueRowIdentifier(URI)reuse
RemovingMUFoutagesthataffectuserdataaccess
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Currentlyplannedfunctionality
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
UnderConsideration
§ ONLINE_AREA_RELEASE– Freeunused/neverusedspaceatbackofdataset
§ Dataareaonly– Inasecondcanreleasespacebacktosystem
§ PastMaximumusedblocks§ PastHighUsedBlock§ GoodforareasthatwereoversizedatINIT
Itemsthatareinthecurrentbacklogofnewfunctionality
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
UnderConsideration(cont’d)
§ ONLINEBlockSizeAlter(Pre-initializeanewdataarea– PartONLINE_AREA_MOVE,PartOLREORG
§ Pre-initializeanewdataarea– “Right-sized”extents
§ Differentblocksize§ Datadictionarydriven§ Movesrowsbynativekeytonewarea
– AnyADDITduringalsogoestocurrentblocksonotinorder
§ Whendoneoldareascratched,newarearenamed
Itemsthatareinthecurrentbacklogofnewfunctionality
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
UnderConsideration(cont’d)
§ ONLINE_TABLE_MOVE– PartONLINE_AREA_MOVEandpartOLREORG
§ Pre-initializeanewdataarea– “Right-sized”extents
§ Imagineoldarea1000cylindersbutcurrently1recordonlasttrack
– Newareacanbe2tracksandwillrunveryfast
§ Movesrowsbynativekeytonewarea– AnyADDITduringalsogoestocurrentblocksonotinorder
§ Whendoneoldareascratched,newarearenamed
Itemsthatareinthecurrentbacklogofnewfunctionality
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SummaryAFewWordstoReview
ExperiencesOnesitehasusedthesenewfunctionstokeeptheiruserdataavailable24x7forover4years.
KeyTopicsIntoday’sworld,user’sdatamustbeaccessible24x7
FindingsCADatacomcontinuestodelivernewfunctionalitythatallowstheDBAtoperformneededactivitieswithoutinterruptinguseraccess.
@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.30 @CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.30
MainframeandWorkloadAutomation
FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI
31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessionsSESSION# TITLE DATE/TIME
MFX92S StrategyandVisionforCADatacomandCAIdeal 11/16/2016at12:45pm
MFX93S What’snewinCADatacom 11/16/2016at1:45pm
MFX94S ReducingTCOwithDatacomCompression(Presspack) 11/16/2016at3:00pm
MFX95SA ModernizingtheCADatacomdata – SQLAccessPartI 11/16/2016at3:45pm
MFX95SB ModernizingtheCADatacomdata – SQLAccessPartII 11/16/2016at4:30pm
MFX96S CADatacom/ADInstallation/UpgradeandMaintenance 11/17/2016at12:45pm
MFX97S CADatacom/ADReportUtilization,andinformationgatherforSupport 11/17/2016at1:45pm
MFX98SUsingSysview tomonitorandmeasureyourCADatacomenvironment– ADandDB
11/17/2016at3:00pm
MFX99S BirdsofaFeather/StumptheTechie! 11/17/2016at3:45pm
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation