![Page 1: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/1.jpg)
Risk&PerformanceAssurance(RPA):DrivingQualityAssuranceandOpera?onsExcellence
October9,2015enova2onpartners.com
![Page 2: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/2.jpg)
PRIVILEGEDANDCONFIDENTIAL 1
Construc?onrisksandcostsareincreasingbutqualityandopera?onsperformanceremainsasignificantchallengeRisingcapitalbudgetsdrivingsignificantworkforceexpansion• Newconstruc2ongrowingrapidly• Acceleratedreplacementofleakpronepipe• 75%ofgascompaniesincreasingO&M• 30%reportturnoverincreasesabove10%
Accelera?ngworkforcere?rementserodingskills,knowledgeandexperience
Inspec?onprogramsheavilydependentonexpertopinionsandtradi?on• Complexconstruc2onprac2cesrequiresignificantexperienceandjudgment
• “Ins2tu2onalknowledge”ofhowtoeffec2velyinspectislimitedanddeclining
• Objec2ve,datadrivenstandardsforhowandhowmuchtoinspectincreasinglycri2cal
Newregula?onsandincreasingoversightandfines,increaseinspec?onneeds
6.640
1.2890.853
1.303
1.9891.8511.957
3.164
6.081
2000sUNK&Pre-1940s
1960s 2010s1970s1940s 1990s1980s1950s
Averagenumberofannualincidentsover2005-2013per10,000milesofonshoregastransmissionpipeby
decadeofpipeinstalla?on
Source:U.S.PHMSAdata,PipelineSafetyTrustanalysisasofMarch2015
Companiesmustnotonlydriveconstruc?onquality,complianceandopera?onsexcellence-butbeabletoproveit!
![Page 3: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/3.jpg)
PRIVILEGEDANDCONFIDENTIAL 2
• Structuredinspec?onprocessensuresfocusonkeyriskandqualityareas
• Provensta?s?csmethodsdriveinspec?onac?vityandfrequency
• Automatedinspec?ondocumenta?on,monitoringandrepor?ng–internal&external
• Tabletbasedinspec?onaids,referencesandconstruc?onmanuals
• Capturesgeocodeloca?on,photos,handwriTennotesandac?onitems
• Iden?fiesqualityandperformancechallengestoguidetraininganddevelopment
• Providescrewandcontractormanagementtools,analy?csandperformancedata
• Inspec?onprocessandstructureconfiguredtoeachcompany
• RequiresminimalITintegra?on,butenablesITintegra?onwhenandasdesired
• Rapidimplementa?onprocess–6weekstofielddeployment,10to12weekstotal
Enova?on,GTI,LocusViewand8gasu?li?esdevelopedRPAtoaddressconstruc?onquality,inspec?onandperformancechallenges
![Page 4: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/4.jpg)
PRIVILEGEDANDCONFIDENTIAL 3
RPAusestablet-basedfieldsoZwaretocollectdata,documentfindings/observa?onsandsupporttheinspec?onprocess
MobilefieldsoZware
WMSorscheduling
tool
RPA
Historicaldata
SMEinput
Cloud-based
collec?onandstorage
Compliancereports,trendsandanalysis
Samplingcalcula?ons
Sta?s?calanalysis
Inspec?onRequirements
Repor?ng&monitoring
Riskhistory,samplingalgorithmsandperformanceanaly?csdriveinspec?onac?vi?es,trendsandissueiden?fica?on,andrepor?ng
![Page 5: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/5.jpg)
PRIVILEGEDANDCONFIDENTIAL 4
Sta?s?callyvalidobserva?onsdriveinspec?onac?vity,frequencyandfocus,andenablequalitymonitoringandrepor?ng
Whattoobserve?
Howmanytosample?
Howareweperforming?
Whatcanweimprove?
• Priori2zekeyac2vi2estoobserve
• U2lizetechnology(mobilesoeware)toensureinspec2onprocessanddocumentresults
• Analyzecompliancefrequencyacrossmul2pledimensions
• Assesslevelofnon-compliance
• Detectpagernsinnon-complianceanddrilldownintospecificissues
• Testefficacyoftrainingandnewprocedures
• Applypreferredprobabilitydistribu2on(givenunderlyingprocess,jobpopula2onandcompliancelevels,etc.)
• Setconfidenceinterval,givendatasources’quality,andriskpolicy
![Page 6: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/6.jpg)
PRIVILEGEDANDCONFIDENTIAL 5
RPAisimplementedinthreephasestoaccelerate“?metovalue”
Configuration and Process Design
Software Tailoring Testing
Reporting and Analytics
Refinement
• Refine inspection process and requirements
• Configure inspection tasks and activities
• Define quality assurance targets and structure
• Format tablet data fields and inspector interface
• Define data model • Validate inspection fields
structure and tablet tools • Develop tablet
navigation framework • Train inspectors and
supervisors on tablet and revised processes
• Deploy tablet solution in the field
• Evaluate ease of use and statistical progress
• Customize reports to each audience
• Configure analytics and data tools
• Track performance and identify improvement actions
• Identify field documentation and support needs
![Page 7: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/7.jpg)
PRIVILEGEDANDCONFIDENTIAL 6
RPATabletdatacollec?on–ini?alinspec?onscreen
![Page 8: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/8.jpg)
PRIVILEGEDANDCONFIDENTIAL 7
Installa?onac?vityexample–acceptablemeterloca0ontask
![Page 9: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/9.jpg)
PRIVILEGEDANDCONFIDENTIAL 8
RPA’sfieldapplica?oncapturesphotos,geocodeloca?on,handwriTennotes/diagramsandac?onitems
RPAalsoprovidesaccesstoinspec?ontools,checklistsandopera?ngmanuals
![Page 10: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/10.jpg)
PRIVILEGEDANDCONFIDENTIAL 9
Inspec?onsamplesizeisdrivenbythenumberofjobs,non-compliancerate,andtargetedlevelofriskassurance
ActualClientExample–Construc0on95%confidencefor7kinstalla0ons
• Sta2s2csdefinesrequiredsamplesizeneededtoachievedesiredconfidencelevelincompliance
• Asoverallcomplianceratesincrease,thesamplesizemustalsoincrease
• Asthedesiredlevelofcomplianceassuranceincreases,therequiredsamplesizeincreases
• Asitturnsoutthenon-compliancerateismuchlower,andthustheconfidenceleveliscorrespondinglyhigher
• ThisexampleshowsthataConfidenceIntervalof95%assuringatleast85%compliancewouldrequireasamplesizeof207;observe207ofthetotalpopula2onof7,000jobs
RequiredSampleSize
DesiredConfidence
PercentCompliant
95 90 85 80 75 70
99 1459 2138 2801 3162 3493 3675
98 459 779 1051 1239 1428 1547
97 248 380 515 619 724 789
96 140 231 320 382 443 488
95 95 155 207 252 291 319
94 71 116 151 184 209 230
93 61 87 115 134 154 170
92 48 71 90 105 119 133
91 36 55 74 84 96 105
90 32 46 58 71 79 86
Observa?ons
![Page 11: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/11.jpg)
PRIVILEGEDANDCONFIDENTIAL 10
Sta?s?caltestsandanaly?csarealsousedtoensuredataintegrityandcomparabilityacrossinspec?onac?vi?es
Byobserver,foreman,geography,andcompany/contractor• Dosomeobserversgradeharder/more
lenientlythantheirpeers?• Dosomeforemen/contractorsperform
consistentlybelowtheirpeersononeormoreskillsortasks?
• Arethereregionalorseasonalpagerns?
Eliminate“outliers”orbiasByobserversandforemanorcontractor/company• Dosomeobserverstendtoinspectthe
sameforemen/contractorsmorethanwouldbe“expected”(i.e.,random)?
• Aretheresta2s2callysignificantpagernsinhowsomeobserversassessforemen/contractorsperformance?
Ensurerandomsample
• Sampleinspec2onsoncrewsshowingconsistentlydeficientperformancerela2vetopeersareisolatedtopreserveindependenceandsta2s2calvalidity
• Inisolatedareas,temporaryassignmentofalterna2veinspectorsanduseofdatafromconstruc2onsupervisorscanbeuseddetectandavoidbias
• Biasdetectedinobservergradingquicklyiden2fiedandcorrectedthroughmanagementinterven2on,training,etc.
Ifbiasisdetected,ac?onsaretakentopreservesta?s?calvalidity
![Page 12: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/12.jpg)
PRIVILEGEDANDCONFIDENTIAL 11
RPAReportsenablesmanagerstounderstandtherootcauseofqualityandnon-complianceissues,andtaketargetedac?on
![Page 13: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/13.jpg)
PRIVILEGEDANDCONFIDENTIAL 12
RPArepor?ngandanaly?csaretailoredtousers’needsandfocusesonqualityimprovementandopera?onsexcellence
Regulators&Execu?ves
• System-levelperformancemetricsforcri2caltasks,byImpactArea
• Progresstowardsamplesizes
Overallsystemperformance• PerformanceonkeytaskswithinSystemIntegrity• Assessmentofskillsaddressedthroughtraining
Audi?ngDivision
• Overalljobscores• Taskperformancebyauditor,contractor,crew
memberandforeman
Regulatorycomplianceandjob-levelperformance• Samplesizerequirementandprogress• PerformanceoftasksassociatedwithSystemIntegrity• Assessmentofskillstobeaddressedthroughtraining
Construc?onDivision
• Skill/taskproficiencybycontractor,company,foreman,andcrewmember
• Performancebyconstruc2on/ac2vitytype
Assessmentsofconstruc0onperformance• Comparisonofassessmentsperformedbyconstruc2on
supervisorsvs.auditorsvs.foremen• Testimpactofprograms,training,toolsmaterials
![Page 14: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/14.jpg)
PRIVILEGEDANDCONFIDENTIAL 13
Oct5 Oct12 Oct19 Oct26 Nov2 Nov9 Nov16 Nov23 Nov30 Dec7
1.Projectlaunch
2.BuildRequirementsdocument
3.Defineworkflowandsystemsinterac?ons
4.Buildtabletapplica?onanddatabase
5.Fieldtraining,rolloutandtes?ng
6.Definesta?s?calapproachandavailablehistoricdata
7.Definerepor?ngbyusergroup
8.Buildrepor?ngengine
9.FinalizePilotanddiscussnextsteps
Milestones
RPApilotscantypicallybeimplementedin10to12weeks,withtabletsdeployedwithin6weeks
Weekbeginning…
Inspec(onRequirements
Test,train&rollouttablets
Reviewpilotresults
Implementstandardrepor(ng
![Page 15: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/15.jpg)
PRIVILEGEDANDCONFIDENTIAL 14
RPAdrivesimprovedconstruc?onquality&produc?vity,increasesinspec?onperformance,andlowerssystemrisk;atlowercost
Opera?onsExcellence
Inspec?oneffec?veness
Riskmanagement
Qualityassurance
• Sta2s2calvalida2onofperformancelevelsandtrends• Automateddocumenta2onofdata,processes,findingsandanalysis• Sta2s2callysupportedevidenceofcompliance–regulators/insurers• Supportsimprovedcommunica2onwithregulators
• Structured,consistent,sta2s2callydriveninspec2onmanagement• Leverageinspec2ondataacrossorganiza2onalsilos• Improvesfieldinspec2oneffec2venessandproduc2vity• Providesrootcauseanalysisonqualitydeficiencies
• Inspec2oneffortsdrivenbyriskandperformanceissues• Systema2ctrackingandrapidtarge2ngofissues,problemsandgaps• Effec2veandefficientcontractor/crewperformancemonitoring• Real-2meinspec2onresultsprovidesvisibilityonissuesastheyoccur
• Robustmanagementofcontractorperformance• Rapiddevelopmentandtes2ngoftrainingeffec2veness• Transi2ons“tribalknowledge”into“ins2tu2onalknowledge”• Drivesculturalchangeacrossconstruc2onandqualityassurance
![Page 16: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/16.jpg)
PRIVILEGEDANDCONFIDENTIAL 15
Construc?on
LeakSurvey
Corrosion
CustomerService
LineLocate&DamagePreven?on
Regula?on
ValveInspec?on
RPAishighlyconfigurabletoeachcompany’sopera?onsandcanaddressesabroadrangeofinspec?onneedsbeyondconstruc?on
Applica?onAreas Benefits
• Riskandsta2s2csdriveinspec2onac2vity• Automatedinspec2onresultsdocumenta2on
• Detailedtrendandperformanceanalysis
• Timelycompliancemonitoringandrepor2ng
• Focusonkeyriskandperformancechallenges
• Datadrivencontractormanagementsupport
• Increasedinspectorproduc2vity(inspec2on2me)
• Improvedcrewqualityandproduc2vity
• Accelerateson-boardinganddevelopment
RPAwasdevelopedbythegasindustryforthegasindustrytodrivequalityandperformanceimprovementacrossopera?ons
![Page 17: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/17.jpg)
PRIVILEGEDANDCONFIDENTIAL 16
Foraddi?onalinforma?on:
EileenSiTeNortheastGasAssocia?onPhone:[email protected]:404-229-7601Email:[email protected]:630-862-4940Email:[email protected]
![Page 18: Risk & Performance Assurance (RPA) & Performance Assurance (RPA): ... 99 1459 2138 2801 3162 3493 3675 ... RPA was developed by the gas industry for the gas industry to drive quality](https://reader031.vdocuments.us/reader031/viewer/2022022009/5aef39897f8b9a8c308baa94/html5/thumbnails/18.jpg)
PRIVILEGEDANDCONFIDENTIAL 17
Energy+Innova2on=Results
Enovation Partners