geobase capability maturity modelproceedings.ndia.org/jsem2004/geobase/filler_lance.pdf · as of: i...
TRANSCRIPT
I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Pacific Air Forces
As of: 1
PACAF GeoBase CapabilityMaturity Model: Metrics for
Program SustainmentMSgt Lance FillerMr. Ben McMillan
HQ PACAF GIO
As of: 2I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Overview
BackgroundCapability Maturity ModelingTailoring the CMMi for PACAF GeoBaseCMMi in PracticeRoad Ahead
As of: 3I n t e g r i t y - S e r v i c e - E x c e l l e n c e
USAF GeoBase Program
USAF GeoBase FoundationsUSAF GeoBase Foundations
Strategic GeoBaseGarrison GeoBase
Syst
ems
Arch
itec
ture
Syst
ems
Arch
itec
ture
Syst
ems
Arch
itec
ture
Syst
ems
Arch
itec
ture
Fina
ncia
l Man
agem
ent
Fina
ncia
l Man
agem
ent
Polic
y, &
Gui
danc
ePo
licy
& G
uida
nce
Educ
atio
n &
Tra
inin
gEd
ucat
ion
& T
rain
ing
Peop
le &
Wor
kflo
wPe
ople
& W
orkf
low
Info
rmat
ion
Arc
hite
ctur
eIn
form
atio
n A
rchi
tect
ure
Info
rmat
ion
Arc
hite
ctur
eIn
form
atio
n A
rchi
tect
ureExpeditionary Site Mapping (GeoReach)
As of: 4I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Metrics through the years…
5
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsan/RHSOsan/RHSYokotaYokota611 ASG611 ASGCOBSCOBS
ImageImage BCOPBCOP DataData GeoBaseGeoBase
Not StartedNot Started StartedStarted CompleteComplete
GeoBase Status FY00GeoBase Status FY00
StratStrat PlanPlan
Web Web Enabled Enabled
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG
CIPCIP RIPRIPCMD CMD CtrCtr
(DCC/SRC)(DCC/SRC)
Not StartedNot Started StartedStarted CompleteComplete
IOCIOC
Garrison GeoBase Status30 Oct 02
As of: 7I n t e g r i t y - S e r v i c e - E x c e l l e n c e
PACAF GeoBase MetricsFY03
CE MDSRIP
99
02
99
02
99
00
00
01
01, 02
Photo
94%
90%
83%
90%
95%
90%
95%
100%
89%
CIP
Yokota
Osan
Misawa
Kunsan
Kadena
Hickam
Elmendorf
Eielson
Andersen
Other MDSInstallation
As of: 8I n t e g r i t y - S e r v i c e - E x c e l l e n c e
A better method wasneeded to evaluate our
program…
As of: 9I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Capability Maturity ModelIntegration (CMMi)
Developed by the Software Engineering Institute atCarnegie Mellon University
A capability maturity model is a reference of maturepractices in a specified discipline, used to assess a group’scapability to perform that disciplineProcess provides a constructive, high-level focus…
As opposed to a focus on peopleYour work force, on the average, is as “good” as it is trained to beWorking harder is not the answerWorking smarter, through process, is the answer
As opposed to a focus on technologyTechnology applied without a suitable roadmap will not result insignificant payoffTechnology provides the most benefit in the context of an appropriateprocess roadmap
Our discipline is GeoBaseOur process areas define our capabilities…
As of: 10I n t e g r i t y - S e r v i c e - E x c e l l e n c e
PACAF GeoBase Processes
PlanningCapability DevelopmentSustain CapabilityConfiguration ManagementCustomer ServiceOrganizational DevelopmentProject Monitoring and ControlMission Integration
As of: 11I n t e g r i t y - S e r v i c e - E x c e l l e n c e
GeoBase Process AreasPlanning
Strategic PlanStrategic Plan is current and accurately reflects the goals, objectives,and strategies planned for the time periodMilestones are clearly articulated, dates and OPRs assignedAnticipated requirements (e.g. sw maintenance) are clearly articulatedAnticipated requirements are reported to Flight Chief wheneverStrategic Plan is revised
Configuration Management PlanCM plan is current and accurately reflects the inventory of technology,data & personnel assets associated with GeoBaseProcesses for data collection, data maintenance, databaseadministration (e.g. backup), service delivery are clearly articulated
Capability DevelopmentData acquisitionData quality controlSystems engineering
As of: 12I n t e g r i t y - S e r v i c e - E x c e l l e n c e
GeoBase Process Areas (cont’d)
Sustain CapabilityProcess and maintain CIP
Required, if applicable, CIP layers are presentLayers have correct spatial referenceCorrect SDSFIE layer & attribute names are usedLayers (features) and required attributes are complete andcurrentAverage spatial accuracy is known and meets ASPRS
Process and maintain Regional Installation Picture(RIP)
Wing/CC has defined spatial extent of RIPADRG 1:50,000 TLM or USGS 1:24,000 DRG are presentIKONOS, QB imagery or other regional imagery, e.g. USGSDOQQ are presentSDSFIE nomenclature and appropriate metadata
As of: 13I n t e g r i t y - S e r v i c e - E x c e l l e n c e
GeoBase Process Areas (cont’d)
Sustain Capability(cont)Process and maintain raster resources
Raster coverage exists that was captured within thepast five years and has one-meter or less resolutionAn image catalog existsAn image mosaic exists
Process and maintain Mission Data Sets (MDS)Layers have correct spatial referenceCorrect SDSFIE layer & attribute names are usedLayers (features) and required attributes arecomplete and currentAverage spatial accuracy is known and meetsASPRS
As of: 14I n t e g r i t y - S e r v i c e - E x c e l l e n c e
GeoBase Process Areas (cont’d)
Configuration ManagementThe practices outlined in the Configuration ManagementPlan are properly executedGeoBase architectures (data and systems) are effectivelymanaged
Customer ServiceHard copy maps available to key personnelMDS available to key mission elementsGeoBase client solutions
Viewers (ArcIMS, ArcReader, ArcGIS)Analysis (GeoBest, CAPP, GeoBase Toolkit)
Geospatial supportOrganizational Development
Personnel know rolesTraining programs exist
As of: 15I n t e g r i t y - S e r v i c e - E x c e l l e n c e
GeoBase Process Areas (cont’d)
Project Monitoring and ControlReview milestones in Strategic PlanExecute reporting requirements
Mission IntegrationSenior leader awarenessSenior leader advocacy
As of: 16I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Capability Score
Points assessed for meeting requirements in each processarea
Percentages calculated for each process areaFor Sustaining Capability, scores are normalized to allow forthe growth of data requirements
Individual percentages for CIP, RIP, Raster, and MDSThese percentages are averaged to provide process area score
As of: 17I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Capability Score (cont’d)
Weights assigned by PACAF GIO used to calculatefinal score
As of: 18I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Maturity Model in Practice
Structured AssessmentsStaff Assistance Visit (SAV)
Focus discussionsEasily pinpoint areas of improvementQuantifiable results to provide senior leadership
Installations required to self-assess each quarterResults provided to HQ PACAF GIOContinuous reference for program growth andimprovement
As of: 19I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Lessons Learned
Pro’sModel can change as program changesNormalized values effectively diagnose change, evenas requirements growEasier for HQ to target improvement areasProvides very graphic status snapshots forcommanders
Con’sSome questions are still subjective and may beinterpreted differently at each baseAnswers subject to attitude, time, effortDistilling diverse program elements into processareas can be problematic
As of: 20I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Road AheadUpdates to Model
Inclusion of MDS defined by FOA’sExpansion of AF data model to include EKBConfiguration requirements for enterprise databasemanagementConfiguration requirements for IMS managementEvaluating customer service
Difficult to gauge, many criteria involvedCIP is available to everyone through IMSNot everyone has MDSDifferent customers served at every baseHow to rate custom service solutions
Incorporate ideas from other sources includingProject Management Institute (Risk Management)
As of: 21I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Questions?
HQ PACAF Geo Integration [email protected]
MSgt Lance S. FillerDSN 448-0403
Ben McMillanDSN 449-7452
As of: 22I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Backup Slides
As of: 23I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Defining Initial OperatingCapability (IOC) seems simple…
PACAF GeoBase IOC components:Strategic PlanCommon Installation Picture (CIP)Geo Integration Office (GIO)Hardware/Software
As of: 24I n t e g r i t y - S e r v i c e - E x c e l l e n c e
…measuring it is something else
Strategic PlanAligned with HHQ guidance?Endorsed by senior leadership?Actively followed and updated?
CIPLayers present or absent?Format meets PACAF CIP spec?Layers complete (features and attributes)?Metadata complete?How do you define complete?Accuracy assessment?
GIOMilitary participation and oversight?Dedicated or additional duty?
HW/SWOptimal mix of CIP Production & maintenance equipment?Will base fund refresh?
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsan/RHSOsan/RHSYokotaYokota611 ASG611 ASGCOBSCOBS
ImageImage BCOPBCOP DataData GeoBaseGeoBase
Not StartedNot Started StartedStarted CompleteComplete
GeoBase Status FY00GeoBase Status FY00
Strat PlanStrat Plan
FundedFunded
As of: 5I n t e g r i t y - S e r v i c e - E x c e l l e n c e
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG
Not StartedNot Started StartedStarted CompleteComplete
CIPCIP ArchitectureArchitecture ManningManning IOC IOC StratStrat PlanPlan
PACAF GeoBase Status1 Jan 01
As of: 6I n t e g r i t y - S e r v i c e - E x c e l l e n c e
IOC IOC
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG
CIPCIP ArchitectureArchitecture ManningManning
Not StartedNot Started StartedStarted CompleteComplete
StratStrat PlanPlan
PACAF GeoBase Status29 May 02
ECDECD
-- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- --TBDTBD
1 Sep 021 Sep 02
As of: 28I n t e g r i t y - S e r v i c e - E x c e l l e n c e
But are we really measuringcapability?
PACAF GeoBase IOC components:Strategic PlanCIPGIOHW/SW
Even with a recipe to organize them, ingredientsdon’t equal capabilitiesPACAF GeoBase IOC capabilities
Develop and administer CIP/RIPHost MDSGeoBase Service AssuranceTraining & Technology Transfer
Web Web Enabled Enabled
AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG
CIPCIP RIPRIPCMD CMD CtrCtr
(DCC/SRC)(DCC/SRC)
Not StartedNot Started StartedStarted CompleteComplete
IOCIOC
Garrison GeoBase Status30 Oct 02
As of: 30I n t e g r i t y - S e r v i c e - E x c e l l e n c e
Relating Process Area Capabilityand Organizational Maturity
Process area capability and organizational maturityare similar conceptsThe difference between them is that process areacapability deals with a set of processes relating to asingle process area or specific practice, whileorganizational maturity pertains to a set of processareas across an organization
6CMMI Tutorial Apr 22, 2003
Why Focus on Process?
• Process provides a constructive, high-leverage focus...–as opposed to a focus on people
»Your work force, on the average, is as “good” as it is trained to be.
»Working harder is not the answer.»Working smarter, through process, is the
answer.–as opposed to a focus on technology
»Technology applied without a suitable roadmap will not result in significant payoff.
»Technology provides the most benefit in the context of an appropriate process roadmap.
14CMMI Tutorial Apr 22, 2003
What is a CMM?
• Capability Maturity Model: A reference model of mature practices in a specified discipline, used to assess a group’s capability to perform that discipline
• CMMs differ by–Discipline (software, systems, acquisition, etc.)–Structure (staged versus continuous)–How Maturity is Defined (process improvement path)–How Capability is Defined (institutionalization)
• “Capability Maturity Model®” and CMM® are used by the Software Engineering Institute (SEI) to denote a particular class of maturity modelsCapability Ma turity Mode l®, CMM®, CMM Integra tion, and CMMI a re se rvice marks and regis te red trademarks of Carnegie Me llon Univers ity
54CMMI Tutorial Apr 22, 2003
Capability Levels
• A capability level is a well-defined evolutionary plateau describing the capability of a process area.
• There are six capability levels.• Each level is a layer in the foundation for
continuous process improvement.• Thus, capability levels are cumulative, i.e., a
higher capability level includes the attributes of the lower levels.
55CMMI Tutorial Apr 22, 2003
The Capability Levels
5 Optimizing
4 Quantitatively Managed
3 Defined
2 Managed
1 Performed
0 Incomplete