performance management with rational insight and …. ibm software group ... manual data customer...
TRANSCRIPT
®
IBM Software Group
© 2009 IBM CorporationInnovation for a smarter planet
Dr. Einar KarlsenCertified IT SpecialistSolution [email protected]
Performance Management with MCIF and IBM Rational Insight
IBM Software Group | Rational software
2Innovation for a smarter planet
Agenda
� Background
� IBM Rational Insight Overview
� Measured Capability Improvement Framework (MCIF) Overview
� Executive Dashboard
� Conclusion
� Demo
IBM Software Group | Rational software
3Innovation for a smarter planet
You can‘t manage, what you can‘t measure!
Control Settings
Results
Better
Quality of Data
Quantity of Data
Time Delay
Stable
Non-Intrusive
You cannot IMPROVE what you cannot MANAGE!
IBM Software Group | Rational software
4Innovation for a smarter planet
Problems and Implications
Lack of timely information and in-context insight
Disparate data sources, formats,
and definitions
Lack of relevant, timely actionable
information
Inability to baseline and benchmark
status and progress
Inability to measure and assess
unobtrusively
“2/3 of executives make more than half
of their decisions based on ‘gut feel’rather than verifiable information”
“77% of managers are aware of
bad decisions made due to lack of access to accurate information”
“Poor decisions have generated
revenue 75% or morebelow expectations”
IBM Software Group | Rational software
5Innovation for a smarter planet
IBM Rational Insight
� Automatic collection, measurement and analysis
of real-time data across projects for informed
decision making
� Built-in library of metrics and dashboards based
on best practices and optimized for software and
systems development and delivery
� Customizable performance management
framework guides customers with best practices
to continuously improve process
� Built upon an open Jazz architecture, leveraging
legacy Rational and 3rd-party data
� Built on a best-in-class business intelligence
platform from IBM Cognos, clear leader in the
2008 Gartner Magic Quadrant for BI
IBM Software Group | Rational software
6Innovation for a smarter planet
Application Lifecycle Management Reports
IBM Software Group | Rational software
7Innovation for a smarter planet
Rational Insight
Project
Management
Project
Management
Build
Management
Build
Management
Architecture
Management
Architecture
Management
Requirements
Management
Requirements
Management
Change
Management
Change
Management
Configuration
Management
Configuration
Management
Portfolio
Management
Portfolio
Management
Quality
Management
Quality
Management
CxO
Project Manager
Collaborate across disparate development artifacts
In the context of business objectives
Process Lead
IBM Software Group | Rational software
8Innovation for a smarter planet
Performance Management Across the Lifecycle
Open Lifecycle Service Integrations
Best Practice Guidance
ClearCase
MS Project
XML
Quality Manager
Partners
Single View into Your Organizational Performance
ClearQuest
RequisitePro
Team Concert
Insight
Requirements Composer
Powered by
Measured Capability Improvement Framework
(MCIF)
Powered By Cognos
3rd Party
HP Quality Center
DOORS
IBM Software Group | Rational software
9Innovation for a smarter planet
Da
taS
tre
am
Da
taS
tre
am
Extract, Transform, Load
Reporting Server
Data Warehouse
M e t a d a t a
XML – ODBC Mapping | DB Access
Rational Insight High-Level Domains
Project
Management
Project
ManagementBuild
Management
Build
Management
Architecture
Management
Architecture
ManagementRequirements
Management
Requirements
Management
Change
Management
Change
Management Configuration
Management
Configuration
Management
Portfolio
Management
Portfolio
ManagementQuality
Management
Quality
Management
CxO Process LeadSelf Service
Report Authoring
REST API - native REST API – adapter
XML DB
Project Manager
Open Data Architecture
Enterprise Data Warehouse
Industry Proven BI Platform
Web architecture to retrieve product data in XML
(REST get)
IBM Software Group | Rational software
Innovation for a smarter planet
Measured Capability Improvement Framework (MCIF)
� Best Practice Adoption a systematic approach to best practice adoption
� Rational Health Assessment to benchmark against proven improvement roadmaps
� Rational Self Checks to provide ongoing self assessment
Ongoing Adoption Assessment
Adopt Practices
IBM Software Group | Rational software
11Innovation for a smarter planet
Performance Measurement Practices shipped with Rational Insight
•This practice
(included with
Insight) gives
detailed
process
guidance on
how to
implement
performance
measurement.
•Rational
Insight
provides the
tooling to
implement the
performance
measurement
practice.
•This practice
(included with
Insight) gives
detailed
process
guidance on
how to
implement
performance
measurement.
•Rational
Insight
provides the
tooling to
implement the
performance
measurement
practice.
IBM Software Group | Rational software
12Innovation for a smarter planet
Available Reports in IBM Rational Insight
�Test Lab Utilization
�Tested Use Cases to Implemented
Use Cases
�Requirement Volatility Churn
�Requirements Distribution
�Requirements Traceability Matrix
�Requirement and related UCM Activities
�Release Readiness (Defect)
�Request Trends
�Run Rate
�Tasks per Project
�Tasks per State Type Owner
�Workload
�SLOC per Defect
�Defect Distribution
�Defect Verification Failure Rate
�SLOC by component
�Test Case Execution Status
�Test Coverage by Requirement
Test management sample
reports
�Defect per Requirement
�Release Readiness (Requirement)
�Requirement Delivery
�Requirement List
Requirement practices sample
reports
�Blocking Defects
�Build Health
�Defect Aging
�Defect Status and Distribution
�Iteration Velocity
�Project Burndown
�Project Performance
Iterative development sample
reports
�Activities per Person
�Defect Glide Path
Change management reports
�Code Churn
�Code Contributions
�Defect Arrival Rate
Change control Reports
IBM Software Group | Rational software
13Innovation for a smarter planet
An Executive Dashboard – One PossibilityExecutiveDashboard
ProjectHealth
StrategicHealth
DevelopmentQuality
CustomerQuality
� Defect Backlog
� Test Escapes
� Functional Test Trends
� Critical Situations
� System Test Trends
� S-Curve Progress
� Automation Percentage
� Customer Testcases
� Consumability Scorecard
� Defect Latency
� Quality Plan Commitments
� Test Coverage
� Defect Backlog
� Defect Density
� Defect Repair Latency
� Build Health
� Project Velocity
� Staffing Actuals
� Process Timeliness
� Milestone Status
� Severity Analysis
� Security Vulnerabilities
� Static Code Analysis
� Requirements Met
� IPD Timeliness
� Transactional Survey
� PMR / Call Rates
� Critical Situations
� Cost of Support
� Installability
� Enhancement SLA
� Useability
� Consumability
� Perceived Performance
� Scalability
� Integrations with other
products
� User Experience / Doc
Time to Resolution
� Sales Plays
� Partner Enablement
� Support Enablement
� Technical Enablement
� Sales Enablement
� Localization
� MCIF Index
� Competition
� Integrated into Story
� Green Threads
� LCM
� Pipeline / Multiplier
� Revenue
PracticesVulnerability Assessment
Concurrent Testing
Test Driven Development
Whole Team
Team Change Management
Evolutionary Architecture
Requirements Management
IBM Software Group | Rational software
14Innovation for a smarter planet
Rational Data Sources
RationalRequirements
Composer
RationalClearQuest
RationalTest
Manager
RationalTeam
Concert
RationalRequisite
Pro
RationalClearCase
RationalQuality
Manager
Headcount&
Financials
Sales&
Pipeline
ManualData
CustomerSupport
3rd Party Data Sources
ProjectData
DB2
Oracle
SQL Server
RationalInsight
Quantitative and Qualitative Data
REST Open Services / ODBC / XML
Where You Are� Productivity Rates
� Quality Levels
Why You Are� Process Assess
� Product Health
Rational Executive Dashboard
IBM Software Group | Rational software
15Innovation for a smarter planet
This top-level dashboard showcases schedule
variance, project health, size, and % complete for each project. Drill down on project for more info.
Project health by region. Drill down for regional information, including headcount
and cost-related information.
Dashboards are organized around business objectives to ensure focus on potential problem areas preventing
us to reach stated business objectives.
IBM Software Group | Rational software
16Innovation for a smarter planet
Project health dashboard provides a scorecard of 12
different quality related metrics. Drill down enables
further analysis.
Control metrics for practices including Test Management,
Iterative Development, Continuous Integration, and 2-Level Planning are provided.
Online Auction is a fictive project.
Guidance on how to set up a performance measurement system
and how to effectively leverage metrics to manage your business
is provided (from RMC)
Plugging in acquired products into our
dashboard allows us to rapidly identify strengths
and weaknesses.
IBM Software Group | Rational software
17Innovation for a smarter planet
Individual reports are among others organized around
practices. For each practice, you can run a set of reports for a
project, or a set of projects, to understand how well they follow discriminating practices. Poor
metrics indicating need for process improvement.
Build health is an example of a control metric for practices such as
iterative development and continuous integration. Seems like most teams have daily builds that pass our automated build tests.
IBM Software Group | Rational software
18Innovation for a smarter planet
360-degree view protects top-line, bottom line and manages risk Integrating and balancing for Real Return on IT Assets
Benefits
Total Asset Cost( )( Risk )
Prevent issues that create rework that
drives projects over budget 30%
Reduce Analysis-paralysis that puts delays projects up to 10% of the time
Automate project and process
measurement to improve team
productively 10%
Reallocate from troubled projects to get winners to market faster for
higher ROI
IBM Software Group | Rational software
19Innovation for a smarter planet
Gain insight into development projects which span
organizational and geographic boundaries
Raise enterprise transparency to reduce costs and risks by
mapping operational activities to strategic objectives
Drive business innovation and reduce costs through measured
and continuous process improvement
IBM Rational Insight Added Value
You cannot IMPROVE what you cannot MEASURE!
IBM Software Group | Rational software
20Innovation for a smarter planet
Demo: IBM Rational Insight Overview
� Executive Dashboard
� KPIs
� Staffing
� Project Size
� Project Status
� Quality
� Project View
� Build Health
� Defects
� Enhancement Requests
� Test Coverage
� Uncovered Test Cases
� Requirement Volatility
� Out-of-the-Box (OOTB) Reports
� Functional Hierarchy>Defect Management>Defect Distribution
� Practice Oriented Hierarchy>Change Control>Code Contributions
IBM Software Group | Rational software
21Innovation for a smarter planet
© Copyright IBM Corporation 2009. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.