visual performance management oct 20 oipmac
DESCRIPTION
Presentation at the Ontario Institute of PMAC conference in Niagara Falls. Co-presented with Leopold Koff (Conestoga College). Material also supplied by Kim Dooling (Town of Oakville). Presentation brought to you by QCsolver.caTRANSCRIPT
![Page 1: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/1.jpg)
Supply Chain Risk and Performance Monitoring:
The use of automated systems to help you manage key areas of your
organization
2012 Annual Conference Presentation
![Page 2: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/2.jpg)
Which sector are you in?Pick one!
1 2 3 4 5 6 7
20 0
3
31
11
1. Municipal2. Academic
(University/College)3. School Board4. Health Care5. Broader Public Sector6. Private7. Federal/Provincial
![Page 3: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/3.jpg)
Survey says
Municipal
Academ
ic (Unive
rsity/
College
)
School B
oards
Health
Care
Broad
er Public
Secto
r
Private
Company
Federa
l/Pro
vincia
l Gov't
Other0%
10%
20%
30%
12%
10%
7%
11%
16%
22%
14%
8%
![Page 4: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/4.jpg)
How many Canadian employees work for your organization? Pick only one!
1 2 3 4 5 6 7 8
0
2
8
12
7
3
4
3
1. 1 to 92. 10 to 243. 25 to 994. 100 to 2495. 250 to 4996. 500 to 9997. 1000 to 24998. 2500 +
![Page 5: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/5.jpg)
Other than OIPMAC which Organization(s) do you belong to?
Pick as many as you would like!
1 2 3 4 5 6 7 8 9 10
4
0 0 0
24
8
5
1
00
1. OPBA2. CPPC3. NIGP4. OECM5. CMC6. HSCN7. Construction Association8. ISM9. Other10. None
![Page 6: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/6.jpg)
Survey Says!
OPBA = Ontario Public Buyers AssociationCPPC = Canadian Public Procurement CouncilNIGP = National Institute of Governmental PurchasingOECM = Ontario Educational Collaborative MarketplaceCMC = Canadian Association of Management ConsultantsHSCN= Healthcare Supply Chain Network
![Page 7: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/7.jpg)
How many competitive bids did your group issue in 2011?
1 2 3 4 5
20
1
9
00
1. 1 to 492. 50 to 993. 100 to 1494. 150 to 1995. Greater than 200
![Page 8: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/8.jpg)
How many competitive bids did the Town of Oakville issue in 2011?
180
![Page 9: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/9.jpg)
On average how many vendor performance evaluations do you do per year?
Pick only one!
1 2 3 4 5
3
22
6
23
1. None2. 1 to 103. 11 to 254. 26 to 495. 50+
![Page 10: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/10.jpg)
Survey Says!
![Page 11: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/11.jpg)
Which tools or methods do you use?Pick as many as you would like!
1 2 3 4 5 6 7
17
11
20
7
23
17
6
1. Checklists2. Forms3. Templates4. User Guides & Manuals5. Progress meetings6. Performance
documentation7. 3rd Party verification
![Page 12: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/12.jpg)
Which tools or methods do you use?
![Page 13: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/13.jpg)
What triggers an evaluation?
1 2 3 4 5 6 7 8 9 10
15
5
18
3
2
3
6
13
6
191. Periodic2. Budget Threshold3. Contract performance4. Project profile5. New vendor6. Project complexity7. Client Dissatisfaction8. Repeat vendors9. Length of Engagement10. Every Project
![Page 14: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/14.jpg)
Survey Says!
![Page 15: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/15.jpg)
Why Measure Performance?
• Support better decision making• Support better communication• Provide performance feedback• Motivate and direct behavior
15Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 16: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/16.jpg)
Problems with Purchasing and Supply Chain Measurement and Evaluation
• Too much data• Wrong data• Measurements that are short-term focused• Lack of detail• Drive the wrong performance• Measures behavior vs. accomplishments
16Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 17: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/17.jpg)
Performance Measurement
• Effectiveness– Extent to which, by choosing a certain course of
action, management can meet a previously established goal or standard
• Efficiency– Relationship between planned and actual
sacrifices made to realize a previously agreed-upon goal
17Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 18: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/18.jpg)
Metrics Key• SPECIFIC• MEASURABLE• ATTAINABLE• RESULTS ORIENTED• TIME-BASED
18Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 19: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/19.jpg)
Develop Specific Measures
• Objectivity• Clarity• Use of accurate and
available data• Creativity
• Directly related to organizational objectives
• Joint participation• Dynamic over time• Non-manipulative
19Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 20: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/20.jpg)
Measurement System Characteristics• Effective measurement requires consistent and reliable
data• Periodic review of measurement system to …
– Eliminate unimportant or unnecessary measurements– Add new criteria as required– Reevaluate objectives or targets– Objective versus Subjective criteria
20Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 21: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/21.jpg)
Measurement System Characteristics
• Measurement is not free• Not all aspects of performance lend themselves to
quantitative measurement• Purchasing and supply management is better served
by a few precisely defined and thoroughly understood measurements
21Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 22: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/22.jpg)
Measurement and Reporting Frequency
• Reporting frequency to buyer– Day-to-day performance for troubleshooting and
expediting• Reporting frequency to supplier
– Routinely summarized monthly or quarterly– Annual face-to-face meeting
• Never delay reporting supplier’s poor performance
22Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 23: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/23.jpg)
Uses of Measurement Data
• Identify poor performing suppliers• Support supply base optimization and rationalization
efforts• Determine future purchase volume allocations• Identify performance improvement opportunities• Make sourcing decisions
23Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 24: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/24.jpg)
Supplier Performance Management
• How does buyer know how well any given supplier is performing?
• Consists of methods and systems to collect and provide information to measure, rate, or rank ongoing supplier performance
• Acts as supplier “report card”
24Leopold Koff, B.A., B.Ed., CPSM, CPM, CSCMPProfessor, Supply Chain & Operations ManagementSchool of Business & Hospitality
![Page 25: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/25.jpg)
Working with ContractorsWHAT IS THE PURPOSE OF A CONTRACTOR PERFORMANCE
EVALUATION?• To ensure that contracts stay on track• To deal with issues and problems as they arise• To develop a relationship with contractors and an
understanding of what is expected• To document poor performance to alleviate the never
ending cycle
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 26: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/26.jpg)
Steps to Good Performance Management
• Establish and implement procedures for review of performance problems and/or disputes
• Have a consistent ranking system and procedure – follow it!
• Conduct regular inspections-project managers• Have written report, minutes, notifications
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 27: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/27.jpg)
Documenting Performance• The MOST crucial part of performance management• Weekly site meetings – up date the contractor on
upcoming issues or problems that have occurred. Get feedback from the contractor on how he feels the contract is going – take his suggestions to heart.
• Distribute site meeting minutes as soon after the meeting as possible
• Ask the contractor to note any exception to the minutes in an email or memo.
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 28: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/28.jpg)
Documenting Performance
• Any performance issues MUST be discussed with the contractor
• Contractor give reasonable time to correct the issue• DOCUMENT all issues – copy contractor on all
documentation• Suggestion: Two part report form – initialed by
contractor• Never put yourself in a position where the contractor
can say, “I had no idea!”
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 29: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/29.jpg)
Types of Documentation• Contract Check List
– Details deliverables and project milestones• Observation Record
– Document observations of Contractor Performance• Complaint Record
– To document and follow up on complaints• Discrepancy Record
– To note contract discrepancy, copy to contractor with expected actions.
• Field Diary– Used to keep track of daily records – be careful what you write.
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 30: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/30.jpg)
Types of Documentation
• Summary Evaluation Report– This is the contractors formal evaluation. – Conducted annually and/or upon completion– Reports can be done more frequently for
probationary or problem contractors– All notes and documentations are attached– Meet with contractor to discuss final outcome
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 31: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/31.jpg)
Contract Management
• Be flexible• Exercise sound judgement
Contracts are not held together by forms, surveys, diaries or other monitoring tools – but by the contract team!
Effective contractor monitoring depends more on the skills of the MONITORS than the monitoring methods
• A delicate balance of time and money vs the potential for disruption a service delivery.
Kim Dooling, CPPBManager, Purchasing and Risk ManagementFinancial Planning
![Page 32: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/32.jpg)
Examples of Automated Systems
RAQS
TQRDC
VPM
![Page 33: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/33.jpg)
![Page 34: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/34.jpg)
On a scale from 1 to 5 what is the average score you give to your contractors when you
do evaluations?
1 2 3 4 5
0
32
17
121. Poor2. Acceptable3. Standard4. Good5. Excellent
![Page 35: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/35.jpg)
Central tendency State of Florida
>= 1.00 to <= 2.80 >= 2.81 to <= 3.20 >= 3.21 to <= 5.000%
10%
20%
30%
40%
50%
60%
70%
3%
66%
31%
Overall Rating
Overall Rating
5105 Surveys conducted in April 2010
![Page 36: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/36.jpg)
![Page 37: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/37.jpg)
Ministry of Transportation Ontario
MTO uses the Registry, Appraisal & Qualification System (RAQS) to manage vendor qualification and vendor performance for infrastructure procurement
RAQS is an integrated solution with support for:• MTO user roles • Process workflows• Internal system interaction• Internal and external communications
![Page 38: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/38.jpg)
RAQS Key Functional Areas
– Vendor management• Vendor registration & qualification• Vendor performance assessment• Vendor rating
– Project tendering• Project notice advertising• Document distribution• Contractor communications
– Bid results and evaluation• Results evaluation / trend analysis• Awards
![Page 39: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/39.jpg)
Simplified 3M team rating (TQRDC)
T – Technology
Q – Quality
R – Responsiveness
D – Delivery
C – Cost
Courtesy: Jeff van GeelManager Sourcing & Accounts Payable
![Page 40: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/40.jpg)
Courtesy: Jeff van GeelManager Sourcing & Accounts Payable
![Page 41: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/41.jpg)
Simplified Scorecard
1. Focus on improvement
2. Present facets of performance without aggregation. Do not dilute message.
3. Communicate dashboard – detail in meeting
4. Scope: all material & services
Courtesy: Jeff van GeelManager Sourcing & Accounts Payable
![Page 42: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/42.jpg)
All information for exercise only
Courtesy: Jeff van GeelManager Sourcing & Accounts Payable
![Page 43: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/43.jpg)
1.Construction – Commodity - Contract2.Contractor - Consultant3.Consistency - Customizable4.Crowdsourcing – Collaborative - Comments5.Compare - Contrast6.Credible – Context7.Cost
7 C’S FOR CONSIDERATION
WWW.CSOLUTIONS.ORGWWW.CMC-CANADA.CA WWW.DOINGBUSINESS.MGS.GOV.ON.CA/
![Page 44: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/44.jpg)
VISUAL PERFORMANCE MANAGEMENT
ABC Contracting Grand River Excavation
Ford’s Landscaping
![Page 45: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/45.jpg)
FILLING OUT EVALUATION
• For ratings that are “Below Standard” and explanation must be entered
Easy to create, fill out and explain!
![Page 46: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/46.jpg)
Easy colour coding to spot what needs to be reviewed quickly.
Data can be exported for further calculations/analysis if required.
![Page 47: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/47.jpg)
1 2 3 4 5 6 7 8
25%
8%
10%
5%
15%16%
4%
17%
1. Effective communication throughout engagement
2. Quality of resources3. Availability of resources to carry
out contract4. Quality of the final deliverables5. Providing value added services6. Maintaining timelines/deadlines7. Budget/cost control8. Having a vendor contact for
dispute resolution
WHAT IS IMPORTANT FOR AN EFFECTIVE CONTRACT?
![Page 48: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/48.jpg)
Survey Says
![Page 49: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/49.jpg)
What are your greatest challenges to having an effective VPM!
Pick more than one!
1 2 3 4 5 6
30
25
9
15
4
15
1. Not enough time2. End user input difficult to
get3. Poor systems4. Not required5. Missing linkage between
contract and performance6. Comparative Consistency
![Page 50: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/50.jpg)
Do you share performance results with contractors - consultants?
1 2
9
27
1. Yes2. No
![Page 51: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/51.jpg)
Do you tie performance management data to proposal evaluations and selection?
1. Yes2. No
1 2
9
23
![Page 52: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/52.jpg)
52
COMMENTS – CONCERNS - CONFERENCE
![Page 53: Visual performance Management Oct 20 OIPMAC](https://reader035.vdocuments.us/reader035/viewer/2022062704/556315a0d8b42a5b498b4e61/html5/thumbnails/53.jpg)
CONTACT – CALL - COSTING
Gerald Ford [email protected]
226-474-1169905-296-4003
53
Leopold Koff [email protected]
Kim Dooling [email protected]
Corporate sponsors