bok chapter
TRANSCRIPT
-
8/6/2019 BOK Chapter
1/32
Improving Agent Performance throughM on ito r ing, Coach ing an dJust -in -Time Tr ain in g
Case St ud y of
Bank of Okl ah oma Finan cial Cor por at ion
by
Dr. Jon Anton
Purdue University
Center for Customer-Driven Quality
and
Scott Davis
Director of Product Validation
BenchmarkPortal, Inc.
Content Editor
John Chatterley
-
8/6/2019 BOK Chapter
2/32
This case study is reprinted with permission from How Technology Enables Profitability, by Jon
Anton, Ph.D. and Scott Davis, published by BenchmarkPortal. The focus of the book is how powerful
new technology solutions specifically designed for call centers allow imaginative executives to initiate
sales and service strategies that could not have been successfully implemented until now. Dr. Jon
Anton has selected specific best-of-breed solutions, and documented the before and after impact of
these solutions on such important business elements as revenue generation, cost savings, return on
investment, and ultimately, earnings per share.
The goal of the research team that Dr. Anton heads at Purdue Universitys Center for Customer-Driven
Quality and BenchmarkPortal is to help operating managers improve the performance of their centers,
and to provide the tools to help them measure that improvement. From Cost Center to Profit Center
is the first-ever compendium of product validation case studies. It promises to be an important source
of fact-based information that will be used by many managers to assess and acquire the solutions they
need to excel in the future.
Purdue Research Foundation, West Lafayette, IN 47907
Used pursuant to license. All rights reserved.
Copyright 2003, BenchmarkPortal, Inc.
This report may not be copied, scanned or reproduced without the written permission ofBenchmarkPortal, Inc. Additional copies may be purchased at a reasonable price bye-mailing [email protected] or by calling (805) 614-0123, ext. 10.
WP24-031003
-
8/6/2019 BOK Chapter
3/32
1
Tabl e of Con t en t s
Acknowledgements ............................................................................................................................................ 3
Executive Summary ............................................................................................................................................ 4
Introduction to Our Product Validation Research .......................................................................................... 5
Ideal Components of an Integrated CSR Monitoring and Coaching System for Call Centers ................... 6
Research Project Background ........................................................................................................................... 9
Research Project Methodology ....................................................................................................................... 10
Brief Background of Bank of Oklahoma..........................................................................................................11
General Business Conditions that Prompted a New Strategy ................................................................... 12
The Monitoring Process Was Time Consuming .............................................................................. 12
The Monitoring Process Was Incomplete ........................................................................................ 12
The Monitoring Process Was Subjective .......................................................................................... 12The Coaching Process Had Limited Options ................................................................................... 13
KPIs Before Implementation of the Click2Coach System............................................................................ 14
Specific Features of the Click2Coach System ................................................................................................ 15
Effects of the Enabling Technologies ............................................................................................................. 16
Effect of the Click2Coach System on Call Workflow Processes .................................................. 16
Effect of the Click2Coach System on Key Constituencies ........................................................... 17
KPIs After Implementation of the Click2Coach System ............................................................................. 19
Financial Analysis of the Economic Impact .................................................................................................. 20
Economic Value Realized From the Improvements in Call Center Performance Metrics ....... 20
Financial Impact on Net Operating Income ................................................................................20
Conclusion and Recommendations ............................................................................................................... 22
About the Sponsor ........................................................................................................................................... 23
Glossary of Terms ............................................................................................................................................ 25
Authors Biographies ....................................................................................................................................... 26
-
8/6/2019 BOK Chapter
4/32
2 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
List o f Figur es
Figure 1. Primary methods used to monitor live CSR call handling ........................................................ 7
Figure 2. Answers to the question: What percentage of your customers give you a perfect score for
caller satisfaction? ........................................................................................................................... 7
Figure 3. Correlation of CSR monitoring with CSR turnover ........................................................................ 8
List o f Tabl es
Table 1. Financial Impact of Click2Coach System ........................................................................................ 21
Table 2. Impact of Click2Coach Program on Shareholder Value ................................................................. 21
-
8/6/2019 BOK Chapter
5/32
3
Ackno wl edgemen t s
We wish to thank the BOK Financial Corporation, whose story appears in
this study, and thank their managers and staff whose cooperation and
support enabled us to produce our findings.
We also want to express our gratitude to Envision Telephony, Inc. for
their sponsorship of this landmark research study.
-
8/6/2019 BOK Chapter
6/32
4 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Executive Summary
The goal of our research was to evaluate the impact that the BOK Financial Corporation (hereinafter,
the Bank) experienced following their implementation of Click2Coach (hereinafter, the Click2Coach
System). The Click2Coach System is an integrated monitoring, coaching, and e-learning system for
customer service representatives (hereinafter, CSRs) developed by Envision Telephony, Inc. (hereinaf-
ter, the Sponsor).Specifically, we wanted to determine if CSR monitoring and coaching, followed by e-learning training
delivered directly to the CSR desktop, positively affected his/her skill-set and performance.
Our objective was to measure and quantify the improved performance levels that CSRs realized after
using the Click2Coach System, and calculate the corresponding financial benefit to the Bank.
The highlights of our research findings are summarized below. The background and details of this
executive summary form the basis of the remainder of this case study.
Our Most Important Findings
After installing the Click2Coach System, the Bank experienced the following changes:
1. Revenue from up-selling increased more than 28% immediately, and has been sustained at this
higher level
2. A 388% return on investment (hereinafter, ROI) in its first year, paying back the initial invest-
ment in less than 3 months
3. Productivity, defined as calls handled per CSR per logged-in-hour, increased by 13%
4. CSR quality monitoring scores improved 14%
5. CSR attendance improved 13.6%
6. CSRs competed for top performance honors 90 days after completing their initial training
7. Supervisors have 30 hours per month more time to spend coaching and motivating their CSRs
8. Supporting the rollout of a new approach to handling customer calls was accomplished with-
out any degradation in performance
-
8/6/2019 BOK Chapter
7/32
5
Introduction to Our Product Validation Research
Powerful technology solutions designed specifically for call centers allow imaginative executives to
initiate sales and service strategies that could not have been successfully implemented until now.
Through these innovative call center solutions, businesses are better able to:
1. Meet customer needs
2. Increase satisfaction
3. Increase market share
4. Increase revenues
5. Reduce transaction costs
6. Improve CSR retention
7. Acquire new customers
8. Retain existing customers
9. Increase profits and earnings per share
Our researchers have developed a scientific method to determine the impact that such enabling
technologies have on leveraging a call centers ability to achieve all of the above.
Our case studies tell a compelling story. We have found astounding ROIs, with paybacks of less than
four months in some cases and less than 12 months in most cases. Because of our focus on revenue
generation, and/or cost reduction, our quantitative product validations stimulate the imagination of
executives, who have their eye on bottom-line profits.
It is an unfortunate fact that, in almost all cases, the financial impact of call center improvementinitiatives are not adequately measured, and therefore, the success stories are never told. This is a loss
for both the vendor providing the improvement solution, and the companys champion who could
take full credit for the financial gains, if only someone would do the research.
It is our conviction that documenting these success stories will engage the imaginations of business
leaders and call center professionals to reach out and embrace the power of enabling technology for
call centers.
This unique case study documents another such financial success story.
Introduction to Our Product Validation Research
-
8/6/2019 BOK Chapter
8/32
6 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Ideal Components of an Integrated CSR Monitoringand Coaching System For Call Centers
An ideal integrated CSR monitoring and coaching system should:
1. Provide timely and accurate performance feedback to the CSRs
2. Develop a CSR performance improvement plan, including individualized reinforcement trainingfor each CSR
3. Conduct digital call recording on a scheduled basis, and store the calls for easy playback and
scoring
4. Connect with the automatic call distributor (hereinafter, ACD) to identify when a CSR is
logged in and available for recording
5. Integrate with the workforce management systems to schedule call recording during times
when CSRs are handling calls
6. Ensure that a pre-determined number of calls are recorded for each CSR each month
7. Capture CSR desktop screen displays associated with each call for later playback of the conver-
sation between the CSR and the caller, and the CSRs navigation of the desktop screen
8. Provide on-screen performance evaluation forms, which allow the supervisor or quality assur-
ance professional to score the call and enter comments and suggestions
9. Send recorded calls and performance evaluations to the CSR desktop electronically, allowing
the CSR to self-coach, as well as to prepare for an upcoming coaching session
10. Support the creation of on-line, computer-based, e-learning vignettes that can be accessed by
CSRs from their desktops, allowing for personalized e-learning to be delivered in quick trainingbites
11. Provide a management reporting system that tracks individual CSR performance, and e-leaning
vignette utilization
Todays astute call center managers understand the importance of CSR monitoring and coaching.
According to our latest research statistics, the vast majority of call centers (over 95%) are monitoring
calls, in some fashion, to measure call quality. Figure 1 shows the different types of monitoring and
their percent utilization.
-
8/6/2019 BOK Chapter
9/32
7
Figure 1. Primary methods used to monitor live CSR call handling
Figure 2. Answers to the question: What percentage of your customers give you a perfect score for caller
satisfaction?
In a recent survey of call center managers with and without monitoring systems in place, we asked the
question, What percentage of your customers give you a perfect score for caller satisfaction? Our
research shows a strong correlation between CSR monitoring and caller satisfaction as shown in
figure 2.
DesktopRecorders
(Manual) 13%
LiveSide-by-Side
Monitoring 20% RemoteMonitoring 31%
AutomatedRecording
System36%
WithoutMonitoring
Systems 44% WithMonitoring
Systems56%
Ideal Components of an Integrated CSR Monitoring and Coaching System for Call Centers
-
8/6/2019 BOK Chapter
10/32
8 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Figure 3. Correlation of CSR monitoring with CSR turnover
Figure 3 shows the results of our research into differences in CSR turnover between call centers with
monitoring systems, and those without. The results clearly show a positive impact of CSR monitor-
ing and coaching on turnover.
Other key performance indicators (hereinafter, KPIs) that CSR monitoring and coaching systems
should positively impact include:
1. First call resolution rates
2. Up-sell and cross-sell conversion rates
3. Cost per call
4. Average call talk time
5. Average after-call work time
6. CSR utilization
7. Training costs
WithoutCSR
Monitoring62%
With CSRMonitoring 38%
-
8/6/2019 BOK Chapter
11/32
9
Research Project Background
We performed a thorough and comprehensive study to determine the changes in performance of CSRs
who used the Click2Coach System over a period of 18 months. We measured CSR performance im-
provements and quantified the financial impact during this time period.
In our research project, working closely with the Banks professionals, we achieved the following:
1. Edentified the KPIs that apply to CSR quality monitoring and coaching
2. Collected baseline performance data before implementing the Click2Coach System
3. Collected baseline performance data after the implementation of the Click2Coach System
4. Analyzed the data collected to quantify CSR performance improvements
5. Analyzed and processed the data collected to quantify the process improvements realized by
the Bank
6. Identified changes made in the call monitoring and coaching process resulting from imple-
menting the Click2Coach System
7. Identified changes made in the call workflow processes resulting from the implementation of
the Click2Coach System
8. Identified changes in management processes required to support the Click2Coach System
9. Identified the effects of the implemented Click2Coach System on other key constituencies
10. Computed a return on investment (ROI) for the Click2Coach System at the Bank
While we certainly expected to find some impact on CSR performance, no guarantees of the outcome
were given to either the Sponsor or the Bank. Whatever conclusions we made were driven and sup-ported by the data we gathered during our study.
Research Project Background
-
8/6/2019 BOK Chapter
12/32
10 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Research Project Methodology
We followed an iterative discovery process with the Bank consisting of:
1. Telephone interviews with key executive manager and operational staff
2. Preparation of a list of major KPIs
3. Analysis and interpretation of the data provided
4. Development and review of preliminary conclusions
5. Validations of the data to ensure our conclusions were accurate
Our primary interviews were with the Bank team comprised of James Morris, Senior Vice President of
Consumer Banking, and members of his staff. In our first interview, Mr. Morris outlined the following:
1. The business challenges that prompted the Bank to acquire the Click2Coach System
2. The call quality monitoring and monitoring process changes his team implemented to take full
advantage of the Click2Coach System
3. The features of the Click2Coach System that were leveraged to produce the Banks impressive
improvement results
Mr. Morris and his staff gathered and submitted their performance data to our research team. We then
conducted a series of meetings to drill down on the data provided to ensure its accuracy and consis-
tency. Our primary concern was to make sure that we understood the differences in the processes that
had been in place before and after implementation of the Click2Coach System.
The Bank management team was able to provide us with accurate data for the following:
1. KPI measurements of CSR performance
2. Up-sell and cross-sell conversion rates per CSR
3. The value of new accounts
4. costs, pricing, and staffing changes
5. Click2Coach feature uses
6. the technical support required for initial setup and ongoing support of the Click2Coach System
We used this Bank data to construct the financial models, and to conduct a before-and-after bench-
mark of the Click2Coach System.
The Bank team was very cooperative with us in furnishing and validating the data provided. Our ROI
analysis and conclusions are based upon a combination of actual financial results and financial fore-
casts furnished by The Bank.
-
8/6/2019 BOK Chapter
13/32
11
Brief Background of Bank of Oklahoma
The Bank of Oklahoma Financial Corporation is a multi-bank holding company based in Tulsa, Okla-
homa, with total assets of $11.9 billion. The company provides:
1. Commercial and consumer banking
2. Investment and trust services
3. Mortgage origination and servicing
4. An electronic-funds transfer network across six states
James Morris oversees 24-Hour Express Bank, which is the commercial name of the Banks customer
care call center. The call center handles over 100,000 sales and service calls each month.
The call center splits its CSRs into two groups.
1. The Customer Service Group, which handles most of the service calls. These inbound calls
range from simple transactions, such as providing account maintenance and balance informa-
tion, to answering complex questions about taxable earnings, callable CDs, investment strate-
gies, and credit issues.
2. The Sales Group, which handles all sales calls. These inbound calls range from handling loan
applications, opening new deposit accounts, and supporting current bank promotions over the
phone.
An interactive voice response unit (hereinafter, IVR) routes a caller to the appropriate CSR group.
In addition to satisfying the callers needs, the Bank wants its CSRs to determine if the caller is an up-
sell or cross-sell prospect for other Bank products and services, such as:
1. A term loan (i.e., auto and home-equity)
2. A new deposit account (CD, college savings account, etc.).
The service CSRs transfer interested and qualified callers to the sales group, or to the callers local
branch, as the caller directs. If the caller signs up for additional products or services, the call center is
given credit for an up-sell, or referral.
Brief Background of Bank of Oklahoma
-
8/6/2019 BOK Chapter
14/32
12 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
General Business Conditions thatPrompted a New Strategy
Monitoring for call quality has always been important for the Bank. Prior to the implementation of the
Click2Coach System in January of 2001, each supervisor would silently monitor at least four calls per
month for each of the 12 to 16 CSRs reporting to them.
The following are the key issues that prompted the need for a new strategy:
The Monitoring Process Was Time Consuming
The manual process being used by the supervisors was inefficient and time consuming. For example:
1. Supervisors were spending over 30 hours each month listening to and evaluating live calls
2. Most monitoring sessions began with supervisors selecting a CSR who was handling a call
already in process, waiting for the CSR to complete the call, and then waiting for the next call
to arrive
3. Once they had a call to evaluate, the supervisor was required to make and record his/herevaluations immediately after the call was completed, as there was no opportunity to listen to
the call a second or third time
4. If the supervisor was interrupted during a monitoring session, he/she would have to find
another call and start all over, losing time already spent
5. When call volume was light, a supervisor could wait several minutes for a call to reach a CSR
before monitoring could begin
The Monitoring Process Was Incomplete
Supervisors were not able to observe the CSRs interaction with the computerized customer record
system while monitoring the call. Supervisors had no way to evaluate and answer the following ques-
tions:
1. Was the CSR navigating the screens effectively?
2. What changes in screen navigation could the CSR make to improve the quality of the callers
experience?
The Monitoring Process Was Subjective
Mr. Morris had no effective way to calibrate the standards used by each of his supervisors, and there-fore, a wide variance existed between the call evaluation scores produced by the supervisors. Their
monitoring and coaching process generally proceeded as follows:
1. At the conclusion of the live monitoring session, the supervisor would complete the assess-
ment forms.
2. Later, the supervisor would meet with the CSR to review their assessment of the calls moni-
tored.
-
8/6/2019 BOK Chapter
15/32
13
3. If supervisors were uncertain that they had interpreted the call correctly, they had no opportu-
nity to listen to the call again, since it was not recorded.
4. If a CSR disagreed with or didnt understand their supervisors evaluation of a call, there was
no process in place for the supervisor to replay the call or provide backup support. This had
the effect of reducing both the credibility of the evaluation and the value of the coaching.
5. In a typical workday, a CSR would handle close to 120 calls. The likelihood that the CSR wouldremember the four calls their supervisor monitored was effectively zero.
6. Some CSRs worked for supervisors with tougher standards than other supervisors, giving the
CSRs a sense that the process was unfair.
The Coaching Process Had Limited Options
Often the call evaluations would lead to the conclusion that the CSR required more training on a
particular product or skill-set. Limited training options were available. For instance, here are a few
examples:
1. A trainer could tutor a single CSR, but this was a very inefficient use of scarce resources;
2. A training session could be held for several CSRs, if enough needed the same refresher course;
or
3. The supervisor could provide the tutoring, even though they did not necessarily have the
training skills to perform this task effectively.
Knowing that coaching was essential to ensure quality customer service and expand customer rela-
tionships, and further, knowing that their approach to monitoring calls and coaching could be im-
proved, Mr. Morris and his team decided to find and implement an effective call monitoring and
coaching system.
In the fall of 2000, following an extensive investigation of vendor products, the Bank selected the
Click2Coach integrated monitoring, coaching, and e-learning system from Envision Telephony. They began
using the Click2Coach System to support their CSR monitoring and coaching process in January 2001.
General Business Conditions That Prompted a New Strategy
-
8/6/2019 BOK Chapter
16/32
14 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
KPIs Before Implementation of theClick2Coach System
The KPIs listed below were used in the study to measure the performance improvements, perform the
ROI analysis, and calculate the added economic value resulting from the implementation of an inte-
grated CSR monitoring, coaching, and e-learning system.
The study consisted of analyzing the call center KPIs before and after implementation of the
Click2Coach System. At the beginning of 2001, the situation at the Banks call center was as follows:
1. CSRs were handling 89,000 calls per month
2. CSRs were averaging a talk time per call of 155 seconds
3. CSRs were idle an average of 77 seconds between each call
4. CSRs were averaging 15.17 calls handled per hour
5. The service CSRs were referring approximately one call per 1000 handled to the sales CSRs
6. The sales CSRs were converting almost 4 calls per 1000 handled into a new deposit account
7. The supervisors were spending 30 hours per month monitoring and evaluating calls
-
8/6/2019 BOK Chapter
17/32
15
Specific Features of the Click2Coach System
Specific features of the Click2Coach System pertinent to the Banks implementation were:
1. Digital recording of the call (CSRs and callers voice), and CSR screen activity during the call
2. On-line capture of the quality teams monitoring scores of the call, and suggestions regarding
the CSRs performance
3. Delivery of recordings and monitoring scores to the CSRs desktop via a customizable,
browser-based window
4. Creation and delivery of e-learning vignettes for viewing by CSRs at their desktop, and for
classroom training
5. Recording and playing audio through standard telephone lines to eliminate the need for
multimedia devices or moving voice files over the LAN or WAN
6. Web-based interface and knowledge portal for CSRs to review training, call evaluations, call
records, real-time contact center statistics and miscellaneous information directly at theirdesktops
7. Automated scheduling and recording to capture random call samples according to a rules-
based schedule that supervisors set in advance
8. Ability to share recordings and training content throughout the entire contact center directly to
CSRs desktops or via e-mail
9. Customizable evaluation templates to grade agent performance based on the companys own
unique metrics
Specific Features of the Click2Coach System
-
8/6/2019 BOK Chapter
18/32
16 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Effects of the Enabling Technologies
Effect of the Click2Coach System on Call Workflow Processes
Beginning in January 2001, Mr. Morris changed the performance goals to place a heavier emphasis on:
1. Up-sell and cross-sell referrals by the customer service group
2. CSR availability (time spent logged into the system and ready to take calls)
Supervisors monitored and coached for the behaviors needed to meet these new goals. The Bank
realized an immediate increase in referrals and new deposit accounts opened.
In the fall of 2001, the Bank implemented a new sales and service system in the call center. The
system calls for a more consultative approach to handling customer calls in order to meet all of the
customers financial needs. The Banks CSRs and supervisors had to learn new skills and behaviors to
support the program. Extensive training took place in October and November of 2001.
The Bank made several management changes to support the new service and sales approach,
including:
1. Developing a new monitoring process to support the assessment of CSRs performance in
achieving the new goals
2. Creating and filling the position of quality assurance specialist to monitor and score calls,
freeing up the supervisors to focus on coaching, and ensuring a consistent use of standards in
the evaluations
3. Sending the recorded calls and the quality assurance specialists evaluations to both the CSR
and their supervisor electronically, for their independent review
4. Scheduling a coaching session between the CSR and supervisor to review the call evaluations,and determine what, if any, action should be taken
5. Holding weekly supervisor meetings to review behavioral and sales goals and identify activities
for the week to reinforce desired behaviors
The Bank actively uses the e-learning component of the new Click2Coach System. Since implementa-
tion in January 2001, Mr. Morris and his team have developed 27 training vignettes which:
1. Are used for new-hire training
2. Are accessible by CSRs from their desktop for refresher learning
3. Average four to five minutes in length
4. Address topics such as:
a. product and service offerings
b. the proper steps for completing transactions
c. stop losses
d. changing a PIN number
e. ordering new checks
-
8/6/2019 BOK Chapter
19/32
17
f. communications skills
g. role-playing
Because of the Click2Coach System, Mr. Morris needed no additional staff to develop and support the
e-learning vignettes.
One of the first e-learning vignettes developed was a refresher course on handling IRS 1099 calls.
Every January, Morris had required each CSR to attend a 30-minute refresher training class. Now they
get their refresher training via a nine-minute e-learning session at their desktop. By reducing the
amount of CSR time to take the training, Mr. Morriss created enough capacity to handle an additional
412 calls.
Effect of the Click2Coach System on Key Constituencies
Strategic technology initiatives impact many different constituencies. An analysis of this impact on
several constituencies at the Bank follows:
1. Customers: Call quality scores improved 10%. The Banks customers are receiving better
services. Greater attention is being placed on identifying and serving each customers financial
service needs.
2. Experienced CSRs: Many of the CSRs on staff did not respond positively to the changes when
the new call monitoring, coaching, and e-learning practices were implemented. Turnover
actually increased following implementation. For the six months ending June 30, 2002, the
performance of only six CSRs (out of seventeen CSRs who were on staff on January 1, 2001)
ranked in the top half.
Implementation of any new system, especially a CSR monitoring and coaching system, within
an existing call center environment, should always be accompanied by a change management
program aimed at assuaging the fear of change and eliciting the buy-in by CSRs to the value
the new system brings to them. By positioning the system for the CSRs as a tool to help them
do their jobs more effectively, and not as a big-brother means of measuring their perfor-
mance and limiting their growth, unintended negative consequences such as higher turnover
and lowered performance can be substantially avoided.
3. New Hires: Within 60 days after initial training, new hires exceeded the average performance
of the experienced CSRs, and were competing for top honors. For example:
a. The performance of three of the four CSRs, hired in January 2002, ranked in the top 50%through June 30, 2002.
b. The average rank in call quality scores of these four was 19 out of 53.
c. The increased attention, performance feedback, coaching, and easy access to refresher e-learning, all had a very positive impact.
4. Supervisors and Managers: The addition of a quality assurance specialist in the fall of 2001
eliminated the 30 hours per month supervisors were spending listening to and evaluating
calls.
Mr. Morris wanted his supervisors to use this excess time to better organize and plan their
coaching activities. In the past, they had to fit in coaching when they could find the time. To
help them manage this newly found time, Mr. Morris established standards for coaching
activities.
Effects of the Enabling Technologies
-
8/6/2019 BOK Chapter
20/32
18 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Supervisors continue to monitor calls, but for specific reasons requiring performance feedback
more frequently than once each month. Examples include:
a. when an individual CSRs performance is below acceptable standards; and
b. when a new marketing campaign or call center contest is in progress.
5. Trainers: Because of the Click2Coach System, the e-learning training modules Mr. Morris and
his team developed have reduced the training preparation required, both in time and effort, and
have improved training consistency.
-
8/6/2019 BOK Chapter
21/32
19
KPIs After Implementation of theClick2Coach System
The Banks reported performance metrics (KPIs), as of June 2002:
1. The call center is now averaging 97,000 calls handled per month, an 9% increase in calls
handled since Click2Coach was implemented
2. The average talk time per call is 155 seconds, which matches the average talk time KPI before
Click2Coach was implemented
3. The average wait time between the conclusion of one call and the receipt of the next call is 49
seconds, a 44% drop from January 2002
4. CSRs are handling 17.26 calls per login hour, approximately 2 more calls per hour than were
handled before Click2Coach was implemented
5. Service CSRs are referring 4.6 calls per 1000 answered to the sales CSRs, an six-fold increase
in the up-sell and cross-sell referral rate of CSRs before Click2Coach was implemented
6. The sales CSRs are converting 5.81 calls per 1000 handled into a new deposit account, a 58%
increase over the rate before implementation of Click2Coach
7. Supervisors have an additional 30 hours each month to spend coaching their CSRs, twice as
much time as they had prior to implementation of Click2Coach
KPIs After Implementation of the Click2Coach System
-
8/6/2019 BOK Chapter
22/32
20 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Financial Analysis of the Economic Impact
Economic Value Realized From the Improvements in Call Center Performance Metrics
To demonstrate the impact of the Click2Coach System, we isolated and quantified the value of the
KPIs that moved as a result of the Click2Coach System, as follows:
1. Increased referrals per 1000 calls resulted in a 28% increase of new deposit accounts opened(this was the result of improved CSR monitoring, coaching, and e-learning)
2. An increase in calls per CSR per login hour of 13% (this was the result of better monitoring and
coaching, improved attendance, higher CSRs availability, and less time spent in non-productive
states).
To determine the amount of credit to award the Click2Coach System for the Banks increase in sales,
we compared referrals and new deposit accounts per 1000 calls for the first 7 months of FY2001,
immediately following the implementation of the Click2Coach System, to the same period of FY2000.
We determined that the:
1. Increase in referrals was driving the opening of one additional new account for every 1000
calls, which equates to $378,000 per year in additional gross margin to the Bank, a significant
bottom-line improvement
2. Increase in the calls handled per CSR per login hour by two calls, allowed the Bank to service
their caller demand with five fewer full-time equivalent CSRs, saving $110,000 per year in
operating expense, a top-line improvement
We then offset the increase in operating income, and savings in operating expense (identified in a. and
b. above), with the implementation costs and increases in operating costs associated with the new
Click2Coach System. We accomplished this as follows:
1. The implementation costs associated with the project were approximately $100,000
2. On-going support costs (hardware, software, and people) amounts to approximately $70,000
per year
Financial Impact on Net Operating Income
The following table shows the impact on net operating income in the first, and subsequent years,
following implementation of the new Click2Coach System.
-
8/6/2019 BOK Chapter
23/32
21
Table 1. Financial Impact of Click2Coach System
Financial Impact to the Bank of the Click2Coach System
Year 1 Subsequent YearsValue of one additional new account per 1000 calls $ 378,000 $ 378,000Value of two additional calls per logged-in hour $ 110,000 $ 10,000Total annual value created $ 488,000 $ 488,000Initial cost of the Click2Coach System $ 100,000Value created in first year $ 388,000First year ROI 388%Payback in months 2.5Ongoing annual expense $ - $ 70,000Annual increase in net income $ 388,000 $ 418,000
The Click2Coach System yielded a payback on the initial investment in two and one-half months.
Going forward, it will add over four times its initial investment to the Banks net annual income each
year.
While $418,000 is only a small percentage of the Banks $10 billion dollars in assets, it has a ratherinteresting impact on shareholder value as the following chart demonstrates. The numbers used in
this analysis include the total number of shares outstanding at the end of 2001, based upon the Banks
annual report and the price earnings multiple of the Banks stock at 10/31/02.
Table 2. Impact of Click2Coach Program on Shareholder Value
Impact of the Click2Coach System on the Banks Shareholder Value
Year 1 Subsequent YearsAnnual increase in net income $ 388,000 $ 418,000Effective Tax Rate 35% 35%
Estimated Taxes $ 137,365 $ 147,986Increase in net income $ 250,635 $ 270,014Fully diluted outstanding shares @ 12/31/01 52,731,791 52,731,791Increase in earnings per share $ 0.005 $ 0.005Price Earnings @ 10/31/02 11.3 11.3Project impact on share price $ 0.54 $ 0.058Project impact on shareholder value $ 2,832,176 $ 3,051,159
We calculated that Banks investment in the Click2Coach System has added approximately
$3,000,000 to its overall shareholder value.
Financial Analysis of the Economic Impact
-
8/6/2019 BOK Chapter
24/32
22 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Conclusion and Recommendations
Delivering coaching, monitoring feedback, and e-learning to CSRs at their desktop in bite-size
learning vignettes, during periods of low call volume, is a very effective way to enable CSRs to gain,
reinforce, and maintain the knowledge and skills necessary to improve their performance.
Setting clear performance goals, identifying the skills and behaviors needed to meet these goals, and
coaching to meet these goals works, when coupled with integrated CSR monitoring, coaching, and e-learning systems such as the Click2Coach System. By increasing the up-sell rate by just one sale per
1000 calls and increasing calls handled per CSR per log-in hour by two calls, the Bank created millions
of dollars of shareholder value.
Some CSRs are reluctant to embrace changes, as demonstrated by the higher turnover and lowered
performance results the Bank witnessed with their seasoned CSRs when the Click2Coach System was
introduced. However, over a relatively short period of time, the new-hires raised the performance bar,
and their results speak for themselves.
As successful as the introduction of the Click2Coach System by the Bank was, proper anticipation of
the negative reaction of the seasoned CSRs could have produced an even more dramatic result.Implementation of any new system, especially a CSR monitoring and coaching system, within an
existing call center environment, should always be accompanied by a change management program
aimed at assuaging the fear of change and eliciting the buy-in by CSRs to the value the new system
brings to them. By positioning the system for the CSRs as a tool to help them do their jobs more
effectively, and not as a big-brother means of measuring their performance and limiting their
growth, unintended negative consequences such as higher turnover and lowered performance can be
substantially avoided.
-
8/6/2019 BOK Chapter
25/32
23
About the Sponsor
Envision Telephony, Inc. develops software solutions for contact centers. Since its founding in 1994,
Envision has focused on improving the effectiveness and performance of contact center agents.
Click2Coach, Envisions patented, agent development solution goes well beyond traditional quality
monitoring to manage and evaluate agent-customer interactions and provide personalized e-learning
vignettes to develop more effective agents. It integrates quality monitoring, evaluation, and e-learningtools in one seamless solution, and delivers it directly to agents desktops. This ongoing feedback and
e-learning allows contact centers to develop, motivate, and retain top-notch agents who provide
superior customer service.
Today, Click2Coach is still the only solution to deliver coaching directly to the agents desktop. This
new coaching approach has opened the door to e-learning in the contact center and has been recog-
nized by industry analysts for its overall impact on improving the quality of customer interactions.
Envision was the first to talk about and deliver solutions for coaching, the ongoing process of
providing agents with the personalized e-learning, objective feedback, and information they need to
perform at their best. Contact center executives are now focusing on agent development tools for
the first time and including it as part of their CRM (Customer Relationship Management) and contactcenter strategy.
Envision has expanded its award-winning Click2Coach product line to include a solution for organiza-
tions with multiple contact centers. Click2Coach MultiSite includes all the power of the Click2Coach
product suite - including integrated quality monitoring, evaluation, and e-learning tools - and expands
those capabilities to connect all contact centers into a single virtual organization for global manage-
ment, administration, coaching, and reporting. With Click2Coach MultiSite, multiple contact centers
act as one for the sharing of information, best practices and e-learning vignettes, so supervisors can
universally develop well-trained, knowledgeable agents who deliver a consistent and predictable
experience for customers.
Customer requirements are the driving factor in the development of Envisions solutions. The
companys customer-focused approach has resulted in a number of innovations. Envision Telephony
was the first developer to offer a Windows NT-based quality monitoring solution, the first to offer
Computer Telephone Integration (CTI), the first to introduce a browser-based agent desktop, and the
first to integrate an authoring tool to create e-learning vignettes on the fly. No other company in the
industry today can provide a system that is as sophisticated, yet easy-to-use.
Envision also offers the commitment to a well-managed, predictable implementation and high quality
of support. The company has a dedicated group of technical and experienced implementation and
support professionals who can quickly address an organizations business needs.
Since the companys inception, Envision has had tremendous growth. The privately held company hasexperienced a growth rate that has more than doubled in the last few years. Additionally, Envision was
named as one of the nations fastest growing private companies by Incmagazine two years in a row,
ranking #107 on the 2002 prestigious Inc500 list. This recognition by Incmagazine comes in the
midst of impressive momentum across all business sectors with the success of its Click2Coach
product suite.
The company is led by its founder and CEO, Rodney Kuhn, a pioneer in the field of CTI and call center
technology. Kuhn helped develop computer telephone standards while developing CTI-enabled voice
About the Sponsor
-
8/6/2019 BOK Chapter
26/32
24 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
messaging products for Active Voice, a leading manufacturer of voice processing systems. The prod-
uct has since received several industry awards, including Product of the Year and Editors Choice
distinctions, and provides the technology behind some of the most customer-focused call centers in
the nation.
In addition to providing companies with effective and innovative contact center solutions, Envision
strives to align itself with technologically advanced partners who will improve the performance,
experience and implementation of solutions for the entire contact center. Forming strategic allianceswith leading companies, such as Aspect, Edify, and Cisco, allows Envision to set new performance
standards for the contact center industry and create new ways to improve the effectiveness of agent-
customer interactions.
Click2Coach is certified for Aspect, Intecom, Rockwell, Avaya, Nortel, Concerto, and Siemens plat-
forms. In addition, Envision supports standard hardware manufacturers such as Compaq, Hewlett-
Packard, Dell, and IBM.
-
8/6/2019 BOK Chapter
27/32
25
Glossary of Terms
ACD: Automatic Call Distributor. A device that forwards incoming calls to the next available TSR or
answering position.
After Tax Net Income (Earnings)::::: Net Income before taxes minus income taxes.
Automated Self-Service Options: Refers to system features that permit a caller to obtain serviceresponse without being connected to a live CSR; For example, request a Fax, obtain account informa-
tion, place an order, etc. through an automated system.
Automated Voice Recognition: Technology that enables a caller to verbally speak to an automated
voice response system (IVR) instead of using a phone keypad; for instance, to ask questions, make
requests, respond to questions, etc.
CTI: Computer-Telephony Integration refers to the linkage of a telephone switch (ACD, PBX) and
computer systems to enhance call processing. Common applications include screen pop, simulta-
neous voice and data transfer, and IVR.
Earnings Per Share: After Tax Net Income (Earnings) divided by the total number of sharesoutstanding.
Gross Margin: Revenue minus the cost of goods and services sold (also known as gross profit).
Integrated CSR Desktop: Refers to a CSR workstation that is configured to provide ease of navigation
to CSRs across multiple application screens and windows as part of a CTI system.
IVR: Interactive Voice Response. Technology that allows a caller making an inbound call to interact
with the data systems by responding to a menu of options. Responses are typically entered by pressing
the keys on the telephone keypad; however, voice recognition is becoming more commonly integrated
into the process, thus providing a more useful tool.
Net Income (Earnings) Before Taxes: Net Operating Income minus interest and other non-operating
expenses.
Net Operating Income (NOI)::::: Income before deducting non-operating expenses such as interest and
income taxes. To calculate Net Operating Income, subtract operating expenses (sales and marketing
expenses + research and development expenses + administrative expenses + other operating expenses)
from Gross Margin.
Revenue: The total dollar amount collected for goods and services provided.
Skills-Based Routing: A feature of an ACD permitting incoming calls to be routed to specially skilled
CSRs based upon the type of call, type of caller, type of product or service, etc.
Web Chat: A Web site feature that allows for interactive keyboard communication with another person
or persons, i.e., an interactive written correspondence.
Glossary of Terms
-
8/6/2019 BOK Chapter
28/32
26 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
Authors Biographies
DrDrDrDrDr. Jon Anton. Jon Anton. Jon Anton. Jon Anton. Jon Anton (also known as Dr. Jon) is the director of benchmark research
at Purdue Universitys Center for Customer-Driven Quality. He specializes in
enhancing customer service strategy through inbound call centers, and e-
business centers, using the latest in telecommunications (voice), and com-
puter (digital) technology. He also focuses on using the Internet for external
customer access, as well as Intranets and middleware.
Since 1995, Dr. Jon has been the principal investigator of the Purdue University
Call Center Benchmark Research. This data is now collected at the
BenchmarkPortal.com Web site, where it is placed into a data warehouse that
currently contains over ten million data points on call center performance.
Based on the analysis of this data, Dr. Jon authors the following monthly
publications: The Purdue Page in Call Center Magazine, Dr. Jons Benchmarks in Call Center News,
Dr. Jons Industry Statistics in Customer Interface Magazine, and Dr. Jons Business Intelligence in
the Call Center Managers Report.
Dr. Jon has assisted over 400 companies in improving their customer service strategy/delivery by thedesign and implementation of inbound and outbound call centers, as well as in the decision-making
process of using teleservice providers for maximizing service levels while minimizing costs per call. In
August of 1996, Call Center Magazine honored Dr. Jon by selecting him as an Original Pioneer of the
emerging call center industry. In October of 2000, Dr. Jon was named to the Call Center Hall of Fame.
In January of 2001, Dr. Jon was selected for the industrys Leaders and Legends Award by Help Desk
2000. Dr. Jon is also a member of the National Committee for Quality Assurance.
Dr. Jon has guided corporate executives in strategically re-positioning their call centers as robust
customer access centers through a combination of benchmarking, re-engineering, consolidation,
outsourcing, and Web-enablement. The resulting single point of contact for the customer allows
business to be conducted anywhere, anytime, and in any form. By better understanding the customerlifetime value, Dr. Jon has developed techniques for calculating the ROI for customer service initia-
tives.
Dr. Jon has published 96 papers on customer service and call center methods in industry journals. In
1997, one of his papers on self-service was awarded the best article of the year by Customer Relationship
Management Magazine.
Dr. Jon has published eighteen professional books:
Offshore Outsourcing Opportunities, The Anton Press, 2002
Optimizing Outbound Calling: The Strategic Use of Predictive Dialers, The Anton Press, 2002
Customer Relationship Management Technology: Building the Infrastructure for Customer Collaboration,The Anton Press, 2002
Customer Obsession: Your Roadmap to Profitable CRM, TheAnton Press, 2002
Integrating People with Processes and CRM Technology, The Anton Press, 2002
Selecting a Teleservices Partner, The Anton Press, 2002
How to Conduct a Call Center Performance Audit: A to Z, The Anton Press, 2002
-
8/6/2019 BOK Chapter
29/32
27
20:20 CRM A Visionary Insight into Unique Customer Contact, The Anton Press, 2001
Minimizing Agent Turnover, The Anton Press, 2001
e-Business Customer Service, The Anton Press, 2001
Customer Relationship Management, The Bottom Line to Optimizing Your ROI, Prentice Hall, 2nd
Edition, 2001
Call Center Performance Enhancement Using Simulation and Modeling, Purdue University Press, 2000
Call Center Benchmarking: How Good is Good Enough, Purdue University Press, 1999
Listening to the Voice of the Customer, Alexander Communications, 1997
Contact Center Management by the Numbers, Purdue University Press, 1997
Customer Relationship Management: Making Hard Decisions with Soft Numbers, Prentice-Hall, Inc.,
1996
Inbound Customer Contact Center Design, Dame Publishers, Inc., 1994
Computer-Assisted Learning, Hafner Publishing, Inc., 1985
Dr. Jon is the editor for a series of professional books entitled Customer Access Management, pub-
lished by the Purdue University Press.
Dr. Jons formal education was in technology, including a Doctorate of Science and a Master of Sci-
ence from Harvard University, a Master of Science from the University of Connecticut, and a Bachelor
of Science from the University of Notre Dame. He also completed a three-summer intensive Executive
Education program in Business at the Graduate School of Business at Stanford University.
Dr. Jon can be reached at (765) 494-8357 or at [email protected].
Authors Biographies
-
8/6/2019 BOK Chapter
30/32
28 Improving Agent Performance through Monitoring, Coaching, and Just-in-Time Training
R. Scott Davis is the Director of Product Validation Studies at
BenchmarkPortal. An industry pioneer, Scott first began working with call
centers in 1971, when he was instrumental in the development of an
operator scheduling system for McDonnell Douglas Automation Com-
pany. This system was the genesis of EDSs Visual FMS, which is still
widely used today.
In April 1976, Scott co-founded the Affinitec Corporation in St. Louis.Affinitec delivered the first computer-based call center management
reporting system, the Force Analyzer. Under Scotts leadership, Affinitec
became a major supplier of Work Force Management Systems. Among its many accomplishments,
Affinitec was the first company to offer comprehensive CSR performance reporting which merged a)
productivity data from the ACD with b) quality data derived from CSR monitoring and c) schedule
adherence data. Affinitec was the first company to offer real time CSR adherence displays. Affinitec
products were deployed in hundreds of call centers including AT&T, American Express, Wachovia
Bank, Maritz, New Zealand Telephone. The products integrated with leading ACDs manufactured by
Lucent, Rolm, Northern Telecom, Aspect, NEC, and Rockwell.
Scotts passion is identifying and quantifying the case studies of the ROIs realized by organizationswho create innovative sales and service strategies taking advantage of call center technologies and
management practices. Scott often lectures at leading call center conferences on topics such as:
1. Developing a Contact Center Performance Improvement Roadmap,
2. Measuring the ROI of Contact Center Performance Improvement Initiatives,
3. Benchmarking Your Contact Center,
4. Balancing Technology and Management in Call Centers, and
5. Employee Measurement and Motivation.
Scotts education includes a BA in Mathematics from Vanderbilt University, and a fast-track execu-
tive education program in Business Administration from Columbia University.
-
8/6/2019 BOK Chapter
31/32
29
John Chatterley is International Call Center Certification Director at
BenchmarkPortal, Inc. In this capacity, he is in charge of working with
multi-national companies to benchmark and improve their call center
performance up to a level where they can attain the coveted Purdue
University Certification as a Center of Excellence. Mr. Chatterley also
specializes in benchmarking certification, best practices, facilities design,
site selection, and offshore outsourcing for the customer contact com-
munity. John is a Purdue Certified Contact Center Auditor, Certified AT&T
Call Center College Instructor, BenchmarkPortal Certified Benchmarking
Instructor and Analyst.
John has edited and published numerous research reports, customized benchmarking reports, and
white papers, including a report on the power utilities industry. Mr. Chatterley is the author of a study
entitled Improving Contact Center Performance through Optimized Site Selection. Mr. Chatterley is
also the content editor of a recently published book entitled Selecting a Teleservices Partner, and co-
author with Dr. Jon Anton of a new book entitled Offshore Outsourcing Opportunities.
Prior to joining BenchmarkPortal, Mr. Chatterley was Director of Site Development and Facilities
Management and Call Center Manager for MicroAge Teleservices, a Fortune 500 call handlingoutsourcing company. Mr. Chatterley designed, implemented, staffed and managed three 500+ seat
call center sites in Arizona, Nevada, and California, and has extensive call center operational manage-
ment experience.
Johns professional career spans more than 20 years of experience in call center technical customer
support and service. He has first-hand experience at all levels of a call center including technical
support CSR, supervisor, team lead, analyst, designer, call center manager, operations director, and
facilities designer.
Johns professional education was in Engineering & Computer Science at Southern Utah State Univer-
sity, and subsequently at the University of Utah.
Authors Biographies
-
8/6/2019 BOK Chapter
32/32
www.envisiontelephony.com