measuring learning roi on a shoestring budget
TRANSCRIPT
![Page 1: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/1.jpg)
measuring learning ROI on a shoestring budget
michael glazerlearning advisor
twitter: @mglazerweb: www.linkedin.com/in/learningpro
Source: Eole via Flickr
![Page 2: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/2.jpg)
How do YOU answer The Question?
Source: Adreanna via flickr
![Page 3: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/3.jpg)
“What’s the ROI on your training programs?”
![Page 4: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/4.jpg)
let’s take a look at an example:
a training program for improving writing skills
![Page 5: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/5.jpg)
• 50 people completed 3 writing skills courses
• 200 total training hours for students
• 3.5 of 4.0 on participant satisfaction
• 3.9 of 4.0 on course materials
would you be more likely to convince your colleagues that training makes a valuable business impact by using data like this:
![Page 6: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/6.jpg)
or data like this:
• Saved $7,000: 10 directors and MDs report a 10% drop in the amount of time they spend making “unnecessary” edits to press releases written by the 50 people who completed writing skills training. Directors and MDs attribute half of the improvement to training.
• Recovered 25 billable hours (valued at $3,750): Participants report, on average, a 40% decrease in the number of final drafts returned to them by directors and MDs for additional edits.
• 60% of training participants’ supervisors report that the tone of client feedback regarding press releases has become more positive
![Page 7: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/7.jpg)
what’s the difference?
![Page 8: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/8.jpg)
the first set of metrics focuses on the
training program itselfSource: gonzoles2010 via flickr
![Page 9: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/9.jpg)
the second set looks
at how training
makes a business
impact
Source: A.Connah via flickr
![Page 10: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/10.jpg)
source: michele_cat via Flickr
a simple three-part
framework can help us find the metrics that matter
most.
![Page 11: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/11.jpg)
first is Organizational Metrics
• these metrics answer the question “how are we helping the firm meet its business goals?”
![Page 12: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/12.jpg)
Source: gthomasbower via flickr
the second is Learner Metrics
• these metrics describe how we help people gain or master skills and knowledge
![Page 13: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/13.jpg)
the third is Training Department Metrics
• these metrics tell us how well are we designing and delivering our training programs
Source: elston via flickr
![Page 14: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/14.jpg)
when used well together, these metrics help us answer The Question.
![Page 15: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/15.jpg)
so, you might be asking yourself, “This sounds good in theory, but how do I put it into
practice?”
![Page 16: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/16.jpg)
by using a practical five-step approach
![Page 17: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/17.jpg)
source: Sebastian-Dario via Flickr
1: get smart
• ask questions that clue you in to the central issues, their symptoms and root causes
![Page 18: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/18.jpg)
Questions: Organizational Metrics
• What are you trying to accomplish? Why does it matter to the organization?
• What are (have been / will be) the observable impacts caused by these issues? By their solutions?
• Describe the type of outcome you want to achieve.
• Do you think training will help? What issues, if any, can’t be addressed through training?
Source: Anua22a via flickr
![Page 19: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/19.jpg)
Source: Anua22a via flickr
• Which groups of employees are involved? Which aren’t involved?
• Describe what you see happening when [business issue] takes place?
• What are the 2-3 most important things employees need do to in order to achieve the desired outcome?
Questions: Learner Metrics
![Page 20: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/20.jpg)
Source: Anua22a via flickr
• What parameters or requirements do we need to consider for the program design and delivery?
• What do we want learners and other stakeholders to say or believe about their learning experience?
Questions: Training Dept. Metrics
![Page 21: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/21.jpg)
• The second step is to define success.2: Define Success
source: Essjay is happy in NZ via Flickr
• couch the success measures in the language of the business.
• use a template to help you organize information
![Page 22: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/22.jpg)
you can also repurpose the information for other uses
Source: matsuyuki via flickr
![Page 23: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/23.jpg)
3: make a measurement plan
source: canonsnapper via Flickr
![Page 24: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/24.jpg)
• training-driven data, like post-event and follow-up surveys
• business-driven data, like financial/productivity reports and client satisfaction surveys
data for the plan usually comes from two types of sources
Source: Will Scullin via flickr
![Page 25: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/25.jpg)
regardless of where you source your data, make sure you have the resources you need before training
starts. and…
Source: cobalt123 via flickr
![Page 26: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/26.jpg)
…make a business contract with your internal clients
![Page 27: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/27.jpg)
Source: nickwheeleroz (on holiday) via flickr
4: design the training
• use the Get Smart info to shape the training content and how it is delivered
![Page 28: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/28.jpg)
validate alignment between the training plan and the success metrics to raise the likelihood of achieving good results
Source: Aiden Jones via flickr
![Page 29: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/29.jpg)
5: measure and communicate the results
• the key to measuring is getting the data (duh)
![Page 30: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/30.jpg)
but collecting the data gives us only
half of what we need to answer
The Question
Source: justmakeit via flickr
![Page 31: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/31.jpg)
sour
ce: m
oriza
via
Flic
kr
once we collect and analyze the data, we still have to communicate it
![Page 32: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/32.jpg)
key messages are built on the metrics
we chose in the define success
step…
sour
ce: d
cmas
ter v
ia F
lickr
![Page 33: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/33.jpg)
…and the key audiences to whom we communicate them fall into our three
framework categories
Source: Peter E. Lee via flickr
![Page 34: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/34.jpg)
the channels you use to deliver
your key messages are important, too.
Source: CasaDeQueso via flickr
![Page 35: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/35.jpg)
more importantly…
![Page 36: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/36.jpg)
communicate the results proactively and frequently
source: Thomas Hawk via Flickr
![Page 37: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/37.jpg)
Why?
![Page 38: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/38.jpg)
to help you answer The Question
source: crossfrontiers via Flickr
![Page 39: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/39.jpg)
or better still…
![Page 40: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/40.jpg)
to avoid having it asked in the first place
source: Kari Marie via Flickr
![Page 41: measuring learning ROI on a shoestring budget](https://reader036.vdocuments.us/reader036/viewer/2022062708/55890887d8b42ab8748b4674/html5/thumbnails/41.jpg)
twitter: @mglazerweb: www.linkedin.com/in/learningpro
michael glazerlearning advisor