framing(&(defining(...
TRANSCRIPT
![Page 2: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/2.jpg)
HOT topic
![Page 3: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/3.jpg)
Know the language of your context
Metrics Value
Evalua:on Assessment
Measures
![Page 4: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/4.jpg)
Measure: info about what is
![Page 5: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/5.jpg)
Assess: test against a target
![Page 6: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/6.jpg)
Evaluate: judge the findings
![Page 7: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/7.jpg)
h=p://goo.gl/kJrzVw
Symptoms
Underlying causes
![Page 8: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/8.jpg)
What’s below the water causing the symptoms?
• We don’t tend to have a “culture of assessment”…
• Most “measures” convey past performance
• Difficult and complex
• Our “measures” don’t align with decision-makers
![Page 9: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/9.jpg)
We’ve learned that:
• Identifying & illustrating value depends on conversations with your stakeholders – …the first conversation shouldn’t be when measures are
presented
• “More” isn’t necessarily better – …in fact, “more” clouds the issue and the message
![Page 10: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/10.jpg)
Our frames & mental models
h=ps://goo.gl/WOjS7N
![Page 11: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/11.jpg)
Why should we frame this issue?
![Page 12: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/12.jpg)
• No one magic measure
• Successful organizations:
• clarity of purpose
• understand their culture
• performance measurement system that fits that culture
• “Value” is dynamic, economic, psychological & relative to alternatives
• Identifying outcomes & especially impact takes a long time & heavy duty analysis
![Page 13: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/13.jpg)
IT’S HARD
![Page 14: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/14.jpg)
Center for Investigative Reporting’s Frame
Non-profit media & their funders have been working on impact for years 4 “strands of the conversation”:
ü Standards ü Engagement ü Online analytics ü Offline activities
![Page 15: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/15.jpg)
Oh, those offline activities
“Because offline activities are messy and irregular and require staff and time to track, they are cast aside as, at best, qualitative data and, at worst, anecdotes. But qualitative data is data, and it is as valuable as quantitative data if it is collected and analyzed using rigorous methods.”!
![Page 16: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/16.jpg)
Impact CIR’s definition: Change in status quo @ macro, meso or micro levels
“we want to understand the relationship of convertibility among these outcomes. We are only beginning to think about how to quantify these interactions; this is not alchemy, but science – and maybe a little art. “
• Dissection • App in Podio
![Page 17: Framing(&(Defining( Metrics(for(Librariesdysartjones.com/wp-content/uploads/2015/05/Measurement-Institut… · Framing(&(Defining(Metrics(for(Libraries Rebecca Jones rebecca@dysartjones.com](https://reader033.vdocuments.us/reader033/viewer/2022051919/600b38951f1bc12ec3528aeb/html5/thumbnails/17.jpg)
Your frame
Your assumptions & beliefs about measurements now:
Ideas, discomfort, provoking
Ideas, discomfort, provoking
Your assumptions & beliefs about measurements at noon tomorrow: