learning from the past to inform future work - …...learning from the past to inform future work...
TRANSCRIPT
![Page 1: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/1.jpg)
1
Learning from the
Past to Inform
Future WorkTrends in Behavior Based
Efficiency Programs
Claire McIlvennie
Program Associate, Consortium for Energy Efficiency
SEE Action Webinar
December 16, 2015
![Page 2: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/2.jpg)
2
![Page 3: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/3.jpg)
3
Program administrators formed CEE:
To reach binational
markets
Accelerate market
uptake of efficient
products and services
Which achieves lasting
public benefit of
energy efficiency
![Page 4: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/4.jpg)
4
CEE supports market initiatives and
explorations with cross cutting functions
Residential Commercial Industrial
Evaluation, measurement and verification
Behavior change
New program design
Connectivity
Emerging technology
![Page 5: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/5.jpg)
5
Agenda for Today
What is the CEE Behavior Program Summary?
Results to Date
Future Work and Next Steps
![Page 6: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/6.jpg)
6
Background
Behavioral insights create
opportunities to drive energy savings
from efficiency programs BUT….
They also come with many questions,
uncertainties, and challenges.
How can we best support
the CEE membership to
succeed in this space?
![Page 7: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/7.jpg)
7
CEE Behavior Program Summary
What: Annual, online survey Summary Document
Who: CEE Member Organizations
Purpose: Serve as a resource for members and help
facilitate information exchange
Available since: 2010 (members), 2012 (public)
![Page 8: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/8.jpg)
8
What information do we collect?
Evaluation
Organization
Description
Program Duration
Location
Funding
Vendors/Contractors
Sector and Target
Audience
Insights
Savings
Program Components Program DetailsBehavior Insights
Strategies
Goals
Gamification (new!)
Two-way feedback (new!)
Type of Evaluation
Data Source/Metrics
Challenges
Key Takeaways Behavior Research Regulatory Requirements
Claiming Savings
Savings Goals
Savings Achieved
Persistence
Savings Attribution
![Page 9: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/9.jpg)
9
Using the Program Summary
Program Name
Filter by Behavior Insight
Filter by
Filter bySector
Target PopulationFilter by
![Page 10: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/10.jpg)
10
Using the Program Summary
“Social Norms” Filter by
2015 Public
Behavior Program
Summary
106 programs62 programs
Evaluation Complete & Claiming Savings
• 23 programs
Target Sector
• Residential (45), Commercial (8), Industrial (13)
Strategies: Provide Feedback
• Estimated (22), Enhanced Billing (25), Real-time (9)
Goals: Market Transformation
• 22 programs
![Page 11: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/11.jpg)
11
Methodology and Caveats
Caveats and Scope
• NOT a representative sample
• Select topics
Public
2012
2013
2014
2015
Master Behavior
Program SummaryCombine
Key Takeaways & Emerging Trends
Common Challenges
![Page 12: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/12.jpg)
12
Who is running behavior-based
programs?
178 Programs
83 program administrators
42 US States
1 CAN Province
99 Claiming Savings
Residential
Commercial
Industrial
Public
133 (75%)
55 (31%)
19 (11%)
16 (9%)
![Page 13: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/13.jpg)
13
Behavior Insights Used
45%
25%
37%
45%
9%
90%
43%
20%
39%
12%
25%26%
11%
21%
15%
39%
45%
52%49%
72%
8%
64%
4%
10%
28%
16%
8%
27%
56%
50%
63%
30%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
![Page 14: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/14.jpg)
14
Behavior Insights Used
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
90% - Feedback
![Page 15: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/15.jpg)
15
Behavior Insights Used
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
90% - Feedback 72% - Modeling Behavior
64% - Social Norms
63% - Prompts
![Page 16: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/16.jpg)
16
Behavior Insights Used
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
90% - Feedback 72% - Modeling Behavior
64% - Social Norms
63% - Prompts
56% - Goal
Setting
52% - Interpersonal
Communication50% - Priming
![Page 17: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/17.jpg)
17
Behavior Insights Used
Follow ThroughPerson-to-Person
Feedback
Easier to gain regulatory acceptance
Social Norms
Modeling
Interpersonal
Communication
Prompts
Priming
Goal Setting
![Page 18: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/18.jpg)
18
Behavior Insights Used
Are insights more effective when used in
combination?
![Page 19: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/19.jpg)
19
Evaluation
42% Complete
24% Planning/Underway
Type of EvaluationImpact – 85%
Process – 49%
ChallengesUncertainty regarding persistence – 31%
Data collection – 30%
Difficulty attributing savings – 26%
Sample Size – 21%
DesignExperimental – 49%
Non-Experimental – 27%
Quasi – Experimental – 9%
MetricsEnergy Savings – 75%
Customer Satisfaction – 62%
Awareness – 59%
Number of Participants Reached – 40%
Cost Savings – 35%
![Page 20: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/20.jpg)
20
Key Takeaways
Implementation
Tips
Program
Benefits
Savings &
Evaluation
CUSTOMER
![Page 21: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/21.jpg)
21
Key Takeaways: Implementation Tips
Planning
Ahead
Communication
& Marketing
Managing Data
& Technology
“Careful, early planning by engaging a multidisciplinary team (program team,
evaluation team, and regulators) at the outset is critical to a successful program
launch and execution.”
![Page 22: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/22.jpg)
22
Key Takeaways: Program Benefits
Energy
Savings
Customer
Satisfaction
Entry Point for
the Future
“Having an icon can help make an ‘invisible concept’
something concrete and visible.”
![Page 23: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/23.jpg)
23
Key Takeaways: Savings & Evaluation
Participant
Sample
“Maintaining no changes during program implementation can
prove to be a little difficult as more information about the program
emerges.”
Benefits and Challenges of Rigorous
EM&V Design
![Page 24: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/24.jpg)
24
Future Work and Next Steps
![Page 25: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/25.jpg)
25
Future Work and Next Steps
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Untapped opportunities to incorporate new insights to enhance
programs and drive savings across sectors
Future Opportunity
![Page 26: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/26.jpg)
26
Future Work and Next Steps
Rewarding Change Framing Efficiency
Connected Technology & Behavioral Insights
+ =
![Page 27: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/27.jpg)
27
Future Work and Next Steps
• Persistence – measurement, length
• Connected technologies
• Savings attribution
Key Areas to Watch
2016 Program Summary
Coming to our public
website in spring of
2016!
![Page 28: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/28.jpg)
28
Resources: Behavior Program Summary
http://library.cee1.org/content/2015-cee-behavior-program-
summary-public-version/
![Page 29: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/29.jpg)
29
Resources: Behavior at CEE
http://www.cee1.org/content/cee-behavior-work
![Page 30: Learning from the Past to Inform Future Work - …...Learning from the Past to Inform Future Work Author Claire McIIvennie Subject presentation on the trends in behavior-based efficiency](https://reader034.vdocuments.us/reader034/viewer/2022042300/5ecad70567650774826e5422/html5/thumbnails/30.jpg)
30
Contact
Claire McIlvennie
Program Associate
Evaluation, Research, & Behavior
Kira Ashby
Senior Program Manager
Behavior