tips and tricks for benchmarking dsm measures, programs ... · web conference december 6, 2018....

www.esource.com

Tips and Tricks for Benchmarking DSM Measures, Programs, and Portfolios

Web conference

December 6, 2018

Rachel Reiss BuckleySenior Director, E Source

© 2018 E Source | www.esource.com 2

Today’s agendaOverview of using E Source for benchmarkingPortfolio benchmarkingMeasure benchmarkingProgram benchmarkingBudget benchmarkingProgram metricsNext steps


Today’s speakersRachel Reiss BuckleySenior DirectorCustomer Energy Solutions

Liza MinorData AnalystCustomer Energy Solutions

Kate MersonDirectorCustomer Energy Solutions


Why benchmark?

I want to make sure our portfolio is on par with our peer utilities’ portfolios. Plus, my superiors like having insights about how we compare.

DSM executive


Why benchmark?

I want to make sure that the programs we approve: Are in the best interest of

ratepayers Keep up with

the industry Produce the

most benefits for the least cost

Regulator


Program manager

I’m focused on continuously improving the program I oversee and want to make sure I’m not missing any opportunities for more savings.

Why benchmark?


DSM benchmarking with E Source

Syndicated, semicustom Service bureau

TechnologyAssessmentService

Demand-Side ManagementService

Self-service



Time frame

Dep

th

Shallow

Deep

Hours Weeks Months


Self-service with DSM Insights

www.esource.com/dsminsights

http://www.esource.com/dsminsights


DSM Insights contents

Utility profile

Customer counts

Sales

AMI penetration

Impacts

kW, kWh, therm

Plan versus actual

Spending

Plan and actual

Per program

Budget breakdown

Cost-effectiveness

Benefit-cost ratios

$/kW, kWh, therm

Evaluation

Net-to-gross/

attribution

Realization


Self-service with Measure Insights

Compiles TRM DATA into astructured online database

of measure-specific assumptions and inputs to base DSM program calculations on


The Demand-Side Management Service helps you by …

Benchmarking and analyzing programs and portfolios

Answering your questions

Facilitating networks and discussion among utility peers


The Technology Assessment Service provides …


E Source DSM services

Technology Assessment Service

Demand-Side Management Service

Residential & Business Marketing Services

Assesses market and savings potential of DSM and distributed

energy resource (DER) measures

Optimizes program design,

implementation, and evaluation

What savings can we expect from HPWHs? Is the market ready?

DescriptionService Example

How does our program compare

to others? What are best practices to achieve savings?

Drives deeper participation

through customer-focused marketing

Which customers should we target? What marketing

tactics work?


Demand-Side Management Service

Identify portfolio and program gaps via benchmarking data

Optimize program design and validate program changes

Enhance program-implementation strategies

Develop RFPs and select high-performing vendors

Justify regulatory and policy decisions

Identify emerging program designs

E Source research servicesTechnology Assessment Service

Identify and vet emerging technologies

Assess the market readiness of DSM and DER technologies

Assess the technical potential of DSM and DER measures

Optimize the product-development process

Identify gaps in measure-level offerings via tech roadmapping


Research on demand

Custom research

3,000+ answered annually

Expert access

Ask E Source

www.esource.com/questions

http://www.esource.com/questions


E Source DSM consulting solutionsInnovation beyond current offerings

Insight into evolving competitive business models

Development of portfolio-gap analysis

Holistic visibility into peer utilities’ programs

Deep understanding of the utility residential and commercial customer landscape

1

2

3

4

5


DSM gap analysis consultingCompare yourself to others by

tapping into E Source’s benchmarking capabilities,

identify top performers and what they are doing well, and learn what can be implemented in

your territory.

Benchmarking can include a variety of performance metrics:

savings, participation, cost-effectiveness, budgets/spending,

meeting goals, etc.

Comprehensive market scan of DSM portfolios, programs, and technologies

Comparison against peers and leaders

Exclusive insights into lessons learned from best-in-class peers

Market-level data to inform customer-centric programs

© 2018 E Source | www.esource.com 19© 2018 E Source | www.esource.com 19

Portfolio benchmarking


$ dashboard in DSM Insights

© E Source (DSM Insights)


DSMi+EIA dashboard TIPS

This dashboard combines data from EIA Form 861 and annual report information found in DSM Insights to show benchmarking analytics.



Industry spending, 2010–2018

https://www.esource.com/10044-007/total-planned-dsm-spending-will-decline-through-2020


State policy and spending trendsIncreases New York Missouri Virginia Illinois California New Jersey

Decreases Iowa Kentucky Arizona


Average spending change by utility

1

5

8

11

52

7

14

6

3

12

0 20 40 60 80 100

Decrease by 70% to 80%




Increase by 10% to 20%





Increase by more than 100%

Number of program administrators

Perc

enta

ge c

hang

e

© E Source (DSM Insights)Base: n = 119.


What are the most consecutive years a utility has achieved 2% energy savings with DSM/energy efficiency?

1

1

1

1

3

4

4

5

5

5

0 1 2 3 4 5 6

Pacific Gas and Electric Co. (CA)

SDG&E (CA)

Southern California Edison (CA)

ComEd (IL)

Otter Tail Power Co. (MN)

Eversource (MA - NSTAR)

Unitil (MA)

National Grid (MA)

Eversource (MA - Western Massachusetts Electric)

National Grid (RI)

Number of years

Util

ity

Top 10 IOUs that have consecutive years with savings greater than 2% MWh sales

© E Source


Which utilities achieved the highest DSM/energy-efficiency savings in the past 10 years (by % sales)?

0.0%

1.0%

2.0%

3.0%

4.0%

5.0%

2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017

Average savings as percentage of sales (MWh) among top 10 investor-owned utilities, 2010–2017

© E Source

Top 5 Average %

Eversource (MA) 2.8%

National Grid (MA) 2.2%

Eversource (MA – WMECo) 2.0%

National Grid (RI) 1.8%

PG&E (CA) 1.7%

Among IOUs, Eversource (NSTAR) in Massachusetts has had the highest average savings as a percentage of sales (2.8%); its energy-efficiency reporting only goes back to 2014, having achieved more than 2% savings in each of the past four years. National Grid in MA and Eversource (WMECo), also in MA are the only two other utilities to average more than 2% over the period of years reported from 2006 to 2017.


What utilities achieved the highest DSM/ energy-efficiency savings in the past 10 years (by % sales)?

0%

1%

2%

3%

2010 2011 2012 2013 2014 2015 2016 2017

Perc

enta

ge o

f sal

esAverage savings as a percentage of sales (MWh) among top 10 IOUs,

2010–2017

© E Source

Since 2010, the average percentage of sales (MWh) achieved by the top 10 utilities (ranked by savings as percentage of sales) has grown from 1.5% in 2015 to 2.6% in 2017. This represents an increase of close to 70% in the average percentage of sales saved over seven years.


Top 10: Savings as percentage of sales achieved each year from 2014–2017

National Grid (MA) 4.1%National Grid (RI) 3.5%ComEd (IL) 3.3%Eversource (MA - NSTAR) 2.8%SDG&E (CA) 2.5%KCP&L (MO) 2.1%Xcel Energy (MN) 2.1%United Illuminating (CT) 1.8%KCP&L GMO (MO) 1.8%Pacific Gas and Electric Co. (CA) 1.8%Grand total 2.6%

Duke Energy Carolinas (SC) 4.3%National Grid (MA) 3.8%Eversource (MA - WMECo) 3.3%National Grid (RI) 3.1%Eversource (MA - NSTAR) 3.0%Otter Tail Power Co. (MN) 2.2%Public Service of New Hampshire (NH) 2.1%Unitil (MA) 2.1%UniSource Energy Services (AZ) 2.0%ComEd (IL) 2.0%Grand total 2.8%

National Grid (MA) 3.6%National Grid (RI) 3.3%Eversource (MA - WMECo) 3.3%Eversource (MA - NSTAR) 2.9%Unitil (MA) 2.1%Otter Tail Power Co. (MN) 2.0%UniSource Energy Services (AZ) 2.0%Tucson Electric Power (AZ) 1.9%ComEd (IL) 1.7%SDG&E (CA) 1.7%Grand total 2.4%

Eversource (MA - WMECo) 3.8%National Grid (RI) 3.5%National Grid (MA) 2.9%Eversource (MA - NSTAR) 2.6%Unitil (MA) 2.1%Otter Tail Power Co. (MN) 2.0%ComEd (IL) 1.9%Delmarva Power (MD) 1.8%Pepco (MD) 1.8%Pacific Gas ad Electric Co. (CA) 1.8%Grand total 2.4%

2014 2015

20172016


What utilities had the highest DSM/energy-efficiency savings (MWh) in the past 10 years?

367,774

404,985

451,187

470,331

473,685

592,605

628,760

1,160,787

1,191,816

1,493,525

0 200,000 400,000 600,000 800,000 1,000,000 1,200,000 1,400,000 1,600,000

PPL Electric Utilities (PA)

Xcel Energy (MN)

National Grid (MA)

AEP Ohio (OH)

Duke Energy (NC)

Eversource (MA - NSTAR)

DTE Energy (MI)

ComEd (IL)

Southern California Edison (CA)

Pacific Gas and Electric Co. (CA)

Average reported first-year savings (MWh)

Top 10 IOUs average reported (incremental) MWh savings, 2006–2017

© E SourceNote: MWh = megawatt-hours.


Measure benchmarking


TRM Coverage dashboard in Measure Insights

View measures across jurisdictions to determine: Most common (benchmarking) Least popular (new opportunities)

First time ever compiled in the industry


TRM Values dashboard in Measure Insights

© E Source (Measure Insights)


Notes: kWh = kilowatt-hours; TRM = technical reference manual. © E Source

Benchmarking smart thermostat savings

https://www.esource.com/tas-1700004-001/smart-thermostat-energy-savings-vary-among-trms


Benchmarking measure life

Note: TRM = technical reference manual. © E Source (Measure Insights)

https://www.esource.com/tas-1700009-012/persistence-smart-thermostat-savings


Custom measure benchmarkingObjectives

Measures and metrics

Realization rate Effective useful life Energy savings

Look for measures not included in a specific TRM

Compare the inputs of a specific measure across multiple TRMs


Advanced power strips benchmarking


Program benchmarking


Benchmark My Program

Redesigned user experience makes it even easier to pull data from one report instead of having to go to multiple dashboards to find your answer. See all metrics for a program category in a single report.


School kit program benchmark

Findings: Typically offered to receptive 4th through 8th grade students Utility brand recognition, reaches underserved communities, cross-

promote programs Smart strips, LEDs, showerheads, and aerators have highest savings Smart strips and LEDs are new editions (high installation rate of plug-

in measures) Recommendations: opt-out program, focus on measures with high

installation rates, give rewards, and use gamification


Most common measures in school kits

School kit measure Frequency

Showerhead 22

LEDs 20

Kitchen faucet aerator 19

Bathroom faucet aerator 16

Digital thermometer 9

Water flow rate test bag 9

LED night light 8

Shower timer 7

Smart power strip 4


Other program benchmarks tocheck out Direct Load Control Program Benchmark Best-in-Class Residential DSM Programs Best-in-Class Commercial DSM Programs

https://www.esource.com/dlc

https://www.esource.com/10257-001/best-class-residential-dsm-programs

https://www.esource.com/10257-002/best-class-commercial-dsm-programs


Common utility offerings Weatherization programs with

standard measures Implemented by contractors/service

agencies Embedded or associated programs that

perform health and safety checks or repairs to enable energy efficiency

Energy bill assistance

Low-income program market scan

Source: iStock


Low-income program market scan

Unique utility offerings Duke: NES Program ACE Energy: Using technology

for customer education SMUD: Low-income

prioritization (4 groups) PSE: Explores methods for

additional measures/structuresSource: iStock


Other noteworthy aspects

SMUD: Using smart meter data to develop a unit-specific bundle of measures to offer the customer

PSE: Cost-effectiveness requirement

SMUD, PSE, Duke: More utilities now including or piloting energy-efficiency programs for manufactured homes

Source: iStock


Budget benchmarking


Budget Details dashboard in DSM Insights

Across multiple administrators

For one portfolio


Average marketing spending across the industry

Planned utility DSM marketing spending as a percentage of total budget, 2016–2020

1.51.4

1.3

0.9

0.7

0.0

0.2

0.4

0.6

0.8

1.0

1.2

1.4

1.6

2016 2017 2018 2019 2020

Aver

age

spen

ding

as

perc

enta

ge o

f bud

get

© E Source (DSM Insights)Base: n = 105.


How much do utilities spend on evaluation?

The answer is 2%.

https://www.esource.com/dsmi-rb-1-evaluation-spend/how-much-do-utilities-spend-evaluation


Program metrics


EM&V dashboard in DSM Insights



Top commercial custom programs based on net-to-gross (NTG) ratio

https://www.esource.com/csm-1700001-001/building-resilient-custom-ci-programs


Searchable database featuring

impact and process evaluationsfor energy-efficiency and demand-response programs

from utilities across the US and Canada, organized by geography, date, author,

administrator, and implementer.



Syndicated, semicustom Service bureau

TechnologyAssessmentService

Demand-Side ManagementService

Self-service


Next stepsLog into DSM Insights and Measure Insights. Let us know if you need training.

Submit an Ask E Source request.

Search the research library.

Set up time to talk with us.

Make sure you’re signed up for weekly alerts and monthly newsletters.


Coming soon…

Market trends in low-income

DSM

Shifts in DSM organizational

structures

State of the upstream / midstream portfolio

Programs

DSM tracking systems


DSM Peer Sharing Calls Topics Covered New-construction programs

Trade allies

Small business programs

Gas DSM programs

Multifamily programs

Behavioral programs

Strategic energy management

Electric vehicles

Smart thermostats

Midstream programs

Setting rebate levels

Low-income programs

Customer experience

Contact center services

Paperless billing adoption

Smart home working group


We’d love to work closely with you!

Rachel Reiss BuckleySenior DirectorCustomer Energy [email protected]

Liza MinorData AnalystCustomer Energy [email protected]

Kate MersonDirectorCustomer Energy [email protected]

You're free to share this document in its entirety inside your company. If you'd like to quote or use our material outside of your business, please contact us at [email protected] or 1-800-ESOURCE (1-800-376-8723).

mailto:[email protected]




tips and tricks for benchmarking dsm measures, programs ... · web conference december 6, 2018....

Documents