using leading indicators to drive sustainability performance

7
Environmental Quality Management / DOI 10.1002/tqem / Summer 2009 / 87 Robert B. Pojasek QUALITY TOOLBOX Using Leading Indicators to Drive Sustainability Performance Companies tend to report their sustain- ability results (both internally and ex- ternally) with the idea that these mea- surements provide a strong indication of their sustainability performance. In fact, the outcomes reported are often referred to as performance results, sustain- ability indicators, or key performance indicators (KPIs). However, these results just reflect the out- come of performance. They do not actually mea- sure performance in a direct way. When this is pointed out, sustainability professionals usually nod their heads, roll their eyes—and go right back to touting their results. Results Versus Leading Indicators This focus on results is a common feature of sustainability reporting. The Global Reporting Initiative (GRI) has 79 results that companies often use in their sustainability reports. There are a number of other organizations that focus on environmental and social governance (ESG) criteria from an investor’s perspective. Together with the International Federation of Accountants (IFAC), these groups focus entirely on select KPIs in sustainability reports. None of these groups are considering the use of leading indicators to drive sustainability per- formance. By con- trast, leading indica- tors are an inherent part of business excellence frame- works, such as the Baldrige National Quality Program in the United States. With some 75 business excellence frameworks currently in use around the world, it is amazing that there is almost no recognition of their work in the sustainability field. Most of these business excellence frameworks make changes annually to take advantage of les- sons learned in the past year. Companies that use business excellence frameworks have been shown to financially outperform those who do not by a margin of more than two to one. In my last column, I discussed how to incor- porate leading indicators into sustainability re- porting. 1 This column provides more background about such indicators. Sustainability programs generally should seek to use and report on a mix of leading and lagging indicators. Before explaining how to use leading indica- tors, it is useful to review some background on lagging indicators. Responding to changing circumstances and improving future performance © 2009 Wiley Periodicals, Inc. Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/tqem.20228

Upload: sl1828

Post on 07-Nov-2014

108 views

Category:

Documents


3 download

DESCRIPTION

Leading indicators can be used tomonitor the effectiveness of controlsystems and give advance warningof any developing weaknessesbefore problems appear.

TRANSCRIPT

Page 1: Using Leading Indicators to Drive Sustainability Performance

Environmental Quality Management / DOI 10.1002/tqem / Summer 2009 / 87

Robert B. Pojasek

QUALITY TOOLBOX Using Leading Indicators to Drive Sustainability Performance

Companies tend to report their sustain-ability results (both internally and ex-ternally) with the idea that these mea-surements provide a strong indication of their sustainability performance. In fact, the outcomes reported are often referred to as performance results, sustain-ability indicators, or key performance indicators (KPIs).

However, these results just reflect the out-come of performance. They do not actually mea-sure performance in a direct way. When this is pointed out, sustainability professionals usually nod their heads, roll their eyes—and go right back to touting their results.

Results Versus Leading IndicatorsThis focus on results is a common feature of

sustainability reporting. The Global Reporting Initiative (GRI) has 79 results that companies often use in their sustainability reports. There are a number of other organizations that focus on environmental and social governance (ESG) criteria from an investor’s perspective. Together with the International Federation of Accountants (IFAC), these groups focus entirely on select KPIs in sustainability reports.

None of these groups are considering the use of leading indicators to drive sustainability per-

formance. By con-trast, leading indica-tors are an inherent part of business excellence frame-works, such as the Baldrige National Quality Program in the United States.

With some 75 business excellence frameworks currently in use around the world, it is amazing that there is almost no recognition of their work in the sustainability field.

Most of these business excellence frameworks make changes annually to take advantage of les-sons learned in the past year. Companies that use business excellence frameworks have been shown to financially outperform those who do not by a margin of more than two to one.

In my last column, I discussed how to incor-porate leading indicators into sustainability re-porting.1 This column provides more background about such indicators. Sustainability programs generally should seek to use and report on a mix of leading and lagging indicators.

Before explaining how to use leading indica-tors, it is useful to review some background on lagging indicators.

Responding to changing

circumstances and improving

future performance

© 2009 Wiley Periodicals, Inc.Published online in Wiley InterScience (www.interscience.wiley.com).DOI: 10.1002/tqem.20228

Page 2: Using Leading Indicators to Drive Sustainability Performance

Robert B. Pojasek88 / Summer 2009 / Environmental Quality Management / DOI 10.1002/tqem

But this represents a strictly reactive approach to sustainability since corrective action cannot be initiated until after the “bad” results have oc-curred. By contrast, leading indicators can help foster a more proactive and preventive approach to sustainability.

Understanding Leading IndicatorsLeading indicators provide information that

helps the user respond to changing circumstances and take action to either achieve desired outcomes or avoid unwanted outcomes. Their role is to promote action that corrects potential weaknesses without waiting for demonstrated failures. This ability to influence and improve future perfor-mance by guiding current actions is an important characteristic of leading performance indicators.

Leading indicators can be used to monitor the effectiveness of control systems and give advance warning of any developing weaknesses before problems appear. By measuring the degree to which best practices are being followed, leading performance indicators can complement the use of lagging indicators and compensate for some of their shortcomings.

A key purpose of leading performance indica-tors is to show the condition of healthy operating systems before accidents, incidents, harm, dam-age, or failures occur. In this way, they can help control operational risks and prevent accidents.

Leading indicators can also be used to mea-sure the inputs that people are making to pro-cesses. Used in this way, leading indicators can help promote a positive culture that seeks to improve performance.

Using Leading Indicators ProperlyLeading indicators should not be used simply

as metrics for current conditions. Instead, they should form part of an organizational initiative toward continual improvement of operating pro-cesses.

Lagging IndicatorsSustainability professionals have a decided

preference for “lagging” indicators that measure the final outcomes that result from their initia-tives. Although useful in many ways, these lag-ging indicators often do not provide enough information to guide future actions and ensure overall sustainability program success. They tend to emphasize doing “less of a bad thing.” Many are associated with regulatory compliance issues.

There are several reasons why lagging indica-tors may not be sufficient to address program performance. Among these reasons are the fol-lowing:

There is often a time delay between the sus-tainable actions we take and the outcomes that result. Lagging indicators may provide information too late for us to respond to is-sues that can arise.Outcomes may be the result of many factors.

When this is the case, lagging indicators can tell you how well you are doing, but may not offer useful infor-mation about what is causing your results or where to focus any corrective actions that

might be necessary to further improve per-formance.The outcome rates being measured may be so low that they do not provide adequate feed-back for effective management of processes.Lagging indicators may fail to reveal latent problems that have a significant potential to result in severe process upsets.

Lagging indicators may give the organization a basis for corrective action if the results they re-port deviate from the outcomes that are expected.

Leading indicators can be used to monitor the effectiveness of control systems and give advance warning of any developing weaknesses before problems appear.

Page 3: Using Leading Indicators to Drive Sustainability Performance

Environmental Quality Management / DOI 10.1002/tqem / Summer 2009 / 89Quality Toolbox

leading performance indicators must have if they are to be useful:

There must be a connection between the lead-ing indicators and the outcomes that are of interest.The reasons for using the indicators and the benefits they offer must be understood by line management and by the employees affected.The indicators must provide information that can guide fu-ture actions. They must either allow for actions that can improve desired outcomes or else provide warning of potential weak-nesses and allow for actions that can avoid undesired outcomes.

Requirements for Full EffectivenessIn addition, in order to be fully effective, lead-

ing indicators must:

relate to activities that are considered to be important for future performance,be amenable to intervention and influence by the group whose performance is being measured,relate to areas where there is scope to im-prove, andprovide a clear indication of a means to im-prove performance.

Leading Indicators and Business Excellence Frameworks

Because leading performance measures are used to influence future actions, it is important to make them part of an overall process improve-

There is good evidence that when leading indicators are used correctly, they are effective at improving performance. However, there is also good evidence that they can be misused.

For leading performance indicators to play an effective role in the improvement process, there must be a clear association between the inputs that the leading indicators are measuring and the lagging outputs that are desired. There also must be a reasonable basis for believing that the ac-tions taken to improve the leading indicators will be followed by improvement in the associated lagging output indicators.

Ensuring That Leading Indicators Are Effective

Ensuring the effectiveness of leading indica-tors is an integral part of business excellence frameworks. In these frameworks, results are carefully coordinated and aligned with the best practice descriptions used for leading indicators.

Basic RequirementsFor any leading performance indicator to be

effective, it must have certain characteristics. It should be:

objective and easy to measure (information associated with the indicator should not be hard to collect),relevant to the organization whose perfor-mance is being measured,able to provide immediate and reliable indica-tions of the level of performance,cost-efficient in terms of information collec-tion, andunderstood and “owned” by the group whose performance is being monitored.

Additional CharacteristicsIn addition to these general requirements,

there are some additional characteristics that

For leading performance indicators to play an effective role in the

improvement process, there must be a clear association between the

inputs that the leading indicators are measuring and the lagging

outputs that are desired.

Page 4: Using Leading Indicators to Drive Sustainability Performance

Robert B. Pojasek90 / Summer 2009 / Environmental Quality Management / DOI 10.1002/tqem

sue’s column) rather than create novel leading indicators.

Sample Leading Indicator: Creating a Positive Work Environment

Let’s look at an example of a leading indica-tor from the “people” category of the Australian Business Excellence Framework:2 “The organiza-tion should create a work environment that is engaging, positive, and open to foster creativity and unify the efforts of its employees. It can do so by encouraging people to learn, test what they see, improve their skills, and provide a good deal of challenge in their work.” The best practice includes:

Creating the right culture—The orga-nization creates a work environment with a strong performance ethic and leader-encouraged elements, including: trans-parency, inclusiveness, diversity, fairness, innovative thinking, and freedom from fear.

Building trust and respect—The or-ganization builds strong relationships through communication, trust, and re-spect. Policies are created that support consistent behavior in the way tasks and responsibilities are delegated.

Effective communication—The orga-nization encourages effective communica-tion that is open, top-down, bottom-up, and lateral. It has mechanisms for obtain-ing input from employees throughout the organization, including their perspective and needs. Feedback processes are well developed and monitored.

Establishing the physical work envi-ronment—The organization establishes a

ment effort. One of the best mechanisms for promoting process improvement is to adopt the business excellence approach.

While some organizations try to create their own leading performance indicators, others turn to one of the many available business excellence frameworks to find useful leading indicators. It is best not to “reinvent the wheel” here. By relying on a business excellence framework, the organi-zation can tap into the wisdom of business lead-ers from around the world.

Using this approach, the organization can assess its current situation to identify the areas of activity that present the greatest threat to per-

formance or the most opportunities for im-provement. They can then identify the sec-tions of the business excellence framework that best address those areas, and choose lead-

ing indicators accordingly. The leading perfor-mance indicators selected can be designed to focus on manageable portions of the organiza-tion’s problem areas.

Selecting Leading IndicatorsLast issue’s column identified 15 candidates

for leading performance indicators. These indica-tors can be described in terms of actions that the organization should be carrying out, allowing the best practice they represent to be conveyed in a proactive manner.

These leading indicators, which are derived from business excellence frameworks, have been reviewed on an annual basis by people who have used them in their organizations. Their collective “lessons learned” help keep the best practices up to date and ensure that they are clearly stated. For this reason, it is much better to use existing indicators (such as the ones discussed in last is-

By relying on a business excellence framework, the organization can tap into the wisdom of business leaders from around the world.

Page 5: Using Leading Indicators to Drive Sustainability Performance

Environmental Quality Management / DOI 10.1002/tqem / Summer 2009 / 91Quality Toolbox

There is an effective, systematic approach that is fully responsive to the elements covered in the best practice description.

Deployment:There is little to no deployment of any sys-tematic approach to the items that are de-scribed in the best practice.The approach is fully deployed without sig-nificant weakness or gaps in all areas and ac-tivities within the organization. The approach is totally integrated into normal operations and planning.

Results:There are only an-ecdotal results.There are positive trends in the results from all areas of the organization. There is active bench-marking of the results with external organi-zations. The results are clearly caused by the approach in all areas.

Improvement:There are no specific improvement methods used (e.g., lean, Six Sigma, or quality manage-ment). Improvements cited by management are anecdotal in nature.There is a proactive system for regular review and improvement of the approach and its de-ployment. There is widespread evidence that the organization is continuously learning.

Scoring Process The ADRI system works most effectively when

the elements are scored by trained assessors who are not evaluating their own organizations. Scor-ing is best accomplished using a team. The inher-ent subjectivity of the scoring process means that

workplace that is safe and in which people are provided with appropriate facilities and tools to do their work well.

It is interesting to note how many ISO 9001 (quality management standard) and ISO 14001 (en-vironmental management standard) requirements are included in this best-practice description.

You might think that stating these require-ments clearly is just good practice. It is! However, the “action” phrasing also allows the best practice to be used as a leading indicator.

But how are you going to measure any of this? That is where the ADRI scoring method comes in.

ADRI Scoring of Leading IndicatorsMany organizations shy away from leading

indicators because they worry that they cannot be quantified easily. One answer to this concern is the Australian Business Excellence Framework’s ADRI (approach, deployment, results, and im-provement) scoring method. ADRI helps quan-tify leading indicators so they can be compared, tracked, and trended over time.

With ADRI, an organization typically uses a loaded matrix that has the following headings in the top row: Score; Approach; Deployment of the Approach; Results of the Approach and Its Deployment; and Improvement of the Approach and Its Deployment.

Scoring RangeThe scoring range generally goes from zero

to ten. Listed below are the two end points (i.e., those associated with the worst and best scores) for each of the four ADRI elements.

Approach: There is no evidence that a planned approach has been considered, and there is a reactive attitude to problems associated with the area that is the subject of the best practice.

Many organizations shy away from leading indicators because

they worry that they cannot be quantified easily.

Page 6: Using Leading Indicators to Drive Sustainability Performance

Robert B. Pojasek92 / Summer 2009 / Environmental Quality Management / DOI 10.1002/tqem

For the “results” category, it is important that the organization have a systematic monitoring and measurement system in place. This is a re-quirement of virtually all management system standards. It is not sufficient to simply tally up some lagging indicators. The assessors need to see how the relevant data are collected and deter-mine the extent to which this information can be directly related to the approach and deployment activities associated with the particular leading indicator. They generally start with a score that is one level below the consensus deployment score, and then adjust up or down from that point.

Finally, the assessors score the “improve-ment” category. The company should be able to demonstrate that it has an organized process improvement program in place that works with the company’s overall business management sys-tem and with the business excellence framework. A previous “Quality Toolbox” column discusses how these systems can create the demand for lean and other process improvement methods.3

The Final ScoreAt the end, the separate scores for approach,

deployment, results, and improvement are added up and divided by four. The quotient is the final score for the leading indicator. Because the scores for the various indicators do not have units at-tributed to them, it is possible at the end to add all 15 leading indicator scores and divide by 15 to get one final score for all the leading indicators.

It should be noted that sustainability results are not scored using the ADRI method. A previ-ous installment of this column addresses the scor-ing of these results.4

Increasing Value With Leading IndicatorsLeading performance indicators can be found

in all the national business excellence frame-works, some of which have been in existence since 1987. Most of these frameworks are main-

group consensus scores are generally more useful than a score assigned by an individual.

The scoring process helps the group reach consensus on what is really being achieved within the organization. The assessors are also seeking to identify both strengths and opportunities for im-provement with respect to each leading indicator that is scored. This information is provided to the organization in the form of a feedback report at the end of the evaluation.

The team typically starts with the assump-tion that the organization is performing at the midpoint of the scoring range in the “approach” category. If the organization appears to be doing

better (or worse) than a score of 5, the as-sessors seek objective evidence of this—that is, they seek informa-tion showing that the organization is meet-ing the requirements of the matrix descrip-tion language that is

applicable to the higher (or lower) score. Then they seek consensus on a score, using objective evidence to support their claim.

Next, the assessors move on to the “deploy” column. For this category, they typically start with the assumption that the organization is per-forming at one level below the score assigned to the approach category. This makes sense because there is often a delay between having a good approach and being able to deploy it effectively throughout the organization.

Once again, the assessors use objective evi-dence to support their decision on a final score. In order to reach a scoring decision in this category, it generally is necessary for the assessors to walk through the organization’s facility and interview employees; this helps them determine the extent to which deployment has been successful.

The team typically starts with the assumption that the organization is performing at the midpoint of the scoring range in the “approach” category.

Page 7: Using Leading Indicators to Drive Sustainability Performance

Environmental Quality Management / DOI 10.1002/tqem / Summer 2009 / 93Quality Toolbox

for this purpose since the score for each indicator can be assured by an independent assessor, which tends to enhance the credibility of the report.

Moreover, leading indicators can be linked to lagging indicators. Both can be scored, and the scores can be added together to create an overall score representing the level of sustainability at-tained by the company.

Currently, organizations report on a very large number of lagging indicators, such as the dozens of results reported with GRI. Most people who prepare or use corporate reports will be happy to eliminate these. Leading indicators can now be used in cas-cading performance scorecards using the criteria in the business excellence frameworks. Sustainability dashboards will become a thing of the past.

With leading indicators, everyone in the or-ganization can see their scores and understand how their individual performance contributes to the overall performance of the organization. As more organizational leaders become familiar with leading indicators, there will be a growing trend toward using them to enhance transparency and accountability in sustainability programs.

Notes1. See Pojasek, R. B. (2009, Spring). Quality toolbox: Sustain-ability reports: An alternative view. Environmental Quality Management, 18(3), 85–92.

2. SAI Global. (2007). The business excellence framework. Sydney, Australia: SAI Global Publishing Limited.

3. See Pojasek, R. B. (2008, Summer). Quality toolbox: Creat-ing a complete business management system. Environmental Quality Management, 17(4), 87–95.

4. See Pojasek, R. B. (2003, Autumn). Quality toolbox: Scoring sustainability results. Environmental Quality Management, 13(1), 91–98.

tained by national quality associations. These groups have worked over the years to identify the factors that are important for improving an orga-nization’s overall operational performance and increasing employee engagement in improve-ment activities. All the frameworks recognize the importance of the three areas of concern that form the “triple bottom line” of sustainability: environment, social, and economic.

It has been demonstrated that providing posi-tive reinforcement for improvement activities is critical to ensuring the success of such activities. Leading indicators help improve the visibility of improvement activities. They also can increase the organization’s confidence that monitoring the indicators and their lagging results is actually making a difference.

The metrics associated with business excel-lence frameworks can be used to monitor indus-try performance regardless of the sector or size of the operation. They also provide a unique op-portunity for benchmarking against the practices of other companies worldwide that have used and benefited from the frameworks. A number of large companies have taken advantage of this op-portunity, using business excellence framework metrics for benchmarking at hundreds of their own facilities. The framework metrics can also be used on logistical corporate functions (such as en-vironmental, health and safety, purchasing, and human resources) and in the supply chain.

Leading indicators offer an excellent method for summarizing sustainability efforts in an organi-zation’s annual report. They are especially attractive

Robert B. Pojasek, PhD, is a senior associate with First Environment in Boonton, New Jersey. Dr. Pojasek’s most recent book is Making the Business Case for EHS (Business & Legal Reports, Inc.), for which he received the APEX writing ex-cellence award. He also is the recipient of the 2006 award for pollution prevention from the Canadian Pollution Prevention Roundtable, and the 2006 P2 Champion Award from the National Pollution Prevention Roundtable of the United States. Dr. Pojasek received the 2008 Petra T. Shattuck Excellence in Teaching Award from the Harvard Extension School, where he teaches a course on sustainable development at the local level. He can be reached by phone at 781-641-2422 or by e-mail at [email protected].