effective communication of performance measures · 2 effective communication of performance...

47
1 Daniela Bremmer Daniela Bremmer Director, Strategic Assessment Office Director, Strategic Assessment Office Washington State Department of Transportation Washington State Department of Transportation TRB Third International Conference on Performance Measurement TRB Third International Conference on Performance Measurement Pre Pre - - Conference Workshop Conference Workshop Building a Successful Measurement System Building a Successful Measurement System September 9, 2007 September 9, 2007 Effective Communication of Performance Measures: Performance Journalism in Practice at the Washington State Department of Transportation

Upload: phamtu

Post on 29-Apr-2018

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

1

Daniela BremmerDaniela BremmerDirector Strategic Assessment OfficeDirector Strategic Assessment Office

Washington State Department of TransportationWashington State Department of Transportation

TRB Third International Conference on Performance MeasurementTRB Third International Conference on Performance MeasurementPrePre--Conference WorkshopConference Workshop

ldquoldquoBuilding a Successful Measurement SystemBuilding a Successful Measurement SystemrdquordquoSeptember 9 2007September 9 2007

Effective Communication of Performance MeasuresPerformance Journalism in Practice at the

Washington State Department of Transportation

2

Effective Communication of Performance Measures Challenges

bull There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

bull Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

3

WSDOTWSDOTrsquorsquoss Communication Approach Communication Approach Performance JournalismPerformance Journalism

bull WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

bull It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

bull WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

4

The Seven Principles of Performance JournalismThe Seven Principles of Performance Journalism

11 Good StoriesGood Stories

22 Good WritingGood Writing

33 Good DataGood Data

44 Good GraphicsGood Graphics

55 Good FormatPresentationGood FormatPresentation

66 Quality ControlQuality Control

77 Good TimingGood Timing

5

WSDOT Lessons Learned in Graphics WSDOT Lessons Learned in Graphics Formatting and PresentationFormatting and Presentation

bullbull Make communicating relevant and easyMake communicating relevant and easy--toto--understand understand measures text and graphs your number one prioritymeasures text and graphs your number one priority-- not not an afterthought once the data has been collectedan afterthought once the data has been collected

bullbull Graphical Displays shouldGraphical Displays shouldbullbull Show the dataShow the databullbull Make the viewer think about substance rather than about Make the viewer think about substance rather than about

methodology graphic design or the technology of graphic methodology graphic design or the technology of graphic productionproduction

bullbull Avoid distorting what the data saysAvoid distorting what the data saysbullbull Make large data sets coherentMake large data sets coherentbullbull Encourage the eye to compare different pieces of dataEncourage the eye to compare different pieces of databullbull Reveal the data at several levels of detailReveal the data at several levels of detail-- from a broad overview to from a broad overview to

the fine structurethe fine structurebullbull Be closely integrated with the statistical and verbal descriptioBe closely integrated with the statistical and verbal descriptions of a ns of a

data setdata set

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 2: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

2

Effective Communication of Performance Measures Challenges

bull There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

bull Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

3

WSDOTWSDOTrsquorsquoss Communication Approach Communication Approach Performance JournalismPerformance Journalism

bull WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

bull It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

bull WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

4

The Seven Principles of Performance JournalismThe Seven Principles of Performance Journalism

11 Good StoriesGood Stories

22 Good WritingGood Writing

33 Good DataGood Data

44 Good GraphicsGood Graphics

55 Good FormatPresentationGood FormatPresentation

66 Quality ControlQuality Control

77 Good TimingGood Timing

5

WSDOT Lessons Learned in Graphics WSDOT Lessons Learned in Graphics Formatting and PresentationFormatting and Presentation

bullbull Make communicating relevant and easyMake communicating relevant and easy--toto--understand understand measures text and graphs your number one prioritymeasures text and graphs your number one priority-- not not an afterthought once the data has been collectedan afterthought once the data has been collected

bullbull Graphical Displays shouldGraphical Displays shouldbullbull Show the dataShow the databullbull Make the viewer think about substance rather than about Make the viewer think about substance rather than about

methodology graphic design or the technology of graphic methodology graphic design or the technology of graphic productionproduction

bullbull Avoid distorting what the data saysAvoid distorting what the data saysbullbull Make large data sets coherentMake large data sets coherentbullbull Encourage the eye to compare different pieces of dataEncourage the eye to compare different pieces of databullbull Reveal the data at several levels of detailReveal the data at several levels of detail-- from a broad overview to from a broad overview to

the fine structurethe fine structurebullbull Be closely integrated with the statistical and verbal descriptioBe closely integrated with the statistical and verbal descriptions of a ns of a

data setdata set

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 3: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

3

WSDOTWSDOTrsquorsquoss Communication Approach Communication Approach Performance JournalismPerformance Journalism

bull WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

bull It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

bull WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

4

The Seven Principles of Performance JournalismThe Seven Principles of Performance Journalism

11 Good StoriesGood Stories

22 Good WritingGood Writing

33 Good DataGood Data

44 Good GraphicsGood Graphics

55 Good FormatPresentationGood FormatPresentation

66 Quality ControlQuality Control

77 Good TimingGood Timing

5

WSDOT Lessons Learned in Graphics WSDOT Lessons Learned in Graphics Formatting and PresentationFormatting and Presentation

bullbull Make communicating relevant and easyMake communicating relevant and easy--toto--understand understand measures text and graphs your number one prioritymeasures text and graphs your number one priority-- not not an afterthought once the data has been collectedan afterthought once the data has been collected

bullbull Graphical Displays shouldGraphical Displays shouldbullbull Show the dataShow the databullbull Make the viewer think about substance rather than about Make the viewer think about substance rather than about

methodology graphic design or the technology of graphic methodology graphic design or the technology of graphic productionproduction

bullbull Avoid distorting what the data saysAvoid distorting what the data saysbullbull Make large data sets coherentMake large data sets coherentbullbull Encourage the eye to compare different pieces of dataEncourage the eye to compare different pieces of databullbull Reveal the data at several levels of detailReveal the data at several levels of detail-- from a broad overview to from a broad overview to

the fine structurethe fine structurebullbull Be closely integrated with the statistical and verbal descriptioBe closely integrated with the statistical and verbal descriptions of a ns of a

data setdata set

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 4: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

4

The Seven Principles of Performance JournalismThe Seven Principles of Performance Journalism

11 Good StoriesGood Stories

22 Good WritingGood Writing

33 Good DataGood Data

44 Good GraphicsGood Graphics

55 Good FormatPresentationGood FormatPresentation

66 Quality ControlQuality Control

77 Good TimingGood Timing

5

WSDOT Lessons Learned in Graphics WSDOT Lessons Learned in Graphics Formatting and PresentationFormatting and Presentation

bullbull Make communicating relevant and easyMake communicating relevant and easy--toto--understand understand measures text and graphs your number one prioritymeasures text and graphs your number one priority-- not not an afterthought once the data has been collectedan afterthought once the data has been collected

bullbull Graphical Displays shouldGraphical Displays shouldbullbull Show the dataShow the databullbull Make the viewer think about substance rather than about Make the viewer think about substance rather than about

methodology graphic design or the technology of graphic methodology graphic design or the technology of graphic productionproduction

bullbull Avoid distorting what the data saysAvoid distorting what the data saysbullbull Make large data sets coherentMake large data sets coherentbullbull Encourage the eye to compare different pieces of dataEncourage the eye to compare different pieces of databullbull Reveal the data at several levels of detailReveal the data at several levels of detail-- from a broad overview to from a broad overview to

the fine structurethe fine structurebullbull Be closely integrated with the statistical and verbal descriptioBe closely integrated with the statistical and verbal descriptions of a ns of a

data setdata set

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 5: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

5

WSDOT Lessons Learned in Graphics WSDOT Lessons Learned in Graphics Formatting and PresentationFormatting and Presentation

bullbull Make communicating relevant and easyMake communicating relevant and easy--toto--understand understand measures text and graphs your number one prioritymeasures text and graphs your number one priority-- not not an afterthought once the data has been collectedan afterthought once the data has been collected

bullbull Graphical Displays shouldGraphical Displays shouldbullbull Show the dataShow the databullbull Make the viewer think about substance rather than about Make the viewer think about substance rather than about

methodology graphic design or the technology of graphic methodology graphic design or the technology of graphic productionproduction

bullbull Avoid distorting what the data saysAvoid distorting what the data saysbullbull Make large data sets coherentMake large data sets coherentbullbull Encourage the eye to compare different pieces of dataEncourage the eye to compare different pieces of databullbull Reveal the data at several levels of detailReveal the data at several levels of detail-- from a broad overview to from a broad overview to

the fine structurethe fine structurebullbull Be closely integrated with the statistical and verbal descriptioBe closely integrated with the statistical and verbal descriptions of a ns of a

data setdata set

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 6: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

6

Good Graphics Every Graph Tells A Story Good Graphics Every Graph Tells A Story Every Graph Asks A QuestionEvery Graph Asks A Question

bullbull In general good performance journalism graphics In general good performance journalism graphics

bullbull Are quickly comprehended and understood by the readerAre quickly comprehended and understood by the reader

bullbull Are relevant to the data and topic Are relevant to the data and topic

bullbull Are formatted with a sense of balance proportion and Are formatted with a sense of balance proportion and clarity of designclarity of design

bullbull Can stand on their own if lifted from the pageCan stand on their own if lifted from the page

bullbull Have data analysis and scale integrityHave data analysis and scale integrity

bullbull Answer some Answer some fundamental fundamental questionsquestions

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 7: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

7

Effort was great Data was good Effort was great Data was good Presentation was lousyPresentation was lousy

Impact was poorImpact was poor

The Key to Effective CommunicationThe Key to Effective Communication

bullbull A StepA Step--byby--Step Practical HowStep Practical How--to that Anyone Can Doto that Anyone Can Do

bullbull How to deconstruct and reconstruct ExcelHow to deconstruct and reconstruct Excel

Provided With appreciation to Provided With appreciation to Edward Edward TufteTufte Professor Emeritus of Yale University Professor Emeritus of Yale University and to and to Barb Barb FelverFelver of the Washington State Department of Social and Health Serviceof the Washington State Department of Social and Health Servicess

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 8: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE SHADING

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 9: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 10: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

REMOVE 3D

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3D

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 11: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE GRIDLINES

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 12: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE TICK MARKS

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 13: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE TICK MARKS

REMOVE 3D

REMOVE BOXFigure VI-1

Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

$40000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

REMOVE 3rd DATA SET

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 14: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

RE-LABEL BARS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 15: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

REMOVE LEGEND

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 16: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REPLACE WITH BAR LABELS

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 17: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

STRENGTHEN THE COLOR

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 18: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

MAKE LEGIBLE

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 19: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

DECREASE EMPHASIS ON REFERENCE

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 20: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Figure VI-1

Average Annual Wages by Sex 1979 amp 1989

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

REWRITE

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 21: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Men Women

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenDELETE

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 22: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

REMOVE 3D

REMOVE BOX

Men Women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs) $34545

$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than WomenSHOW AS FOOTNOTE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 23: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

ADD DATE REFERENCEAverage annual income 1989 dollars (real income)

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 24: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 25: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Figure VI-1Average Annual Wages by Sex 1979 amp 1989

$0

$5000

$10000

$15000

$20000

$25000

$30000

$35000

Men Women Total

19791989

Men continued to earn higher incomes than women

Rea

l Ann

ual W

age

and

Sala

ry In

com

e (1

989

dolla

rs)

$34545$33384

$18022$19684

$28722$27824

BEFORE

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 26: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Men WomenAverage annual income 1989 dollars (real income)

REMOVE 3D

REMOVE BOX

Men Women

$34545$33384

$18022$19684

1979 19791989 1989

Figure VI-1The Gap Between Male and Female Earnings is Decreasing

But Men Still Earn More Than Women

Average annual income 1989 dollars (real income)Data Source Office of Financial Management June 1993

AFTER

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 27: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

27

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 28: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

28

81

13 6

REMOVE SHADING

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 29: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

29

81

13 6

REMOVE LINE

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 30: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

30

81

13 6 REMOVE 3D

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 31: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

31

81

136

DELETE LEGEND

Vendors amp ClientsDSHS Salaries WagesOther

DSHS Expenditures

81

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 32: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

32

DSHS Expenditures

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

CHANGE COLOR

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 33: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

33

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

DSHS ExpendituresREWRITE TITLE

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 34: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

34

Our Spending Goes to Client Care

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 35: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

35

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionADD DOLLAR

AMOUNT

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 36: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

36

Our Spending Goes to Client CareDSHS 2001-03 Budget = $141 BillionCHANGE

FONT

ROTATE

Dollars to Vendors and Clients

81

Salaries Wages and Benefits

13Other6

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 37: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

37

Our Spending Goes to Client Care2001-03 DSHS Budget = $141 billion

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6 COMPLETE MESSAGE Where do we place our FTEs

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 38: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

38

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 39: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

39

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

Direct Service FTEs96

Central Management

FTEs

4

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 40: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

40

81

13 6

Vendors amp ClientsDSHS Salaries WagesOther

BEFOREDSHS Expenditures

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 41: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

41

BUDGET SUMMARY

2001-03 Proposed Budget

$141 Billion (All Funds)

Focused and Efficient

Focused and Focused and EfficientEfficient

All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

Direct Service FTEs96

Central Management

FTEs

4

Our Spending Goes to Client CareProposed = $141 billion

Our Employees Serve Clients First

Proposed = 18201 FTEs

AFTER

Dollars to Vendors and

Clients81

Salaries Wages and

Benefits13

All Other

6

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 42: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

42

Applying What You Have Just LearnedApplying What You Have Just Learned

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 43: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

43

WhatWhatrsquorsquos Wrong with this Graphs Wrong with this Graph

Mitigation Acres Achieved

0

20

40

60

80

100

120

2001 2002 2003 2004 2005 2006

Acreage Required amp Achieved by Year

Acr

es

Acreage Required amp Achieved Cumulative

RequiredAchievedRequired CumulativeAchieved Cumulative

Real Life Gray Notebook example of a ldquoBEFORErdquo graph

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 44: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

44

The Final Version as it Appeared in the The Final Version as it Appeared in the Gray NotebookGray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 45: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

45

Performance Measurement at WSDOT Overview and Lessons Learned

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 46: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

46

Sharing Our Lessons LearnedSharing Our Lessons Learned

Most Recent WSDOT ResearchMost Recent WSDOT Researchbullbull Bridging the Gap Between Agencies and Citizens Performance Bridging the Gap Between Agencies and Citizens Performance

Journalism Offers A Practical Solution to Communicate PerformancJournalism Offers A Practical Solution to Communicate Performance e Results Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRB Submitted)TRB Submitted)

bullbull Maximizing Highway System Capacity Measuring and Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving FieldCommunicating System Performance in an Evolving Field (Bremmer (Bremmer and Bryan Unpublishedand Bryan Unpublished-- TRI Submitted)TRI Submitted)

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 47: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

47

Resources and ContactsResources and Contactsbullbull WSDOTWSDOTrsquorsquos overall Accountability sites overall Accountability site httpwwwwsdotwagovaccountabilitybullbull WSDOTWSDOTrsquorsquoss quarterly performance report the quarterly performance report the Gray NotebookGray Notebook

httpwwwwsdotwagovNRrdonlyres1668E9EB-8A54-4B08-81B3-B64CBADBB0B20GrayNotebookMar07pdf

bullbull Performance Measurement at WSDOT FolioPerformance Measurement at WSDOT FoliohttpwwwwsdotwagovNRrdonlyres07E1F62D-0BF9-47B9-AE06-1B8F26D51A570Performance_Measurement_Folio_2007pdf

bullbull Bridging the Gap Between Agencies and Citizens Performance JourBridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical nalism Offers A Practical Solution to Communicate Performance Results Solution to Communicate Performance Results (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished-- TRB TRB Submitted)Submitted)

bullbull Making the Case for Funding The WSDOT ExperienceMaking the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished(Bremmer and Bryan Unpublished--TRB Submitted)TRB Submitted)

bullbull Emerging Performance Measurement Responses to Changing PoliticalEmerging Performance Measurement Responses to Changing Political Pressures at State Pressures at State DOTDOTrsquorsquoss A A PractitionerPractitionerrsquorsquos Perspectives PerspectivehttpwwwwsdotwagovNRrdonlyres139F581FhttpwwwwsdotwagovNRrdonlyres139F581F--0CED0CED--40E640E6--B3DBB3DB--E89581B016DF0Practitioners_PerspectivepdfE89581B016DF0Practitioners_PerspectivepdfDaniela Bremmer Director Strategic Assessment OfficeWashington State Department of Transportation(360) 705-7953bremmedwsdotwagov

  • WSDOT Lessons Learned in Graphics Formatting and Presentation
  • Effort was great Data was good Presentation was lousyImpact was poor
  • Focused and Efficient
  • Focused and Efficient
  • Whatrsquos Wrong with this Graph
  • The Final Version as it Appeared in the Gray Notebook
  • Resources and Contacts
    • Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      TRB Third International Conference on Performance Measurement

      Pre-Conference Workshop

      ldquoBuilding a Successful Measurement Systemrdquo

      September 9 2007

      Effective Communication of Performance Measures

      Performance Journalism in Practice at the
      Washington State Department of Transportation

      Effective Communication of Performance Measures

      Challenges

      There is a large gap in completed research and the performance measurement and reporting literature about the effective communication of performance information

      Ineffective communication does little to build credibility leads to information asymmetry and can increase public dissatisfaction reflected as anti-tax sentiments and growing funding shortages

          WSDOTrsquos Communication Approach

          Performance Journalism

          WSDOT has been using its Performance Journalism approach to communicate performance results to a diverse audience including the public the media and policy-makers

          It is a combination of quantitative reporting (using data graphs and charts) and narrative story telling

          WSDOT developed performance journalism based on experience gained over six years of reporting comprehensive transportation system performance information in the agencyrsquos quarterly performance report Measures Markers and Mileposts also referred to as the Gray Notebook

              The Seven Principles of Performance Journalism

              Good Stories

              Good Writing

              Good Data

              Good Graphics

              Good FormatPresentation

              Quality Control

              Good Timing

              WSDOT Lessons Learned in Graphics
              Formatting and Presentation

              Make communicating relevant and easy-to-understand measures text and graphs your number one priority- not an afterthought once the data has been collected

              Graphical Displays should

              Show the data

              Make the viewer think about substance rather than about methodology graphic design or the technology of graphic production

              Avoid distorting what the data says

              Make large data sets coherent

              Encourage the eye to compare different pieces of data

              Reveal the data at several levels of detail- from a broad overview to the fine structure

              Be closely integrated with the statistical and verbal descriptions of a data set

                  Good Graphics Every Graph Tells A Story

                  Every Graph Asks A Question

                  In general good performance journalism graphics

                  Are quickly comprehended and understood by the reader

                  Are relevant to the data and topic

                  Are formatted with a sense of balance proportion and clarity of design

                  Can stand on their own if lifted from the page

                  Have data analysis and scale integrity

                  Answer some fundamental questions

                  Effort was great Data was good
                  Presentation was lousy
                  Impact was poor

                  The Key to Effective Communication

                  A Step-by-Step Practical How-to that Anyone Can Do

                  How to deconstruct and reconstruct Excel

                  Provided With appreciation to Edward Tufte Professor Emeritus of Yale University

                  and to Barb Felver of the Washington State Department of Social and Health Services

                  The following slides show how to take a graph step by step from ldquobadrdquo to ldquogreatrdquo This presentation is courtesy of Barb Felver of Washington Statersquos Department of Social and Health Services

                  Figure VI-1
                  Average Annual Wages by Sex 1979 amp 1989

                  Men continued to earn higher incomes than women

                  Real Annual Wage and Salary Income (1989 dollars)

                  $34545

                  $33384

                  $18022

                  $19684

                  $28722

                  $27824

                  REMOVE SHADING

                  Here is our starting point

                  • A typical excel graph produced everyday in every kind of organization
                  • But this is a very pour formatting tool for performance data
                  • Letrsquos start taking it apart
                  • First thing to do remove the shading
                  • Remove the box around the graph
                    • Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Take out the 3-D effect ndash it distorts the relationships among the bars

                      Real Annual Wage and Salary Income (1989 dollars)

                      REMOVE 3D

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE BOX

                      REMOVE 3D

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      Get rid of the grid-lines chart clutter

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE GRIDLINES

                      Tick marks can go too ndash more chart clutter

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE TICK MARKS

                      Whatrsquos the point of the third data set Wersquore trying to compare men vs women The average doesnrsquot really add much Bye-bye third data set

                      REMOVE TICK MARKS

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      $28722

                      $27824

                      REMOVE 3rd DATA SET

                      Make the labels on the bars really stand out

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      RE-LABEL BARS

                      Who needs legends Only rarely will they be preferable to actually labeling the bars lines or other elements of the graph directly

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REMOVE LEGEND

                      And here is how you make the legend obsolete

                      REMOVE 3D

                      REMOVE BOX

                      Figure VI-1
                      Average Annual Wages by Sex 1979 amp 1989

                      Men continued to earn higher incomes than women

                      Real Annual Wage and Salary Income (1989 dollars)

                      $34545

                      $33384

                      $18022

                      $19684

                      REPLACE WITH BAR LABELS

                      1979

                      1979

                      1989

                      1989

                      • Make the color contrast stand out also heighten the effect that you really want to show
                      • In this case we want to make the 1989 data stand out to show that ten years later than the first data set women are still earning significantly less than men
                        • REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          STRENGTHEN THE COLOR

                          1979

                          1979

                          1989

                          1989

                          Bring out the x-axis labels

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          MAKE LEGIBLE

                          1979

                          1979

                          1989

                          1989

                          Decrease the emphasis on the reference (Figure VI-1) Place it instead on the chart title

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          DECREASE EMPHASIS ON REFERENCE

                          1979

                          1979

                          1989

                          1989

                          What is this title really saying

                          REMOVE 3D

                          REMOVE BOX

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          REWRITE

                          1979

                          1979

                          1989

                          1989

                          The title has been updated and improved

                          Now remove that secondary label because you already have it in the title

                          REMOVE 3D

                          REMOVE BOX

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          DELETE

                          1979

                          1979

                          1989

                          1989

                          The vertical writing is a significant visual problem No one should have to turn his or her head to read your graph

                          Place the same information in the footnote

                          REMOVE 3D

                          REMOVE BOX

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          SHOW AS FOOTNOTE

                          1979

                          1979

                          1989

                          1989

                          Missing anything

                          Yes thatrsquos right ndash therersquos no reference to the data

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          ADD DATE REFERENCE

                          Average annual income 1989 dollars (real income)

                          1979

                          1979

                          1989

                          1989

                          So what does it look like now

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          1979

                          1979

                          1989

                          1989

                          And herersquos the final product in all its glory

                          BEFORE

                          Figure VI-1
                          Average Annual Wages by Sex 1979 amp 1989

                          Men continued to earn higher incomes than women

                          Real Annual Wage and Salary Income (1989 dollars)

                          $34545

                          $33384

                          $18022

                          $19684

                          $28722

                          $27824

                          Beforehellip

                          Men

                          Women

                          Average annual income 1989 dollars (real income)

                          REMOVE 3D

                          REMOVE BOX

                          $34545

                          $33384

                          $18022

                          $19684

                          Figure VI-1
                          The Gap Between Male and Female Earnings is Decreasing

                          But Men Still Earn More Than Women

                          Average annual income 1989 dollars (real income)

                          Data Source Office of Financial Management June 1993

                          AFTER

                          1979

                          1979

                          1989

                          1989

                          And After

                          81

                          13

                          6

                          DSHS Expenditures

                          Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                          Answers

                          • Shading as the slide says
                          • Box
                          • 3-D
                          • Legend
                          • Colors (the colors could better correlate with the severity of the information)
                          • Title is ridiculously non-descriptive
                          • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                            • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                              81

                              13

                              6

                              DSHS Expenditures

                              REMOVE SHADING

                              Any ideas about whatrsquos wrong with this pie chart now that we have gone through the revision process with the bar graph

                              Answers

                              • Shading as the slide says
                              • Box
                              • 3-D
                              • Legend
                              • Colors (the colors could better correlate with the severity of the information)
                              • Title is ridiculously non-descriptive
                              • There is no sense of the total dollar amount that wersquore talking about here A thousand dollars A billion
                                • Letrsquos start by taking out the box surrounding the chart ndash it just distracts the eye

                                  81

                                  13

                                  6

                                  REMOVE LINE

                                  DSHS Expenditures

                                  (No Notes)

                                  81

                                  13

                                  6

                                  REMOVE 3D

                                  DSHS Expenditures

                                  Good-bye 3-D and good-bye legend

                                  DSHS Expenditures

                                  81

                                  81

                                  13

                                  6

                                  DELETE LEGEND

                                  Now letrsquos take a look at the coloring What should be emphasized

                                  DSHS Expenditures

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  CHANGE COLOR

                                  Any ideas what that should be Assume wersquore trying to tell a good-news story

                                  Thatrsquos right Excellent Wersquore trying to show that 81 of our dollars go to client care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  REWRITE TITLE

                                  DSHS Expenditures

                                  And this title itrsquos not to our liking

                                  Our Spending Goes to Client Care

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  Much better

                                  Ok how about some context How much money are we talking about here

                                  ADD DOLLAR AMOUNT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  A few little tricks

                                  CHANGE FONT

                                  Our Spending Goes to Client Care

                                  DSHS 2001-03 Budget = $141 Billion

                                  ROTATE

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits 13

                                  Other

                                  6

                                  make the font san-serif (like Arial or Helvetica) and rotate the pie chart so that the little wedge starts at 3 orsquoclock

                                  Our Spending Goes

                                  to Client Care

                                  2001-03 DSHS Budget = $141 billion

                                  COMPLETE MESSAGE Where do we place our FTEs

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Now bring out your message

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  Add a few extra details and some context to improve the picturehellip

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And herersquos the final product

                                  81

                                  13

                                  6

                                  BEFORE

                                  DSHS Expenditures

                                  Before (remember what poor shape this was in)

                                  BUDGET SUMMARY

                                  2001-03 Proposed Budget

                                  $141 Billion

                                  (All Funds)

                                  Focused and Efficient

                                  All Other includes items such as leases Attorney General services agency contracts (other than direct vendor or client services) capital outlays administrative hearings support services training fraud prevention administration of vendor contracts and administration

                                  Our Spending Goes

                                  to Client Care

                                  Proposed = $141 billion

                                  Our Employees

                                  Serve Clients First

                                  Proposed = 18201 FTEs

                                  AFTER

                                  Direct Service FTEs

                                  96

                                  Central Management FTEs

                                  4

                                  Dollars to Vendors and Clients

                                  81

                                  Salaries Wages and Benefits

                                  13

                                  All

                                  Other

                                  6

                                  And After

                                  Applying What You Have Just Learned

                                  Whatrsquos Wrong with this Graph

                                  Real Life Gray Notebook example of a ldquoBEFORErdquo graph

                                  Whatrsquos Wrong with this Graph

                                  Where do we start

                                  (What isnrsquot wrong with this graph)

                                  • Gray background
                                  • ldquogridrdquo background
                                  • Sideways writing
                                  • Legend ndash it offsets graph from center and itrsquos not really necessary
                                  • Colors donrsquot place emphasis on important things (over-achievement on total acreage)
                                  • Title doesnrsquot say ldquowetlandsrdquo
                                  • No data source
                                  • Title doesnrsquot specify years that the graph covers
                                  • Anything else that looks wrong to you
                                  • The scale is actually fairly good as is displaying two types of data (year-by-year and cumulative) on the same graph
                                    • Chart1

                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Summary

                                      Summary

                                      ampA
                                      Page ampP
                                      Required
                                      Achieved
                                      Required Cumulative
                                      Achieved Cumulative
                                      Acreage Required amp Achieved by Year
                                      Acres
                                      Acreage Required amp Achieved Cumulative
                                      Mitigation Acres Achieved
                                      3258
                                      37
                                      227
                                      225
                                      968
                                      806
                                      2693
                                      3154
                                      1077
                                      1113
                                      1065
                                      1017

                                      Site list

                                      BushTFrom pg 11 in the mitigation plan next to blue sticky note
                                      BushTWithout the forest preserve on the 41706 delineation
                                      BushTFrom 2006 closeout report
                                      BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
                                      BushTfrom page 11 of the mitigation plan in the table
                                      BushTFrom pg 3 of the mitigation plan
                                      BushTFrom 2007 closeout report
                                      BushTfrom page 4 of the mitigation plan (see hand written notes
                                      BushTThis probably should not belong I dont think that this is mitigation

                                      Sheet3

                                      The Final Version as it Appeared in the
                                      Gray Notebook

                                      Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

                                      This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

                                      Performance Measurement at WSDOT Overview and Lessons Learned

                                          Sharing Our Lessons Learned

                                          Most Recent WSDOT Research

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

                                          Resources and Contacts

                                          WSDOTrsquos overall Accountability site

                                          WSDOTrsquos quarterly performance report the Gray Notebook

                                          Performance Measurement at WSDOT Folio

                                          Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

                                          Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

                                          httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

                                          Daniela Bremmer

                                          Director Strategic Assessment Office

                                          Washington State Department of Transportation

                                          (360) 705-7953

                                          bremmedwsdotwagov

                                          Mitigation Acres Achieved

                                          0

                                          20

                                          40

                                          60

                                          80

                                          100

                                          120

                                          200120022003200420052006

                                          Acreage Required amp Achieved by Year

                                          Acres

                                          Acreage Required amp Achieved Cumulative

                                          Required

                                          Achieved

                                          Required Cumulative

                                          Achieved Cumulative

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          $40000

                                          MenWomenTotal

                                          1979

                                          1989

                                          MenWomen

                                          $0

                                          $5000

                                          $10000

                                          $15000

                                          $20000

                                          $25000

                                          $30000

                                          $35000

                                          MenWomenTotal

                                          1979

                                          1989

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          MenWomen

                                          MenWomen

                                          Vendors amp Clients

                                          DSHS Salaries Wages

                                          Other

                                          UNKNOWN-0

                                          UNKNOWN-1

                                          UNKNOWN-2

                                          UNKNOWN-3

                                          UNKNOWN-4

                                          UNKNOWN-5

                                          UNKNOWN-6

                                          UNKNOWN-7

                                          UNKNOWN-8

                                          UNKNOWN-9

                                          UNKNOWN-10

                                          UNKNOWN-11

                                          UNKNOWN-12

                                          UNKNOWN-13

                                          UNKNOWN-14

                                          UNKNOWN-15

                                      Acres
                                      Req Acres Achieved Reqd Cum Achieved Cum
                                      110 110 110 110 es st 3
                                      1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
                                      110 110 1720 1621 SR2 Profitts Point 11702
                                      051 046 1771 1667 SR 5 Ash Way 112702
                                      023 027 1794 1694 SR5 North Lake Samish 42104
                                      191 341 1985 2035 SR5 Flame 1 41504
                                      250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
                                      237 251 2472 2592 SR 9 Stilly Haller 32105
                                      298 247 2770 2839
                                      345 353 3115 3192
                                      263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
                                      080 081 3458 3421 SR 18 Pumpkin Patch 2503
                                      032 032 3490 3453 SR 18 IssaquahHobart 4804
                                      208 209 3698 3662 SR99 1st Ave South Bridge 5604
                                      428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
                                      452 460 4578 4596
                                      366 380 4944 4976
                                      025 028 4969 5004 SR 405 Swamp Creek 32002
                                      079 064 5048 5068 SR 405 160th St IC 101001
                                      032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
                                      088 161 5168 5262 SR 525 Cameron Road 33104
                                      416 416 5584 5678
                                      073 073 5657 5751
                                      310 234 5967 5985
                                      044 046 6011 6031 SR 509 Erdahl Ditch 31705
                                      193 212 6204 6243 SR 509 Hylebos 112205
                                      060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
                                      177 181 6441 6482 Rail Cgherry Point 101601 11404
                                      195 810 6636 7292 harris morris 41905
                                      022 015 6658 7307 SR 12 Naches River 5905
                                      069 269 6727 7576 SR 5 Salzer Creek 5504
                                      098 115 6825 7691 SR 14 Maryhill 21203
                                      041 041 6866 7732 SR 100 Ilwaco 32102
                                      348 312 7214 8044
                                      315 324 7529 8368
                                      246 216 7775 8584
                                      288 282 8063 8866
                                      160 132 8223 8998 SR 594 Kid Valley 41404
                                      345 358 8568 9356 kendal 1 32006
                                      059 097 8627 9453 Fish Road 41706
                                      320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
                                      129 126 9076 9731 Manor Way 31406
                                      14 131 9216 9862 Patterson Creek 1 32306
                                      002 003 9218 9865 Holder Creek 2 32206
                                      07 150 9288 10015 Stanwood Bryant 32906
                                      228 Bear Creek 2 51606
                                      1065 1017 2006 cumulative totals- 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
                                      Year Reqd Achieved R - Cum A - Cum
                                      2001 3258 3700 3258 3700 9 sites
                                      2002 227 225 3485 3925 4 sites
                                      2003 968 806 4453 4731 5 sites
                                      2004 2693 3154 7146 7885 15 sites
                                      2005 1077 1113 8223 8998 5 sites
                                      2006 1065 1017 9288 10015 7 sites
                                      2001 2001 3258 37
                                      2002 2002 3485 3925
                                      2003 2003 4453 4731
                                      2004 2004 7146 7885
                                      2005 2005 8223 8998
                                      2006 2006 9288 10015
Page 48: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Chart1

Required
Achieved
Required Cumulative
Achieved Cumulative
Acreage Required amp Achieved by Year
Acres
Acreage Required amp Achieved Cumulative
Mitigation Acres Achieved
3258
37
227
225
968
806
2693
3154
1077
1113
1065
1017

Summary

Summary

ampA
Page ampP
Required
Achieved
Required Cumulative
Achieved Cumulative
Acreage Required amp Achieved by Year
Acres
Acreage Required amp Achieved Cumulative
Mitigation Acres Achieved
3258
37
227
225
968
806
2693
3154
1077
1113
1065
1017

Site list

BushTFrom pg 11 in the mitigation plan next to blue sticky note
BushTWithout the forest preserve on the 41706 delineation
BushTFrom 2006 closeout report
BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
BushTfrom page 11 of the mitigation plan in the table
BushTFrom pg 3 of the mitigation plan
BushTFrom 2007 closeout report
BushTfrom page 4 of the mitigation plan (see hand written notes
BushTThis probably should not belong I dont think that this is mitigation

Sheet3

The Final Version as it Appeared in the
Gray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

Performance Measurement at WSDOT Overview and Lessons Learned

      Sharing Our Lessons Learned

      Most Recent WSDOT Research

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

      Resources and Contacts

      WSDOTrsquos overall Accountability site

      WSDOTrsquos quarterly performance report the Gray Notebook

      Performance Measurement at WSDOT Folio

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

      httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

      Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      (360) 705-7953

      bremmedwsdotwagov

      Mitigation Acres Achieved

      0

      20

      40

      60

      80

      100

      120

      200120022003200420052006

      Acreage Required amp Achieved by Year

      Acres

      Acreage Required amp Achieved Cumulative

      Required

      Achieved

      Required Cumulative

      Achieved Cumulative

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      MenWomen

      MenWomen

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      UNKNOWN-0

      UNKNOWN-1

      UNKNOWN-2

      UNKNOWN-3

      UNKNOWN-4

      UNKNOWN-5

      UNKNOWN-6

      UNKNOWN-7

      UNKNOWN-8

      UNKNOWN-9

      UNKNOWN-10

      UNKNOWN-11

      UNKNOWN-12

      UNKNOWN-13

      UNKNOWN-14

      UNKNOWN-15

Acres
Req Acres Achieved Reqd Cum Achieved Cum
110 110 110 110 es st 3
1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
110 110 1720 1621 SR2 Profitts Point 11702
051 046 1771 1667 SR 5 Ash Way 112702
023 027 1794 1694 SR5 North Lake Samish 42104
191 341 1985 2035 SR5 Flame 1 41504
250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
237 251 2472 2592 SR 9 Stilly Haller 32105
298 247 2770 2839
345 353 3115 3192
263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
080 081 3458 3421 SR 18 Pumpkin Patch 2503
032 032 3490 3453 SR 18 IssaquahHobart 4804
208 209 3698 3662 SR99 1st Ave South Bridge 5604
428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
452 460 4578 4596
366 380 4944 4976
025 028 4969 5004 SR 405 Swamp Creek 32002
079 064 5048 5068 SR 405 160th St IC 101001
032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
088 161 5168 5262 SR 525 Cameron Road 33104
416 416 5584 5678
073 073 5657 5751
310 234 5967 5985
044 046 6011 6031 SR 509 Erdahl Ditch 31705
193 212 6204 6243 SR 509 Hylebos 112205
060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
177 181 6441 6482 Rail Cgherry Point 101601 11404
195 810 6636 7292 harris morris 41905
022 015 6658 7307 SR 12 Naches River 5905
069 269 6727 7576 SR 5 Salzer Creek 5504
098 115 6825 7691 SR 14 Maryhill 21203
041 041 6866 7732 SR 100 Ilwaco 32102
348 312 7214 8044
315 324 7529 8368
246 216 7775 8584
288 282 8063 8866
160 132 8223 8998 SR 594 Kid Valley 41404
345 358 8568 9356 kendal 1 32006
059 097 8627 9453 Fish Road 41706
320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
129 126 9076 9731 Manor Way 31406
14 131 9216 9862 Patterson Creek 1 32306
002 003 9218 9865 Holder Creek 2 32206
07 150 9288 10015 Stanwood Bryant 32906
228 Bear Creek 2 51606
1065 1017 2006 cumulative totals- 7 sites
2001 2001 3258 37
2002 2002 3485 3925
2003 2003 4453 4731
2004 2004 7146 7885
2005 2005 8223 8998
2006 2006 9288 10015
Year Reqd Achieved R - Cum A - Cum
2001 3258 3700 3258 3700 9 sites
2002 227 225 3485 3925 4 sites
2003 968 806 4453 4731 5 sites
2004 2693 3154 7146 7885 15 sites
2005 1077 1113 8223 8998 5 sites
2006 1065 1017 9288 10015 7 sites
2001 2001 3258 37
2002 2002 3485 3925
2003 2003 4453 4731
2004 2004 7146 7885
2005 2005 8223 8998
2006 2006 9288 10015
Page 49: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Summary

Summary

ampA
Page ampP
Required
Achieved
Required Cumulative
Achieved Cumulative
Acreage Required amp Achieved by Year
Acres
Acreage Required amp Achieved Cumulative
Mitigation Acres Achieved
3258
37
227
225
968
806
2693
3154
1077
1113
1065
1017

Site list

BushTFrom pg 11 in the mitigation plan next to blue sticky note
BushTWithout the forest preserve on the 41706 delineation
BushTFrom 2006 closeout report
BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
BushTfrom page 11 of the mitigation plan in the table
BushTFrom pg 3 of the mitigation plan
BushTFrom 2007 closeout report
BushTfrom page 4 of the mitigation plan (see hand written notes
BushTThis probably should not belong I dont think that this is mitigation

Sheet3

The Final Version as it Appeared in the
Gray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

Performance Measurement at WSDOT Overview and Lessons Learned

      Sharing Our Lessons Learned

      Most Recent WSDOT Research

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

      Resources and Contacts

      WSDOTrsquos overall Accountability site

      WSDOTrsquos quarterly performance report the Gray Notebook

      Performance Measurement at WSDOT Folio

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

      httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

      Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      (360) 705-7953

      bremmedwsdotwagov

      Mitigation Acres Achieved

      0

      20

      40

      60

      80

      100

      120

      200120022003200420052006

      Acreage Required amp Achieved by Year

      Acres

      Acreage Required amp Achieved Cumulative

      Required

      Achieved

      Required Cumulative

      Achieved Cumulative

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      MenWomen

      MenWomen

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      UNKNOWN-0

      UNKNOWN-1

      UNKNOWN-2

      UNKNOWN-3

      UNKNOWN-4

      UNKNOWN-5

      UNKNOWN-6

      UNKNOWN-7

      UNKNOWN-8

      UNKNOWN-9

      UNKNOWN-10

      UNKNOWN-11

      UNKNOWN-12

      UNKNOWN-13

      UNKNOWN-14

      UNKNOWN-15

Acres
Req Acres Achieved Reqd Cum Achieved Cum
110 110 110 110 es st 3
1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
110 110 1720 1621 SR2 Profitts Point 11702
051 046 1771 1667 SR 5 Ash Way 112702
023 027 1794 1694 SR5 North Lake Samish 42104
191 341 1985 2035 SR5 Flame 1 41504
250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
237 251 2472 2592 SR 9 Stilly Haller 32105
298 247 2770 2839
345 353 3115 3192
263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
080 081 3458 3421 SR 18 Pumpkin Patch 2503
032 032 3490 3453 SR 18 IssaquahHobart 4804
208 209 3698 3662 SR99 1st Ave South Bridge 5604
428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
452 460 4578 4596
366 380 4944 4976
025 028 4969 5004 SR 405 Swamp Creek 32002
079 064 5048 5068 SR 405 160th St IC 101001
032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
088 161 5168 5262 SR 525 Cameron Road 33104
416 416 5584 5678
073 073 5657 5751
310 234 5967 5985
044 046 6011 6031 SR 509 Erdahl Ditch 31705
193 212 6204 6243 SR 509 Hylebos 112205
060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
177 181 6441 6482 Rail Cgherry Point 101601 11404
195 810 6636 7292 harris morris 41905
022 015 6658 7307 SR 12 Naches River 5905
069 269 6727 7576 SR 5 Salzer Creek 5504
098 115 6825 7691 SR 14 Maryhill 21203
041 041 6866 7732 SR 100 Ilwaco 32102
348 312 7214 8044
315 324 7529 8368
246 216 7775 8584
288 282 8063 8866
160 132 8223 8998 SR 594 Kid Valley 41404
345 358 8568 9356 kendal 1 32006
059 097 8627 9453 Fish Road 41706
320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
129 126 9076 9731 Manor Way 31406
14 131 9216 9862 Patterson Creek 1 32306
002 003 9218 9865 Holder Creek 2 32206
07 150 9288 10015 Stanwood Bryant 32906
228 Bear Creek 2 51606
1065 1017 2006 cumulative totals- 7 sites
2001 2001 3258 37
2002 2002 3485 3925
2003 2003 4453 4731
2004 2004 7146 7885
2005 2005 8223 8998
2006 2006 9288 10015
Year Reqd Achieved R - Cum A - Cum
2001 3258 3700 3258 3700 9 sites
2002 227 225 3485 3925 4 sites
2003 968 806 4453 4731 5 sites
2004 2693 3154 7146 7885 15 sites
2005 1077 1113 8223 8998 5 sites
2006 1065 1017 9288 10015 7 sites
Page 50: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Summary

ampA
Page ampP
Required
Achieved
Required Cumulative
Achieved Cumulative
Acreage Required amp Achieved by Year
Acres
Acreage Required amp Achieved Cumulative
Mitigation Acres Achieved
3258
37
227
225
968
806
2693
3154
1077
1113
1065
1017

Site list

BushTFrom pg 11 in the mitigation plan next to blue sticky note
BushTWithout the forest preserve on the 41706 delineation
BushTFrom 2006 closeout report
BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
BushTfrom page 11 of the mitigation plan in the table
BushTFrom pg 3 of the mitigation plan
BushTFrom 2007 closeout report
BushTfrom page 4 of the mitigation plan (see hand written notes
BushTThis probably should not belong I dont think that this is mitigation

Sheet3

The Final Version as it Appeared in the
Gray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

Performance Measurement at WSDOT Overview and Lessons Learned

      Sharing Our Lessons Learned

      Most Recent WSDOT Research

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

      Resources and Contacts

      WSDOTrsquos overall Accountability site

      WSDOTrsquos quarterly performance report the Gray Notebook

      Performance Measurement at WSDOT Folio

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

      httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

      Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      (360) 705-7953

      bremmedwsdotwagov

      Mitigation Acres Achieved

      0

      20

      40

      60

      80

      100

      120

      200120022003200420052006

      Acreage Required amp Achieved by Year

      Acres

      Acreage Required amp Achieved Cumulative

      Required

      Achieved

      Required Cumulative

      Achieved Cumulative

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      MenWomen

      MenWomen

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      UNKNOWN-0

      UNKNOWN-1

      UNKNOWN-2

      UNKNOWN-3

      UNKNOWN-4

      UNKNOWN-5

      UNKNOWN-6

      UNKNOWN-7

      UNKNOWN-8

      UNKNOWN-9

      UNKNOWN-10

      UNKNOWN-11

      UNKNOWN-12

      UNKNOWN-13

      UNKNOWN-14

      UNKNOWN-15

Acres
Req Acres Achieved Reqd Cum Achieved Cum
110 110 110 110 es st 3
1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
110 110 1720 1621 SR2 Profitts Point 11702
051 046 1771 1667 SR 5 Ash Way 112702
023 027 1794 1694 SR5 North Lake Samish 42104
191 341 1985 2035 SR5 Flame 1 41504
250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
237 251 2472 2592 SR 9 Stilly Haller 32105
298 247 2770 2839
345 353 3115 3192
263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
080 081 3458 3421 SR 18 Pumpkin Patch 2503
032 032 3490 3453 SR 18 IssaquahHobart 4804
208 209 3698 3662 SR99 1st Ave South Bridge 5604
428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
452 460 4578 4596
366 380 4944 4976
025 028 4969 5004 SR 405 Swamp Creek 32002
079 064 5048 5068 SR 405 160th St IC 101001
032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
088 161 5168 5262 SR 525 Cameron Road 33104
416 416 5584 5678
073 073 5657 5751
310 234 5967 5985
044 046 6011 6031 SR 509 Erdahl Ditch 31705
193 212 6204 6243 SR 509 Hylebos 112205
060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
177 181 6441 6482 Rail Cgherry Point 101601 11404
195 810 6636 7292 harris morris 41905
022 015 6658 7307 SR 12 Naches River 5905
069 269 6727 7576 SR 5 Salzer Creek 5504
098 115 6825 7691 SR 14 Maryhill 21203
041 041 6866 7732 SR 100 Ilwaco 32102
348 312 7214 8044
315 324 7529 8368
246 216 7775 8584
288 282 8063 8866
160 132 8223 8998 SR 594 Kid Valley 41404
345 358 8568 9356 kendal 1 32006
059 097 8627 9453 Fish Road 41706
320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
129 126 9076 9731 Manor Way 31406
14 131 9216 9862 Patterson Creek 1 32306
002 003 9218 9865 Holder Creek 2 32206
07 150 9288 10015 Stanwood Bryant 32906
228 Bear Creek 2 51606
1065 1017 2006 cumulative totals- 7 sites
2001 2001 3258 37
2002 2002 3485 3925
2003 2003 4453 4731
2004 2004 7146 7885
2005 2005 8223 8998
2006 2006 9288 10015
Page 51: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Site list

BushTFrom pg 11 in the mitigation plan next to blue sticky note
BushTWithout the forest preserve on the 41706 delineation
BushTFrom 2006 closeout report
BushTThe harlan landing was 070 acres and both combined is the 152 acres This is with the non-GPSd forested wetland of019 acrea and this is without the potential beaver acerage just the areas that currently meet the 3 paramaters of a wetland
BushTfrom page 11 of the mitigation plan in the table
BushTFrom pg 3 of the mitigation plan
BushTFrom 2007 closeout report
BushTfrom page 4 of the mitigation plan (see hand written notes
BushTThis probably should not belong I dont think that this is mitigation

Sheet3

The Final Version as it Appeared in the
Gray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

Performance Measurement at WSDOT Overview and Lessons Learned

      Sharing Our Lessons Learned

      Most Recent WSDOT Research

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

      Resources and Contacts

      WSDOTrsquos overall Accountability site

      WSDOTrsquos quarterly performance report the Gray Notebook

      Performance Measurement at WSDOT Folio

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

      httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

      Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      (360) 705-7953

      bremmedwsdotwagov

      Mitigation Acres Achieved

      0

      20

      40

      60

      80

      100

      120

      200120022003200420052006

      Acreage Required amp Achieved by Year

      Acres

      Acreage Required amp Achieved Cumulative

      Required

      Achieved

      Required Cumulative

      Achieved Cumulative

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      MenWomen

      MenWomen

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      UNKNOWN-0

      UNKNOWN-1

      UNKNOWN-2

      UNKNOWN-3

      UNKNOWN-4

      UNKNOWN-5

      UNKNOWN-6

      UNKNOWN-7

      UNKNOWN-8

      UNKNOWN-9

      UNKNOWN-10

      UNKNOWN-11

      UNKNOWN-12

      UNKNOWN-13

      UNKNOWN-14

      UNKNOWN-15

Acres
Req Acres Achieved Reqd Cum Achieved Cum
110 110 110 110 es st 3
1500 1401 1610 1511 SR2 Ebey Slough Stage 2 101601 51104
110 110 1720 1621 SR2 Profitts Point 11702
051 046 1771 1667 SR 5 Ash Way 112702
023 027 1794 1694 SR5 North Lake Samish 42104
191 341 1985 2035 SR5 Flame 1 41504
250 306 2235 2341 SR 9 Howell Creek 12604 Island GPSd 5304
237 251 2472 2592 SR 9 Stilly Haller 32105
298 247 2770 2839
345 353 3115 3192
263 148 3378 3340 SR 18 Frog Pond 123003 SS 42004 Wet
080 081 3458 3421 SR 18 Pumpkin Patch 2503
032 032 3490 3453 SR 18 IssaquahHobart 4804
208 209 3698 3662 SR99 1st Ave South Bridge 5604
428 474 4126 4136 SR 167 Mill Creek Stage 2 3204
452 460 4578 4596
366 380 4944 4976
025 028 4969 5004 SR 405 Swamp Creek 32002
079 064 5048 5068 SR 405 160th St IC 101001
032 033 5080 5101 SR 520 Bear Creek 1 Mar-04
088 161 5168 5262 SR 525 Cameron Road 33104
416 416 5584 5678
073 073 5657 5751
310 234 5967 5985
044 046 6011 6031 SR 509 Erdahl Ditch 31705
193 212 6204 6243 SR 509 Hylebos 112205
060 058 6264 6301 SR 706 Ashford 92303 (SS) 4104 (wet)
177 181 6441 6482 Rail Cgherry Point 101601 11404
195 810 6636 7292 harris morris 41905
022 015 6658 7307 SR 12 Naches River 5905
069 269 6727 7576 SR 5 Salzer Creek 5504
098 115 6825 7691 SR 14 Maryhill 21203
041 041 6866 7732 SR 100 Ilwaco 32102
348 312 7214 8044
315 324 7529 8368
246 216 7775 8584
288 282 8063 8866
160 132 8223 8998 SR 594 Kid Valley 41404
345 358 8568 9356 kendal 1 32006
059 097 8627 9453 Fish Road 41706
320 152 8947 9605 Selah - harlan and fish Jan 06 and Oct 06
129 126 9076 9731 Manor Way 31406
14 131 9216 9862 Patterson Creek 1 32306
002 003 9218 9865 Holder Creek 2 32206
07 150 9288 10015 Stanwood Bryant 32906
228 Bear Creek 2 51606
1065 1017 2006 cumulative totals- 7 sites
Page 52: Effective Communication of Performance Measures · 2 Effective Communication of Performance Measures: Challenges • There is a large gap in completed research and the performance

Sheet3

The Final Version as it Appeared in the
Gray Notebook

Real Life Gray Notebook example of an ldquoAFTERrdquo graph from the December 31 2006 edition

This graph was done in Adobe Illustrator for the Gray Notebook For the Gray Notebook graphs are generated in Excel and given to a graphic artist to redraw by freehand for publication The artist must have the excel spreadsheet in order to draw a graph with exact points and proportions Illustrator is used provides better graphics display

Performance Measurement at WSDOT Overview and Lessons Learned

      Sharing Our Lessons Learned

      Most Recent WSDOT Research

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Maximizing Highway System Capacity Measuring and Communicating System Performance in an Evolving Field (Bremmer and Bryan Unpublished- TRI Submitted)

      Resources and Contacts

      WSDOTrsquos overall Accountability site

      WSDOTrsquos quarterly performance report the Gray Notebook

      Performance Measurement at WSDOT Folio

      Bridging the Gap Between Agencies and Citizens Performance Journalism Offers A Practical Solution to Communicate Performance Results (Bremmer and Bryan Unpublished- TRB Submitted)

      Making the Case for Funding The WSDOT Experience (Bremmer and Bryan Unpublished- TRB Submitted)

      Emerging Performance Measurement Responses to Changing Political Pressures at State DOTrsquos A Practitionerrsquos Perspective

      httpwwwwsdotwagovNRrdonlyres139F581F-0CED-40E6-B3DB-E89581B016DF0Practitioners_Perspectivepdf

      Daniela Bremmer

      Director Strategic Assessment Office

      Washington State Department of Transportation

      (360) 705-7953

      bremmedwsdotwagov

      Mitigation Acres Achieved

      0

      20

      40

      60

      80

      100

      120

      200120022003200420052006

      Acreage Required amp Achieved by Year

      Acres

      Acreage Required amp Achieved Cumulative

      Required

      Achieved

      Required Cumulative

      Achieved Cumulative

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      $40000

      MenWomenTotal

      1979

      1989

      MenWomen

      $0

      $5000

      $10000

      $15000

      $20000

      $25000

      $30000

      $35000

      MenWomenTotal

      1979

      1989

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      MenWomen

      MenWomen

      Vendors amp Clients

      DSHS Salaries Wages

      Other

      UNKNOWN-0

      UNKNOWN-1

      UNKNOWN-2

      UNKNOWN-3

      UNKNOWN-4

      UNKNOWN-5

      UNKNOWN-6

      UNKNOWN-7

      UNKNOWN-8

      UNKNOWN-9

      UNKNOWN-10

      UNKNOWN-11

      UNKNOWN-12

      UNKNOWN-13

      UNKNOWN-14

      UNKNOWN-15