Sub-group "Indicators"

Grange 21-22 November, 2012

Response to Questions

• Do we need indicators?• Yes. Helps in focusing on objectives, to make self-

assessments, measure changes/trends (assuming that we continue with same objectives/indicators)

• Do we need to define "indicator"?• Answer: yes.

– Other concepts around indicator should also be clarified as well as the relations between them e.g. next question: indicator, data, information, analysis etc. etc.

Characteristics of good indicators?

• Should be:– Linked to the objectives of legislation,

guidance or any other standards– Linked to strategic objectives– Reflect efficiency, effectiveness, impact– Describe achievement towards targets/goals– Valid, unambiguous adequate, reliable,

specific, sensitive, relevant and easily obtainable

Input process outputInitial

situationOutcome

Consumer Goals

Process indicators

Impact indicators

Relevance Adequacy

Types of indicatorsDifferent indicators may measure different things, like:

–Process (compliance with plan)–Effectiveness (output vs. goals)–Efficiency (output-input ratio)–Impact (initial situation vs. final)

–National, regional, local level–Producing relevant and meaningful indicators at national level is a challenge:

• requires a lot of coordination, cooperation and communication

• Might need to be a (relatively) independent, objective process

More questions/topics• Examples of indicators (explaining the boxes in the diagram• How to measure?• Could we find a "common set" of indicators, measures,

metrics?• Principles for designing performance indicators• Criteria for good indicators?• How to: Strategic objectives SMART objectives,

operational targets metrics/measures indicators?• Communication with stakeholders? (understood, accepted)

– Sometimes controversial e.g. enforcement indicators• Continuous or periodic measurement?

Examples (positive)

• Compliance – compound indicator using:– Number of inspections– Level of risk-based targeting– Grading of non-compliances

• Contaminant monitoring programme: proportion of positive samples, outcome of follow-up, timeliness– Depends on a number of factors… (e.g. proficiency testing)

• Animal health – incidence, out-breaks in the context of eradication programmes e.g.– BSE, salmonella

Examples (bad)

• Number of controls carried out– Not sufficient alone