1

MANCP Network Document on Performance Objectives & Indicators

Presentation on behalf of the Performance Objectives & Indicators Working Group

To “Measuring Outcomes” WorkshopFederal Agency for the Safety of the Food Chain

Brussels – 3 & 4 April 2014

Julia WilliamsFood Standards Agency

UK

2

Introduction

• Working Group first meeting April 2013

• 10 Member States represented

• 3 Workshops held to date

• 2 Multi-Annual National Control Plan (MANCP) Plenary sessions discussed and amended draft

3

Background

• Regulation 882 – Member States (MS) are required to provide MANCP with strategic objectives

• MANCP sets out strategic objectives/business plans and Annual Report details progress and effectiveness

• Other organisations are addressing the need for guidelines in developing performance measures

• The Working Group is also taking the initiative• Measurement is not just an option – it is essential if we

want to demonstrate our effectiveness

4

Aim of the Network Document

• To produce a non-binding reference document on objectives and indicators as ways of measuring the effectiveness of official controls

• To contribute to a harmonised approach for MS and Competent Authorities (CA) in developing their own objectives and indicators

• To provide guidance and principles that are easy to apply by any MS/CA when developing objectives and indicators

• To support MS/CA in setting up their own systems of indicators• To promote a more delivery-led MANCP and Annual Report

5

Scope of the Network Document

• Applies to monitoring effectiveness of controls which fall within the context of Regulation (EC) No. 882/2004

• Intended for use by MSs and CAs • Gives principles and guidelines without being too specific• Focuses on outcomes (effectiveness) not inputs (processes)• Should be taken in conjunction with “Guidance Note on

Auditing Effectiveness of Official Control Systems” from the National Audit Systems Network

6

Scope of the Network Document

7

Strategic & Operational Objectives

8

Linked to strategic objectives / plans /

legislation etc

SMART

User friendly

Resistant to manipulation Outcome and impact

indicators

Unambiguous and robust, based on high quality

unbiased data

Characteristics for good

indicators:

Good Indicators

9

Use & Purpose of IndicatorsThe purpose of indicators is to evaluate / measure a controls system’s degree of achievement of a specific objective or to monitor trends

Periodically assess / continuously improve

effectiveness of an official control system

Provide input into the MANCP and Annual

Reports

Help focus on objectives / make self assessments

Help set priorities / review strategic

objectives

Generate information on achievement of objectives which

can be easily communicated internally or externally

Demonstrate relevance and effectiveness of our work to stakeholders throughout the

food chain

Assist internal or external auditors in

their evaluations

Measure changes and identify trends or

patternsIndicators can be used to:

10

Objectives & indicators examples – Consumer confidence

Reg. 882/2004 “Control is risk-based, effective…”

Operational Objectives

Indicators

Strategic Objective

Indicators High level of consumer confidence achieved

Consumers have the information and understanding to make informed choices about where and what they eat

100% Local Authority uptake of Food Hygiene Rating/Food Hygiene Information Scheme

% of FBOs achieving 3 to 5 ratings under FHRS/

FHIS increases

Number of meat establishments on Cause for Concern list continues to reduce

Reduction in food borne incidents

FBOs understand importance of

HACCP controls

FBOs have access to information ie food

safety events, SFBB

Consumer has access to

information via websites / displayed

at premises

% of non compliant businesses reduces

Increase in numbers of food establishments

categorised as low risk

Monitoring and analysis of

enforcement data (LAEMS)

Open and transparent communication with consumers

Publication of audit reports for meat establishments

Number of meat establishments scoring >45 at audit and going

onto C4C

11

UK Food Hygiene Rating/Information Schemes

12

GB Cause for Concern

2009 2010 2011 2012 20130

10

20

30

40

50

60

70

80

Number of approved and operational meat establishments in GB which were on the Cause for Concern list since launch in November 2009

13

Next Steps

• Working Group will continue its work via email and discussion

• Sharing documents and communicating on Wikispace

• Final draft for presentation at next MANCP Plenary session – 14 & 15 May 2014

QUESTIONS???