overview of the current monitoring tools available in the … · bottom-up approach: it uses around...
TRANSCRIPT
Overview of the current monitoring tools available in the framework of
the SDGs
Paolo BOLSI – Policy Analyst
REGIO.B1 Policy Development and Economic Analysis
DG for Regional and Urban Policy
17 Goals, 169 targets
Defining an indicator framework
Indicators
Data Data
Indicators
Top/down approachPros: fitness;
Cons: missing data.
Bottom/up approachPros: data completeness;
Cons: use of proxies
Defining an indicator framework
• From absolute to relative indicators (using common denominators is sometimes not sufficient!);
• Comparability over time and across space (countries, regions) and use of common definitions!
e.g. EC Better Regulation Guidelines Tool #41: R.A.C.E.R. criteria
Relevant, Accepted, Credible, Easy to monitor, Robust.
• Ensuring internal consistency before aggregation;
• Distances towards targets… depending on data availability and proper definition of targets and baselines!
e.g. EC Better Regulation Guidelines Tool #16: S.M.A.R.T. criteria
Specific, Measurable, Achievable, Relevant, Time-Bound.
UN SDG Global Indicator Framework
232 unique indicators (244 with repetitions), mostly quantitative but also of qualitative nature (e.g. compliance in adopting specific legislation) at a global scale (reporting at national level)!
UN SDG Global Indicator Framework
Top-down reporting: Indicators are divided into tiers:
• Tier I: methodology is available and data are regularly produced by most countries (104 indicators as of 09/2019)
• Tier II: methodology is available but data is not regularly produced (89 indicators as of 09/2019)
• Tier III: methodology under development (33 indicators as of 09/2019)
Indicator list currently under review, decision on the new list is expected for March 2020 by the UN Statistical Commission.
Due to lack of data, calculation of distance towards SDGs is currently not possible.
Eurostat SDG statistical reporting
Bottom-up approach: it uses around 100 quantitative indicators (some “multipurpose”), 5-6 indicators per goal for a EU context. Mostly data from Eurostat, sometimes from other Commission sources (e.g. Agencies).
List is regularly reviewed.
Eurostat SDG statistical reportingNo distance to targets is possible yet due to the lack of targets, hard to define for some indicators, but the report provides trend analyses:- short term over the past 5 years;- long term over the past 15 years;
For each indicator, if targets, baselines and historical data are available, it calculates “target paths”, otherwise it makes an assessment about growth rates.
At goal level, they use “scoring functions” to aggregate target paths and growth rates.
Eurostat SDG statistical reporting
OECD Measuring Distance to SDG Targets
Bottom-up approach: it uses 132 quantitative indicators mostly from OECD database but also from UN dataset (tier I and II). Groups also the 17 SDG into 5 Ps (People, Planet, Prosperity, Peace and Partnership).
OECD Measuring Distance to SDG Targets
Definition of targets: step by step approach: 1. Using the wording of the UN targets in the 2030 agenda (52
indicators);2. Using international agreements and expert opinions (21);3. When possible to determine a direction, top performing
countries (36);4. No target (23).
Calculation of distances is made using statistical methods, using absolute differences between a country’s position and the target end value which are then standardised by the standard deviation observed in countries performances.
Bertelsmann Stiftung SDG index
Bottom-up approach: it uses 114 indicators (85 global + 29 for OECD countries) from various sources for 165 countries.
Calculates scores based on a definition of target for each indicator.
Bertelsmann Stiftung SDG index
Definition of targets: step by step approach: 1. Using the wording of the UN targets in the 2030 agenda;2. Using the principle of “Leave no one behind”: either
universal access or zero deprivation, depending on the indicator;
3. Science-based targets;4. Average of the top performers**If certain SDG targets are already met by many countries, they are replaced by the average of the top performers.
Calculation of distances is made using the target as max reference value. This is used to compare the country performance minus the worst performer (min reference value) to build a score from 0 to 100.
SDG monitoring at subnational level?
Several challenges exist:
• Some SDG become more relevant, some less. Some cases the change in scope changes the perspective of the indicator choice;
• Data limitations exist;
• Common geographical definitions are needed, especially for cities.
