nisto: a new evaluation framework for mobility projects...2 main elements of the framework o...
TRANSCRIPT
-
NISTO NEW INTEGRATED SMART
TRANSPORT OPTIONS
NISTO: A new evaluation framework
for mobility projects
Jeroen Bulckaen PhD Research Associate
http://mobi.vub.ac.be
-
Source: http://simonkneebone.com/2013/02/01/evaluation-tool/
-
Source: Evaluation matters. A practitioner’s guide to sound evaluation for urban mobility measures. Waxmann Verlag, Munster 2013.
-
4 main input channels
NISTO evaluation framework
Stakeholder survey
State of the art analysis
Stakeholder workshops
Pilot and Demonstration
projects
-
2 main elements of the framework
NIS
TO
Evaluation tools
MCA
MAMCA
Target monitoring
Criteria and indicator
framework
Core criteria
Indicator 1 (Core)
Indicator 2 (Optional)
Local criteria
Indicator 3 (Core)
Indicator 4 (Optional)
-
Assessment of project sustainability
NIS
TO
Evaluation tools
MCA
MAMCA
Target monitoring
Criteria and indicator
framework
Core criteria
Indicator 1 (Core)
Indicator 2 (Optional)
Local criteria
Indicator 3 (Core)
Indicator 4 (Optional)
-
Assessment of project sustainabilility
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
-
16 NISTO core criteria
SUSTAINABILITY ECONOMY ENVIRONMENT SOCIETY
Economic activity Land consumption Safety
Cost efficiency Greenhouse gas emissions Security
Business productivity Air quality Health
Public funding of transport Resource use Liveability
Noise Equity
Socio-political acceptance
Accessibility for people with special needs
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
-
20 core & 15 optional indicators
11
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
-
20 core & 15 optional indicators
12
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
ECONOMY ENVIRONMENT SOCIETY TRANSPORT
Cost-efficiency Noise Safety - Investment costs - Operating costs
- Revenues
- Perception - Produced noise
- Exposure
- No. of accidents - Perception
Modal split: Passenger kms
-
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
Distribution of 100 points
for the criteria under each pillar
SUSTAINABILITY
ECONOMY ENVIRONMENT SOCIETY
Cost efficiency (0,23) Noise (0,16) Safety (0,24)
-
Aid is provided by the set-up of a
Data Collection Plan
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
-
online TOOLKIT
November 2015
http://www.nisto-project.eu
Define evaluation criteria
Identify indicators
Weight the
criteria
Collect & measure
data
Score the criteria
Calculate overall scores
-
16
-
17
-
18
Source: Evaluation matters. A practitioner’s guide to sound evaluation for urban mobility measures. Waxmann Verlag, Munster 2013.
-
Jeroen Bulckaen Vrije Universiteit Brussel
Dr. Imre Keseru
Vrije Universiteit Brussel [email protected]
Prof. dr. Cathy Macharis
Vrije Universiteit Brussel [email protected]
THANK YOU FOR YOUR ATTENTION!
www.nisto-project.eu
http://mobi.vub.ac.be
mailto:[email protected]:[email protected]:[email protected]
-
Links
NISTO Project
• http://www.nisto-project.eu
MOBI Research Group, Vrije Universiteit Brussel
• http://mobi.vub.ac.be
Department BUTO, Vrije Universiteit Brussel
• http://research.vub.ac.be/buto
20
-
Criteria weights
MOSI - Transport & Logistics 21
-
The NISTO indicator framework
22
-
MOSI - Transport & Logistics 23
-
MOSI - Transport & Logistics 24
Input data
Output Stakeholders’
performance scores Target achievement Sustainability scores
Indicators Stake-
holders
Criteria
Targets Project type
1 2 3 4
Project alternatives
NISTO Evaluation tools
MCA MAMCA Target Monitoring
-
Multi-Actor Multi-Criteria Analysis
Macharis, 2000 & 2004
http://mobi.vub.ac.be
Stakeholder analysisStakeholder analysis
Stake-
holder 1
Stake-
holder 1
C11C11 CCAlternativesAlternatives Cn1Cn1 CnmCnm
Stake-
holder m
Stake-
holder m
Ref.Ref.
AlternAltern
C11C11 Results
Implemen-
tation
Implemen-
tation
scenariosscenarios
resultresult
resultresult
CnmCnm
resultresult
resultresult
IndicatorsIndicatorsMeasurement
methods
Measurement
methods
C11C11
CnmCnm
Mitigation
strategies
Mitigation
strategies
C11C11 CC
Wn1Wn1 Wnm
Wnm
W11W11 Wnm
WnmOverall analyses
(MCA)
+/0/-+/0/-Deployment
scenarios
Deployment
scenarios
11
22
6655
44
33
77