The impact of Digital Intermediaries in the

Emilia - Romagna Region based on the

local implementation of the MIREIA project

Grazia Guermandi – Regione Emilia-Romagna (IT)

• “B&I” is the main e-inclusion programme of the Telematics Plan of the Emilia-Romagna Region– Started in 2009

• Targets: citizens and e-inclusion intermediaries– 725 digital literacy courses – 10.500 citizens– 190 municipalities in the E-R Region

Pane e InternetBread and Internet (B&I)

2

http://is.jrc.ec.europa.eu/pages/EAP/eInclusion/MIREIA.html

Pilot case for MIREIA

• B&I selected as Pilot case for 'testing' the methodological approach of the Impact Assessment framework developed by the European Commission's Joint Research Centre – Institute for Prospective Technological Studies (JRC-IPTS)

3

Performance Assessment ModelPerformance Assessment Model

Impact Measurement Model

Impact Measurement Model

Context Analysis Framework

Context Analysis Framework

Counterfactual Impact Evaluation

Counterfactual Impact Evaluation

Source: Misuraca et al, JRC-IPTS , European Commission , 2012

MIREIA Impact assessment framework

4

• A specific action created to test MIREIA in ´real-life´• to evaluate improvements in employability • to verify the effects on users´ behaviors

• MIREIA used a robust methodology for testing hypothesis

• Counterfactual analysis with Randomized Control Trial

From Digital literacy to ICT for employability

“Bread, Internet & Jobs” (B&I&J)

5

Modena

Bologna

Piacenza

ParmaFerrara

Reggio Emilia

Ravenna

Forlì-Cesena Rimini

Unemployment Rate

6.32%Unemployment

Rate6.91%

Unemployment Rate

6.91%

Unemployment rate:

Emilia-Romagna Italy 7.08%

Italy 10.70%

Implementation of the B&I&J Pilot for MIREIA• 14 training courses of the Employment centres

• provinces of Parma, Bologna and Rimini• Target: unemployed citizens

• TG = 148 people tested ex-ante, ex-post, after 3 weeks; • nTG = 100 people reached interviewed in May 2013

6

Never

Sometimes

Quite often

Often

Behavioural changes in on-line job searching

(t-stud0,001)

Key results of the MIREIA piloting 1/3• Behavioral changes in job searching methods:

• TG has increased the use of internet tools for job searching

7

Absolute numbers

Key Behavioural

Changes

Proxy of expected

impact

Behavioural changes in on-line job searching(t-stud0,001)

• Behavioral changes in internet use for job searching: • the number of job offers has increased for TG candidates

8

Key results of the MIREIA piloting 2/3

• ´Nudge´ effects on local communities• trained people help other people in learning how to use

Internet for job searching

9

Key results of the MIREIA piloting 3/3

• The application of MIREIA-IAF in ER provides evidence of:• the importance of the role of eInclusion intermediaries

for promoting digital inclusion and employability

• the need to equip eInclusion intermediaries with instruments and methodologies for impact assessment

• the need of strengthening coordination of activities at regional level involving local partners

• the need to develop an Impact assessment “culture” at the local level, through seminars, training and workshops

10

Lessons learned from MIREIA

• Intermediaries

• allow to address more specific actions to targeted groups

• are able to engage target groups quickly and effectively

• contribute strengthening the positive effects of e-Inclusion initiatives

Added Value: the key role of intermediaries

11

Recommendations

• Introduce Impact assessment instruments, such as MIREIA, in policy planning and monitoring• Crucial role of counterfactual evaluation

• Take into account methodological challenges• e.g. privacy issues and selection of control groups

• Share evidence gathered as knowledge base for better integrating policy and implementation actions• Impact assessment as strategic planning support

12

For further information

• Grazia GuermandiRegione Emilia-Romagna Email GGuermandi@regione.emilia-romagna.it http://www.paneeinternet.it/

13