indicators and evaluation (alv)

18
A IMPORTÂNCIA DA ALV NA UNIVERSIDADE: INDICADORES E A VALIAÇÃO THE IMPORTANCE OF LLL AT THE UNIVERSITY : INDICATORS AND EVALUATION Alfredo Soeiro, Universidade do Porto ALV, Oeiras, 12-13Out10 1

Upload: hoangbao

Post on 28-Dec-2016

236 views

Category:

Documents


7 download

TRANSCRIPT

Page 1: Indicators and Evaluation (ALV)

A IMPORTÂNCIA DA ALV NA UNIVERSIDADE:

INDICADORES E AVALIAÇÃO

THE IMPORTANCE OF LLL AT THE

UNIVERSITY: INDICATORS AND EVALUATION

Alfredo Soeiro, Universidade do Porto

ALV, Oeiras, 12-13Out10

1

Page 2: Indicators and Evaluation (ALV)

UNIVERSITY RANKING

Projects financed by the European Commission

Multi-dimensional Global ranking of

Universities; a feasibility project

http://www.u-multirank.eu/

E3M: European indicators and ranking

methodology for university third mission

http://www.e3mproject.eu

2

Page 3: Indicators and Evaluation (ALV)

THE MISSIONS OF THE UNIVERSITY

First Mission: Teaching

Second Mission: Research

Third Mission: ??

3

XII

XIII

XIV

XV

XXI

XVII

XVIII

XVI

XIX

XX 3M

2M

1M

*

*

Page 4: Indicators and Evaluation (ALV)

THIRD MISSION

What is it?

Which activities are included?

How to measure it?

Set of indicators

Validity

Reliability

Comparability

Relevance

Feasibility

Simple

4

Page 5: Indicators and Evaluation (ALV)

THE PROJECT

Lifelong Learning Programme

8 partners

Participants

Researchers: 20

Advisors: 2

Experts*: 30

Timeline

5

20102009 2011

www.e3mproject.eu

Page 6: Indicators and Evaluation (ALV)

PARTNERS

6

2

1

3

4

6

5

7

8

10

9

Coordinator

Page 7: Indicators and Evaluation (ALV)

OBJECTIVES

To create European standard indicators to

measure the effectiveness of third mission

provision

To create a ranking methodology to benchmark

European Third Mission Services providers of

HEI

To create good practices for institutional dialogue

in a European Area of higher education

framework7

www.e3mproject.eu

Page 8: Indicators and Evaluation (ALV)

WHAT IS THE THIRD MISSION?

8

Contracted research

ConsultancyLicensing

Start-ups

Spin-offs

CompaniesBusiness incubators

Technology parks

Cooperation

Non-academic organizations

Sharing of space

Facilities

Shared laboratories

Mobility of people

Sponsoring of education

Collaborative research projects

Continuing Education

Technology Transfer

& Innovation

Social Engagement

Patents

e-Learning

Programs

Fee management Teaching

Educational activitiesLife Long LearningGrants

Sponsorship

Business opportunities

Seminars

Access to libraries

Volunteering

Membership of

Community boards

Political participation

Community service projects

International

cooperation

Cultural events

Senior populations

Page 9: Indicators and Evaluation (ALV)

THE DIMENSIONS OF THE

THIRD MISSION

9

Continuing

Education

Technology

Transfer &

Innovation

Social

Engagement

Page 10: Indicators and Evaluation (ALV)

METHODOLOGY

10

Continuing

Education

Technology

Transfer &

Innovation

Social

Engagement

… …

Processes Indicators

DIM

EN

SIO

NP

RO

CE

SS

ES

PO

SS

IBL

E

IND

ICA

TO

RS

RE

LE

VA

NT

IND

ICA

TO

RS

FE

AS

IBL

E

IND

ICA

TO

RS

Page 11: Indicators and Evaluation (ALV)

SOME RESULTS: CONTINUING EDUCATION

11

Analysis of the Demand and

Curriculum Design

Implementation of CE

Activities

Information and

Advertising

Financial

Management

Application and

Admission

Management

Teaching and Learning

Quality Evaluation

Follow-up Assesment

Page 12: Indicators and Evaluation (ALV)

SOME RESULTS: TECHNOLOGY TRANSFER &

INNOVATION

12

Entrepreneurial ProcessStructural Cooperation

ProcessNetworks Process

Contract-based research

& consultancy

Intellectual property

rights (IPR)

Licensing

Start-ups/spin-offs/spin-

outs & spin-in

formation

University business

incubators

/scientific/discovery/tech

nology parks

Cooperation in R&D

Sharing of space/

facilities/equipment

Cooperation in

education

Mobility of people

Formal Networking

Informal Networking

Page 13: Indicators and Evaluation (ALV)

SOME RESULTS: Social Engagement

13

Local National International

Ind

ivid

ua

lIn

sti

tuti

on

al

SE1- Non-discipline specific volunteering

SE2- Expert advisory engagement

SE3- Services and facilities

to Society

SE4- Educational

Outreach and

widening diversity

Page 14: Indicators and Evaluation (ALV)

CE1 – ANALYSIS OF DEMAND AND

CURRICULUM DESIGN

SOME INDICATORS

CE1-i1: Total number of CE programmes

active in that year (for implementation)

CE1-i2: Number of CE programmes

delivered which have a major award under

European Higher Education system

CE1-i3: Number of partnership CE

programmes delivered in that year

CE1-i4: Number of international CE

programmes delivered in that year

….

14

Page 15: Indicators and Evaluation (ALV)

DESCRIPTION OF INDICATOR

(EXAMPLE CE1-I2)

Purpose: To measure the academic level of the CE activity

Definition: Total number of CE programmes delivered which have a major award under European HE system

Interpretation: This indicator tries to assess the academic level of the CE activity

Formula: Number of programmes with major award under EH system (N Degree programmes).

15

Page 16: Indicators and Evaluation (ALV)

DESCRIPTION OF INDICATOR

(EXAMPLE CE1-I2) (CONT.)

Units: CE Programmes

Level of data collection: Institution

Type of data source: Institutional data

Time reference: Year

Problems/remarks: N/A

Relevance: +

Validity: +

Reliability: +

Feasibility: +

Comparability: +

16

Page 17: Indicators and Evaluation (ALV)

FINAL REMARKS

Ranking or Indicators for LLL

Financing, Attractiveness, Value of LLL

providers

Value of LLL

Benchmarking LLL management

Good Practices of LLL

Cooperation or competition among

institutions of LLL

17

Page 18: Indicators and Evaluation (ALV)

THANK YOU!

[email protected]

18