orpheus tools for assisting institutions in implementing best practices for responsible research...

Michael Mulvany

ORPHEUS tools for assisting institutions in implementing

best practices for responsible research training

Professor emeritus

Department of Biomedicine

Aarhus University, Denmark

Head Graduate Studies, 2002-2011

Chairman, ORPHEUS Labelling Board

ORPHEUS Vice-president 2010-2014

[email protected]

ORPHEUS workshop

29 June, Istanbul

Key slides

• What is responsible research training?

ORPHEUS tools for assisting institutions in implementing best practices for

responsible research training

Outline

• Research integrity

• Developing and implementing best practices

The ORPHEUS tools

International initiatives

• Ensuring good careers

• Many pressures encourage irresponsible research

• Pressure to publish … career … grant

• Pressure for results from leader/supervisor

Why training in responsible research?

• Increasingly, published results cannot be repeated

• The need for Rigour and Reproducibility

Training in responsible research

“Importance of fostering and maintaining a culture of research integrity

through teaching, training, and supervision” (Copenhagen U.)

• Weekly group supervisor-PhD student meetings

• Presentation of raw data

Courses:

Fabrication, Falsification, Plagiarism.

Principles for handling Scientific Misconduct

Documentation of scientific results, Authorship, Intellectual property rights

The basics:

• Honesty, Transparency, Accountability

The changing PhD training model

Apprenticeship model from the 1800sThe team model

Report of the

Royal Society,

UK, 2010

What happens to PhD graduates?

Careers outside

science

Non-university

research (industry, government etc.)

Post-doc Academic

researchstaff

Professor

53%

17%

47%

44%

3.5%0.45%

80%

27%

• academic research

• clinical research

• industrial research

• contract research organization

• etc., etc.

Research

• clinical positions

• higher education teaching

• funding organizations

• scientific writing

• scientific consultant

• in vitro diagnostics, specialist

laboratories

• research management

• evidence-based policy making

• own spin-off business

• etc., etc.

Research-based opportunities

• marketing, sales,

• customer support

• technical support,

• patents

• communications

• regulatory, QC&QA

• administration

• human resources

• investment banking

• etc., etc.

Outside the box

How are PhD graduates using their talents?

20%

80%

PhD CareerCompetence development

Career development

Ensuring good careers for PhD graduates

Research skills

• Ability to conceive, design,

implement and adapt a

substantial process of original

research

• with scholarly integrity

• at a level that merits international

refereed publication

Competences that should be provided by a PhD

Communication skills

• Ability to present research

• … also to non-academic audiences

• Ability to teach

• Linguistic skillsManagement skills

• Project management

• Ability to work in a team

• Ability to supervise technicians

and research students

• Ability to apply (and obtain) grants

• Ability to network

• Ablility to plan career

• establishing scientific careers

• making effective career decisions

• building and maintaining professional relationships

• Industrial internships

• video series – interviews with alumni.

https://medschool.vanderbilt.edu/aspire/

Support for career development

Best Practice documents

Document number

of words

Salzburg I: Bologna Seminar on

“Doctoral Programmes for the

European Knowledge Society”, 2005

850

Salzburg II: Implementing the

Salzburg Principles, 2010

1,700

EU Commission: Principles for

Innovative Doctoral Training, 2011

700

The Quality Assurance Agency for

Higher Education Doctoral degree

characteristics in UK, 2011

17,000

League of European Research

Universities, LERU: Good Practice

Elements in Doctoral Training, 2014

18,500

ORPHEUS Best Practices 4,500

The Best Practices document

www.orpheus-med.org

ORPHEUS

conference

number

delegates institutions countries

2004, Zagreb 53 25 16

2005, Zagreb 71 33 21

2007, Helsinki 80 43 26

2009, Aarhus 165 72 33

2010, Vienna 196 114 39

2011, Izmir 250 98 42

2012, Bergen 195 156 36

2013, Prague 181 40

2014, Lausanne 300 100 40

2015, Belgrade 135 79 35

2016, Cologne ca. 200 ca. 100 ca. 35

Contents

• Research environment

• Outcomes

• Admission policy and criteria

• PhD training programme

• Supervision

• PhD thesis

• Assessment

• Graduate school structure

General format

• Basic recommendations (40)

• Quality development

• recommendations that are in

accordance with international best

practice (28)

• Annotations (31):

• explanations and flexibilitywww.orpheus-med.org


Contents

• Research environment

• Outcomes

• Admission policy and criteria

• PhD training programme

• Supervision

• PhD thesis

• Assessment

• Graduate school structure

General format

• Basic recommendations (40)

• Quality development

• recommendations that are in

accordance with international best

practice (28)

• Annotations (31):

• explanations and flexibility www.orpheus-med.org


Some recommendations concerned with research integrity

Some recommendations concerned with career development

www.orpheus-med.org

How to implement these?


www.orpheus-med.org

Self-evaluation questionnaire

Some recommendations concerned with research integrity


Some recommendations concerned with career development


head graduate school

head PhD

administration

programme directors

supervisors

PhD students

ORPHEUS recommends

that this be completed in

collaboration with all

stakeholders

• 40 basic recommendations

• 28 quality development

• 31 annotations


Executive committee

Labelling BoardSub-committees

Evaluation Certificate

Evaluation of the completed Self-

evaluation questionnaire by the

ORPHEUS Labelling Board.

www.orpheus-med.org

Written discussion with

ORPHEUS Labelling

Board

Award of an

ORPHEUS Evaluation Certificate.

Xx hoji sp ep dæie jkj enicodiekkm,eookeJodmm,oe iihenkdXx hoji sp ep dæie jkjenicodiekkm,eooke Jodmm,oe iihenkd


e Jodmm,oe iihenkdXx hoji sp ep dæie jkjenicodiekkm,eooke Jodmm,oe iihenkd


• Completed self-evaluation

questionnaire sent to Labelling

Board

Label

www.orpheus-med.org





head graduate school

head

administrationprogramme directors

supervisors

PhD students

ORPHEUS

facilitators

• Site visit by two members of the

Labelling Board to meet with

stakeholders.

Award of an ORPHEUS label

Institutions with

Evaluation Certificates

Mannheim

Institutions in process

of self-evaluation

Groningen

Manitoba

Vanderbilt

Copenhagen

Belgrade

Bergen

Graz

Iceland

Karolinska

Izmir

Institutions with Labels

Evaluation Certificate and Label

Accreditation

• Accreditation is normally an inspection by relevant Ministry to

ensure that regulations are being followed

• Emphasis on numbers of PhD students, numbers of

completions, etc.

Accreditation and labelling

Labelling

• Aim is to encourage self-reflection.

• Label is awarded on the basis of peer review following

discussion with all stakeholders.

• Minimal documentation.

• Process is concerned with the quality of the training being

provided.

Using the ORPHEUS label

1. The process will have encouraged self-reflection

2. A mark of quality

3. Recruitment of PhD students

4. A factor when applying for grants

Label

Interested? Write to [email protected] or [email protected]

• Research integrity

ORPHEUS tools for assisting institutions in implementing best practices

for responsible research training

Summary

• Developing and implementing best practices

• Ensuring good careers

• ORPHEUS Best Practices document

• Self-evaluation questionnaire

• ORPHEUS Evaluation Certificate

• ORPHEUS Label

Interested?

Write to

[email protected]

or

[email protected]

• What is responsible research training?

orpheus tools for assisting institutions in implementing best practices for responsible research...

Health & Medicine