methodological issues in an practice oriented research project · self-tracking devices and...

47
Methodological issues in an practice oriented research project Presentation Zurich University of Applied Sciences International dialogs amongst research and practice: Getting insight and focusing action

Upload: others

Post on 11-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

Methodological issues in an practice oriented research project Presentation Zurich University of Applied Sciences International dialogs amongst research and practice: Getting insight and focusing action

Page 2: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

2

Self-tracking devices and sustainable labour participation

Hanze University of Applied Sciences:

Hilbrand Oldenhuis (Professorship Labour Participation)

Louis Polstra (Professorship Labour Participation)

Martijn de Groot (Quantified Self Institute)

Hugo Velthuijsen (Professorship New Business and ICT)

Page 3: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

3

Self-tracking devices and sustainable labour participation

Hanze University of Applied Sciences:

Honoursstudents:

Chantal van de Wolfshaar

Rosalie Rodijk

Christhy Fels

Esther Storteboom

Page 4: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

4

Self-tracking devices and sustainable labour participation

Program:

• Introduction by Hilbrand Oldenhuis

• Contribution by honoursstudents

• Group assignment

• Presentations

• Lessons learned by Louis Polstra

Page 5: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

5

Self-tracking devices and sustainable labour participation

Context:

• Retirement age is increasing

• (Working) population is getting older

Page 6: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

6

Self-tracking devices and sustainable labour participation

Context:

• Sustainable labour participation: the degree to which individuals are able and willing to perform their current and future work in a healthy, valued way (van Vuuren, 2011; van der Klink e.a., 2010)

Presenter
Presentation Notes
Velen stoppen met werken als ze de keus hebben om te stoppen of door te gaan.
Page 7: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

7

Self-tracking devices and sustainable labour participation Sustainable labour participation:

• Vitality: high levels of energy, vigour, and resilience while working and the willingness to keep investing energy in the job during trying circumstances

• Employability: the ability to keep on performing the different tasks and positions in the current and in future organizations and sectors

• Workability: the degree to which an individual is mentally, physically, and socially capable of working

Page 8: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

8

Self-tracking devices and sustainable labour participation

Healthy older workers may suffer (perceived) loss of vitality, workability and employability:

‘For how long will I be able to keep on performing my tasks? And will there be enough opportunities for me to adapt my working environment to my needs as an older worker?’

Page 9: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

9

Self-tracking devices and sustainable labour participation

Possible solution:

Self-tracking devices can be used to increase self self-insight and self-efficacy concerning health behavior and help to alter behaviors if necessary (Sundar, Bella & Jia, 2012)

Page 10: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

10

Self-tracking devices and sustainable labour participation

This project, part of Interreg project iAge (partners in Norway, Germany, Denmark, Scotland, Belgium, the Netherlands)

Self-tracking devices as a means to increase self insight and self management when it comes to health behavior.

Result: higher level of sustainable employability, because workers are more self confident and are better equipped when it comes to health behavior

Page 11: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

11

Self-tracking devices and sustainable labour participation General aim of this project:

Increasing sustainable labour participation of older workers by using self-tracking devices

In a broader context (EU-goals):

• (early) prevention of drop-out of older workers

• contributing to healthier lifestyle of (older) workers, while workers themselves are the main ‘actors’

Page 12: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

12

Self-tracking devices and sustainable labour participation General aim of this project:

Increasing sustainable labour participation of older wokers by using self-tracking devices

(possible) stakeholders:

• Governments

• Employers

• HR-consultants

• Insurance companies

• Scientists

Page 13: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

13

Self-tracking devices and sustainable labour participation

Aim of this pilot more specifically:

Finding out which challenges arise when investigating the effects of self-tracking devices on employees’ sustainable labour participation in ‘real-life settings’

Page 14: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

14

Self-tracking devices and sustainable labour participation

Why this pilot?

Integration of disciplines: ict and psychology of life style intervention in a working environment

Not many experiences until now

Page 15: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

15

Self-tracking devices and sustainable labour participation Participating company: ‘Museumtechnische werken’

Page 16: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

16

Self-tracking devices and sustainable labour participation Participating company: ‘Museumtechnische werken’

‘Museum-technical products’:

• Small company

• Supporting management

Page 17: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

17

Self-tracking devices and sustainable labour participation Global overview of the project:

Twelve workers, varying in age, choose one of 5 domains to be measured (‘big five for healthy life’, QSI):

1. Daily physical activity

2. Food and nutrition

3. Sleep

4. Stress

5. Social interaction

Page 18: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

18

Self-tracking devices and sustainable labour participation Global overview of the project:

• Preparation phase (Oct. 2013 – March 2014):

– Selection of participants – Choice of self-tracking devices – Design of execution activities (additional self-

report measures, how to integrate theoretical principles, etc.)

– First measurement of relevant variables

Page 19: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

19

Self-tracking devices and sustainable labour participation Global overview of the project:

• Execution phase (April 2014 – June 2014):

– Participants use and test the selected self-tracking devices during three months

– Monitoring the results; adapting the devices/data-display if necessary

– Supervision of an (external) coach – Final measurement of relevant variables

Page 20: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

20

Self-tracking devices and sustainable labour participation Global overview of the project:

• Evaluation phase (July 2014 – Oct. 2014):

– Evaluation of the results – Writing-up the final report

Page 21: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

21

Self-tracking devices and sustainable labour participation Right now:

• Participants have used the devices: – 4 ‘fitbits’ for daily physical activity

– 5 ‘withings’ for sleep and daily physical activity

– 1 ‘inner balance’ for stress

– 1 ‘zeo’ for sleep

– 1 ‘emwave’ for stress

• Participants are supervised by an external ‘vitality-coach’ during those three months

Page 22: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

22

Self-tracking devices and sustainable labour participation

Page 23: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

23

Self-tracking devices and sustainable labour participation Right now:

• Participants have used the devices: – 4 ‘fitbits’ for daily physical activity

– 5 ‘withings’ for sleep and daily physical activity

– 1 ‘inner balance’ for stress

– 1 ‘zeo’ for sleep

– 1 ‘emwave’ for stress

• Participants are supervised by an external ‘vitality-coach’ during those three months

Page 24: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

24

Self-tracking devices and sustainable labour participation

Page 25: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

25

Self-tracking devices and sustainable labour participation Right now:

• Participants have used the devices: – 4 ‘fitbits’ for daily physical activity

– 5 ‘withings’ for sleep and daily physical activity

– 1 ‘inner balance’ for stress

– 1 ‘zeo’ for sleep

– 1 ‘emwave’ for stress

• Participants are supervised by an external ‘vitality-coach’ during those three months

Page 26: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

26

Self-tracking devices and sustainable labour participation

Page 27: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

27

Self-tracking devices and sustainable labour participation Right now:

• Participants have used the devices: – 4 ‘fitbits’ for daily physical activity

– 5 ‘withings’ for sleep and daily physical activity

– 1 ‘inner balance’ for stress

– 1 ‘zeo’ for sleep

– 1 ‘emwave’ for stress

• Participants are supervised by an external ‘vitality-coach’ during those three months

Page 28: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

28

Self-tracking devices and sustainable labour participation

Page 29: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

29

Self-tracking devices and sustainable labour participation Right now:

• Participants have used the devices: – 4 ‘fitbits’ for daily physical activity

– 5 ‘withings’ for sleep and daily physical activity

– 1 ‘inner balance’ for stress

– 1 ‘zeo’ for sleep

– 1 ‘emwave’ for stress

• Participants are supervised by an external ‘vitality-coach’ during those three months

Page 30: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

30

Self-tracking devices and sustainable labour participation

Page 31: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

31

Self-tracking devices and sustainable labour participation Data:

• Logbooks of the participants

• Interviews with participants

• Questionnaires before and afterwards (QoL, self efficacy)

• Data retrieved from devices

• Interviews with coach and report of the coach

• Interviews with the employer

• ‘Observations’ within the company

Page 32: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

32

Self-tracking devices and sustainable labour participation Some preliminary observations:

• Moderate to high values of satisfaction (according to logbooks and interviews afterwards)

• ‘Subjective’ behavioral change for some participants

• Two devices lost...

• Coach: valuable project, however, devices can be ‘distraction’ of ‘real’ problems

Page 33: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

33

Page 34: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

34

Self-tracking devices and sustainable labour participation Preliminary conclusion:

Yes, self-tracking devices can lead to higher level of employers’ sustainable labour participation

but.....

.... more research is needed....

Page 35: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

35

Methodological issues

‘There are only two types of research: good research and bad research’

Page 36: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

36

Methodological issues

‘There are only two types of research: good research and bad research’

Page 37: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

37

Methodological issues

Practice oriented research (HBO-raad, 2007) :

• founded in professional practice regarding research questions and knowledge that it produces – often multiple disciplines are involved

– methodologically

– strongly related to other activities besides research

– takes place within networks of external partners

– different types of research, publications, products and networks in which it takes place

Page 38: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

38

Methodological issues

Practice oriented research:

Methodological thoroughness

Pra

ctic

al v

alue

pilot MTW

Page 39: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

39

Methodological issues

Practice oriented researcher: researcher, designer and change agent at the same time

Dilemma’s: objective and independent vs. convincing and dependent

– meeting with participants in which they had to be convinced to use the devices

– warm, friendly relationship with the employer

– time pressure leads to trade off between objective measuring of long term effects (also in the long run) and producing an end product

Page 40: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

40

Methodological issues

Methodological issues in (design-based) practice oriented research:

• Dilemma’s: objective and independent vs. convincing and dependent – internal politics and employer-employee relation are very

important parameters

– possible contradiction between participating and observing

Page 41: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

41

Methodological issues

More practical/methodological issues:

• Participants’ own choice leads to unstructured, ‘non-comparable between-subjects’ data

• Time-series analysis requires baseline phase...

• Formation of control group is problematic

• Sessions with the coach were not videotaped because of privacy considerations

• Multidisciplinary: integration of ict and (social) psychology

Page 42: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

42

Methodological issues

Short group discussion and reflection

Page 43: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

43

Methodological issues

Page 44: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

44

Methodological issues

Follow-up: Fit4Sustainable Employability (Interreg 5b)

• How many companies? What type of companies?

• How many domains? Which domains?

• Number of participants

• Type of data

• International comparisons

Condition: conceptual consistency (as much as possible)

Page 45: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

45

Methodological issues

Assignment (45 min):

Design (in groups of 4/5) a research design for the Fit4SE follow-up in which you explicitly address the described specifications and reflect on the described dilemma’s

Present the result to the rest of the group

Page 46: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

46

Methodological issues

Practice oriented research:

Methodological thoroughness

Pra

ctic

al v

alue

Page 47: Methodological issues in an practice oriented research project · Self-tracking devices and sustainable labour participation . Context: • Sustainable labour participation: the degree

Thank you!

Professorship Labourparticipation