tester motivationtester motivation dr stuart reid ©stuart reid, 2015 scope •introduction to...

62
Tester Motivation Dr Stuart Reid ©Stuart Reid, 2015

Upload: others

Post on 15-Oct-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Tester Motivation

Dr Stuart Reid

©Stuart Reid, 2015

Page 2: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Scope

• Introduction to Motivation

• Outline of the Motivation Survey

• Survey analysis and results

– What factors correlate best with motivation?

– How does motivation change

• for different roles

• for different regions

– Do existing theories work for testing?

– What is the best combination?

• Conclusions & recommendations

2

Page 3: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Defining Motivation

• a reason or reasons for acting or behaving in a particular way - Oxford Dictionaries

• internal and external factors that stimulate desire and energy in people to be continually interested and committed to a job, role or subject, or to make an effort to attain a goal– http://www.businessdictionary.com

3

Page 4: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Motivation 101

4

Page 5: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Multi-faceted Motivation

Motivation

Sociological

Physiological

Psychological

Behavioural

5

Page 6: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Investigation Approach

• Questionnaire

– Paper-based

– SurveyMonkey

• 40 Questions

– Demographic

– Motivation-related (Likert-scale)

– Open-ended

– Qualitative & quantitative data

• Responses from around the world (over 600)

• Thanks to Tafline Murnane

– KJ Ross – Australia

6

Page 7: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Respondents by Region

7

Page 8: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Industry Sectors

Finance, Insurance

Communications

IT

Utilities

Health Care

Government

Services

Transportation

Media

Non-profit

Retail, Wholesale

Construction

Internet

Manufacturing

Other

8

Page 9: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Organization Types

IT Organization

Self-employed Consultant

Self-employed Contractor

Testing Services

IT Department within an

Organization

Other

9

Page 10: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Testing Roles

10

Page 11: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Specified Variety - Test Analyst

0%

20%

40%

60%

80%

100%

Exploratory

Test Design

Execution

Automation

Reviewing

Management

Improvement

Env't Support

11

Page 12: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Jobs…

0%20%40%60%80%

100%Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Head of Testing

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Manager

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Developer/Tester

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Analyst

0%20%40%60%80%

100%

Exploratory

Test

Design

Execution

Automation

Reviewing

Management

Improve-

ment

Env't

Support

Test Lead

0%20%40%60%80%

100%

Exploratory

TestDesign

Execution

Automation

Reviewing

Management

Improve-ment

Env't Support

Test Consultant

12

Page 13: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Life Cycles

13

Page 14: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Company Size

14

Page 15: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Motivation Theories

• Hierarchy of Needs – Maslow, 1943

• Motivation-Hygiene Theory – Herzberg, 1959

• Theory X & Theory Y – McGregor, 1960

• Expectancy Theory – Vroom, 1964

• Equity Theory – Adams, 1965

• Job Characteristics Model (MPS) – Hackman & Oldham, 1976

• Three Needs Theory – McClelland, 1988

• Temporal Motivation Theory (TMT) - Steel and Konig, 2006

• Motivation 3.0 (MAP) – Pink, 2010

15

Page 16: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

• Skill Variety (V)– range of different skills used

• Task Identity (I)– degree of completing a whole job

• Task Significance (S)– importance of the job

• Autonomy (A)– level of control of your own time

• Feedback (F)– degree of supervisory & results-based feedback

• MPS =

FASIV

**3

MPS from Hackman & Oldham, 1975.

Motivating Potential Score

Assign a score of 1 to 7 to

each attribute...

...and then calculate your

MPS

16

Page 17: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

0

50

100

150

200

250

300

stronglydisagree

disagree neitheragree nordisagree

agree stronglyagree

Perceived Motivation

“I am highly motivated to do my

job in testing”

17

Page 18: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = +0.70 or higherVery strong positive relationship

r = 0.85r = 1

0

20

40

60

80

100

120

140

160

180

200

0 5 10 15 200

20

40

60

80

100

120

140

160

180

200

0 5 10 15 20

18

Page 19: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = +0.30 to +0.39Moderate positive relationship

r = 0.35r = 0.55

r = +0.40 to +0.69Strong positive relationship

0

20

40

60

80

100

120

140

160

180

0 5 10 15 200

20

40

60

80

100

120

140

160

180

0 5 10 15 20

19

Page 20: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Pearson’s Correlation Coefficient

r = 0 to +0.19Negligible positive relationship

r = 0.10r = 0.25

r = +0.20 to +0.29Weak positive relationship

0

20

40

60

80

100

120

140

160

180

0 5 10 15 20 250

20

40

60

80

100

120

140

160

180

0 5 10 15 20

20

Page 21: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MPS & Perceived Motivation

0

50

100

150

200

250

300

0 1 2 3 4 5 6 7

r = 0.40r = +0.40 to +0.69Strong positive relationship

21

Page 22: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MPS & Perceived Motivation

0

50

100

150

200

250

300

0 1 2 3 4 5 6 7

r = 0.40r = +0.40 to +0.69Strong positive relationship

22

Page 23: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Feedback

23

(WORK ITSELF)

(COLLEAGUES)

(SUPERVISOR)

Page 24: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Feedback - Asian vs All

24

(WORK ITSELF)

(COLLEAGUES)

(SUPERVISOR)

Page 25: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Variety

25

(# TASKS)

(# PROJECTS)

Page 26: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Variety - Asian vs All

26

(# TASKS)

(# PROJECTS)

Page 27: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Significance

27

(# AFFECTCOLLEAGUES)

(AFFECT PROJECT)

Page 28: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Significance - Asian vs All

28

(# AFFECTCOLLEAGUES)

(AFFECT PROJECT)

Page 29: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Identity

29

(PROJECTS TO COMPLETION)

(TASKS TO COMPLETION)

Page 30: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Identity - Asian vs All

30

(PROJECTS TO COMPLETION)

(TASKS TO COMPLETION)

Page 31: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Autonomy

31

(NEXT TASK)

(WORKING HOURS)

(WHO WITH)

(HOW TO DO)

Page 32: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Autonomy - Asian vs All

32

(NEXT TASK)

(WORKING HOURS)

(WHO WITH)

(HOW TO DO)

Page 33: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MPS Factors - Asian vs All

33

Page 34: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Daniel Pink’s MAP

• Daniel Pink’s Motivation 3.0

Mastery

PurposeAutonomy

34

Page 35: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Mastery

35

(CHALLENGE)

(MASTERED SKILLS)

(IN THE FLOW)

Page 36: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Mastery - Asian vs All

36

(CHALLENGE)

(MASTEREDSKILLS)

(IN THE FLOW)

Page 37: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Purpose

37

(WIDER COMMUNITY)

(PROFITS)

Page 38: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Purpose - Asian vs All

38

(WIDER COMMUNITY)

(PROFITS)

Page 39: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MAP Factors - Asian vs All

39

Page 40: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Environment

40

Page 41: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Environment - Asian vs All

41

Page 42: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Integrating Theories

Motivation

Variety

Feedback

Significance

Identity

Mastery

Purpose

Autonomy

Environment

42

Page 43: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

MPS and MAP and MAPFV and…

0.40

0.38

0.41

0.44

0.5

MPS

Summative MPS

M+A+P

M+A+P+F+V

Top 4

Daniel Pink’s Motivation 3.0

ENV’T + VARIETY 2 + MASTERY 1 + MASTERY 3

43

Page 44: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Asian vs All – Motivation Models

44

Page 45: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

What Motivates Testers?

Challenges &

New Areas

Meeting

Targets

Feedback &

Appreciation

Autonomy

Quality &

Making a difference

Team &

Work Env'tMoney

Other

Good Management

45

Page 46: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

What Demotivates Testers?

Developers!

OtherPoor Management

Feedback &

Appreciation

Team & Work Env't

Repetitive Tasks

Ignored

Exit Criteria

No

Goals

46

Page 47: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

How Do You Motivate?

Money

Bonding

Feedback &

Appreciation

GoalsVariety &

Challenges

Other

Involve Team

Training &

Career Dev't

Autonomy

47

Page 48: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Salary Profile

48

Page 49: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Experience Levels

49

Page 50: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Education Levels

50

Page 51: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

0.09

0.51 0.010. 15

-0. 05

Salary, Experience & Education

Tester Experience

Perceived Motivation

Tester Salary

Tester Education

51

Page 52: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Salary, Experience & Education

52

Page 53: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Qualification Levels

53

Page 54: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Life Cycles…

54

Page 55: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Organization Sizes…

55

Page 56: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Experience Levels…

56

Page 57: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Different Organization Types…

57

Page 58: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Outside Interests?

58

Page 59: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Conclusions

• Testers are special– we can improve on the generic motivation theories

• Please try to use the most influential factors– ALL

• MASTERY + ENVIRONMENT + VARIETY + FEEDBACK + AUTONOMY

– ASIA • IDENTITY + VARIETY + FEEDBACK

– TOP 4• ENVIRONMENT + VARIETY 2 + MASTERY 1 & 3

• Not all testers are the same– Don’t treat everyone working in testing the same

• different roles require a different focus• culture plays a part – but less so than the roles

– We need to consider ‘smarter’ approaches to the motivation of testers

59

Page 60: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

Thanks for listening

Any Questions?

More information available

– please email

[email protected]

60

Page 61: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

1 FEEDBACK 1The work itself provides feedback on how well I am doing in

my job. (POSITIVE)

2 FEEDBACK 2My colleagues provide little or no feedback on how well I

perform. (NEGATIVE)

3 FEEDBACK 3My supervisor provides me with regular feedback on my

performance. (POSITIVE)

4 AUTONOMY 1Most of the time someone else decides what tasks I should do

next. (NEGATIVE)

5 AUTONOMY 2My job is flexible enough to allow me to decide which hours I

work most days. (POSITIVE)

6 AUTONOMY 3For most tasks I get to decide who I will work with.

(POSITIVE)

7 AUTONOMY 4I rarely get to choose the way that an activity is carried out.

(NEGATIVE)

8 SIGNIFICANCE 1My job is one that affects few other colleagues.

(NEGATIVE)

9 SIGNIFICANCE 2If not done well my job will have little impact on the project.

(NEGATIVE)

Page 62: Tester MotivationTester Motivation Dr Stuart Reid ©Stuart Reid, 2015 Scope •Introduction to Motivation •Outline of the Motivation Survey •Survey analysis and results –What

10 IDENTITY 1My job allows me to see projects through to completion.

(POSITIVE)

11 IDENTITY 2I often start tasks but then pass them on to colleagues before I

finish them. (NEGATIVE)

12 VARIETY 1My job comprises a relatively small number of different tasks.

(NEGATIVE)

13 VARIETY 2In my job I get the chance to work on many interesting

projects. (POSITIVE)

14 MASTERY 1My job does not challenge or stretch me.

(NEGATIVE)

15 MASTERY 2I have mastered most of the skills required to perform my job.

(NEGATIVE)

16 MASTERY 3I often become so engaged in my work that I forget the time.

(POSITIVE)

17 PURPOSE 1My job includes the opportunity to work for the good of the

wider community (beyond my employer). (POSITIVE)

18 PURPOSE 2My organization is primarily focused on increasing its profits.

(NEGATIVE)

19 PERCEPTIONI am highly motivated to do my job in testing.

(POSITIVE)

20 ENVIRONMENTMy work environment encourages me to perform my job better.

(POSITIVE)