the measurement and validity of well-being

138
The Measurement and Validity of Well-being Economics and Psychology Masters Course Andrew E. Clark (Paris School of Economics and IZA) http://www.parisschoolofeconomics.com/cla rk-andrew/

Upload: aliza

Post on 05-Jan-2016

41 views

Category:

Documents


0 download

DESCRIPTION

The Measurement and Validity of Well-being. Andrew E. Clark (Paris School of Economics and IZA) http://www.parisschoolofeconomics.com/clark-andrew/. Economics and Psychology Masters Course. What Do You Want from Life?. We all want to live a good life - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: The Measurement and Validity of Well-being

The Measurement and Validity of Well-being

Economics and Psychology Masters Course

Andrew E. Clark (Paris School of Economics and IZA)http://www.parisschoolofeconomics.com/clark-andrew/

Page 2: The Measurement and Validity of Well-being

2

What Do You Want from Life?

• We all want to live a good life

• And we all want to live in a Society that is doing well.

• But how do we know if we are?

Page 3: The Measurement and Validity of Well-being

3

• Social Science agrees that these are important questions

• What it doesn’t agree on is how to measure the good life.

• Very broadly speaking, there are three approaches. Each associated with a different discipline.

Page 4: The Measurement and Validity of Well-being

4

Three concepts of well-being• Economics: Preference satisfaction / desire fulfilment

– Revealed preference: one allocation is better than another if it is chosen when the other one could have been.

– Individuals get what they want (emphasis on the role of resources, preferences and prices)

– But we would need to know preferences to make SWB statements – the same choice can be associated with different preferences (see Fleurbaey and Blanchet, “Beyond GDP”).

Page 5: The Measurement and Validity of Well-being

5

Three concepts of well-being• Sociology: Let’s make lists!

– These lists include the elements of success

– But which elements: how do we know that we have included everything that matters?

– And which weights?

Page 6: The Measurement and Validity of Well-being

6

Three concepts of well-being• Psychology: Let’s actually ask people how they are

doing– ‘Subjective’ well-being: this is democratic and not

paternalistic

– These accounts provided by individual can be evaluative/cognitive: how has my life gone so far?

– Or they can be a series of how I feel from moment to moment: experienced utility

– There are many versions of both: are they all picking up the same thing?

Page 7: The Measurement and Validity of Well-being

7

• Objective lists have often appeared in Macro debates about performance – how well a country as a whole is doing– GDP.– The misery index AKA the Okun index

(unemployment rate plus inflation)

• Widely used in policy debates– unemployment rate; suicide rate; education level;

access to green space; income inequality; etc– Of the kind HDI/HDI+– Or Community Health Indicators

Page 8: The Measurement and Validity of Well-being

8

• Which is not to say that there are no concerns about such nice “list” measures:– What should be on the list?– How can the items be compared?– Are the weights the same for everyone?– Paternalism: who decides?

Page 9: The Measurement and Validity of Well-being

Capabilities as a list

• Amartya Sen’s “capability approach”

• A challenge to consequentialist utilitarianism, and the Pareto criterion

• Start from a conception of what makes a good human life: people, not goods

• Capability Approach: – what people are free to do as well as what they actually do. – opportunities result from ‘capabilities’ – what you can do. – these are distinct from ‘functionings’ – what you do: role of responsibility

Page 10: The Measurement and Validity of Well-being

One example: Nussbaum’s list of capabilities 1. Life: not dying prematurely2. Bodily health: good health; adequately nourished; shelter3. Bodily integrity; mobility; free from violence; choice in sex

and reproduction4. Senses, imagination, and thought: education, religion, art5. Emotions: attachments, love6. Practical reason: form conception of the good, planning of

life7. Affiliation: social interaction; respect and dignity8. Other species: concern and relation to animals, plants,

nature9. Play: laugh, play, enjoy recreational activities10. Control over one’s environment: political participation;

property, employment.

Page 11: The Measurement and Validity of Well-being

Human Development Index (HDI)

• Based on Sen’s idea of capabilities, added to Macro measures of performance

• Rationale: GDP per capita gives an incomplete picture of development and well-being– can be supplemented by information on the

opportunities people have

• UNDP has published the HDR every year since 1990; this includes the HDI by country.

Page 12: The Measurement and Validity of Well-being

United Nations Development Report 1990

• “Human development is a process of enlarging peoples choices. The most critical of these wide ranging choices are to live a long and healthy life, to be educated and to have access to resources needed for a decent standard of living.”

• “No one can guarantee human happiness, and the choices people make are their own concern. But the process of development should at least create a conducive environment for people, individually and collectively, to develop their full potential and to have a reasonable chance of leading productive and creative lives in accordance with their needs and interests”

Page 13: The Measurement and Validity of Well-being

The Human Development Index

Page 14: The Measurement and Validity of Well-being

To calculate each dimension index …

Page 15: The Measurement and Validity of Well-being

Each indicator index …

Page 16: The Measurement and Validity of Well-being

• Each dimension is equally weighted

• Within education, the adult literacy rate is weighted 2/3, and school enrolment 1/3.

• Income is expressed in logs, so that an extra dollar has a larger HDI “hit” for poorer countries

• = (lnY – ln(Ymin))/(ln(Ymax) – ln(Ymin))

Page 17: The Measurement and Validity of Well-being

HDI data from UNDR

Page 18: The Measurement and Validity of Well-being

• The last column shows that the ranking of countries by GDP per capita is not the same as that by HDI

• Some countries do better than their GDP would imply (the Scandinavians, Madagascar)

• Others do worse• The HDI adds new information to answer the

question of how well a country is doing• Despite their relatively high incomes, none of the

oil-producing countries has a high HDI

Page 19: The Measurement and Validity of Well-being
Page 20: The Measurement and Validity of Well-being

Gender-related Development Index: HDR 1995

• UNDP acknowledges key role for gender equality• development per se may not contribute to gender

equality • HDI measures average achievement• GDI adjusts to reflect male/female inequalities • Calculate dimension indices by gender• Use inequality-sensitive aggregation• Then combine into GDI.

Page 21: The Measurement and Validity of Well-being

Contruction of the GDI

Page 22: The Measurement and Validity of Well-being

Gender specific values …

Page 23: The Measurement and Validity of Well-being

“Inequality-sensitive” aggregation

• average well-being of men and women: Dm, Df

• proportion of men and women : pm, pf

• aggregate population well-being: W

• equity-neutral aggregation:

W1 = pmDm + pfDf

• equity-sensitive aggregation:

W2 = [ pmDm-r + pfDf

-r ] -1/r

• if r = -1, then W1 = W2, and thus equity neutral• if r > -1, then inequality aversion; GDI uses r = 1.

Page 24: The Measurement and Validity of Well-being

GDI data from UNDR

Page 25: The Measurement and Validity of Well-being

GDI Map

Page 26: The Measurement and Validity of Well-being

Main findings of HDR 95Benefits of development do not trickle down to

everybody; it is not gender neutral• Most of men’s work is paid; most of women’s

work is unpaid: – this impacts on social status (employment confers

status)

• GDP per capita alone, or HDI, does not explain rank of country in GDI.

• In 2010, both the variables used to construct the HDI changed somewhat. And the GDI was replaced by the Gender Inequality Index. A new index was introduced that takes into account inequality in the dimensions of the HDI over the whole population (Inequality-adjusted HDI).

Page 27: The Measurement and Validity of Well-being

• Ravallion calls such indices “mashup indices of development”

• 20th Human Development Report (UNDP, 2010) changed the measures used for these core dimensions, and how they are aggregated.

• Gross national income (GNI) has replaced GDP, both still at purchasing power parity (PPP) and logged.

• Education now measured by mean years of schooling (MS) and expected years of schooling (ES)

• Three core dimensions on a common (0, 1) scale.

Page 28: The Measurement and Validity of Well-being

• LE HDI bounds changed to 20 years and 83.2 years (Japan’s LE).

• GNI per capita is bounded by $163 (Zimbabwe in 2008) and $108,211 (UAE in 1980).

• The new education variables have minimum of zero, and MS upper bound of 13.2 years (US in 2000) and that of ES of 20.6 years (Australia, 2002).

Page 29: The Measurement and Validity of Well-being

• Aggregation used to be arithmetic mean. • Starring from income of $20K, an extra year

of LE worth around $2000.• Now geometric: introduces additional

concavity• The new HDI has lowered the weight on

longevity for all but five countries• Liberia has an HDI value of $5.51 per year for

a year of LE. The value tends to rise with income and reaches about $9,000 per year in the richest countries.

• Longevity has been devalued

Page 30: The Measurement and Validity of Well-being

The HDI is one “top-down” way of weighing objective lists.

Although as we have seen, weights are controversial.

Another is the Misery index: a percentage point of unemployment equals a point of inflation.

Says who? In Table 1 of Di Tella et al. (2001), unemployment has an estimated coefficient of -2.8 and inflation of -1.2: in happiness terms, inflation matters only about 40% as much as unemployment.

Page 31: The Measurement and Validity of Well-being

An alternative is to not use weights at all, but simply provide a list of things that we would all like to see.

Page 32: The Measurement and Validity of Well-being

32

United Nations Millennium Development Goals

http://www.undp.org/

Page 33: The Measurement and Validity of Well-being

33

Target 1A: Halve, between 1990 and 2015, the proportion of people living on less than $1.25 a day

Page 34: The Measurement and Validity of Well-being

34

Target 2A: By 2015, all children can complete a full course of primary schooling, girls and boys

Page 35: The Measurement and Validity of Well-being

35

Target 4A: Reduce by two-thirds, between 1990 and 2015, the under-five mortality rate

Page 36: The Measurement and Validity of Well-being

36

Target 5A: Reduce by three quarters, between 1990 and 2015, the maternal mortality ratio

Page 37: The Measurement and Validity of Well-being

37

Target 6A: Have halted by 2015 and begun to reverse the spread of HIV/AIDS

Page 38: The Measurement and Validity of Well-being

Alternatively, we can restore consumer sovereignty (as it were), and let individuals assign their own preferred weights to the posited various different dimensions of the Good Life.

Page 39: The Measurement and Validity of Well-being

39

Page 40: The Measurement and Validity of Well-being

40

Preference satisfaction accounts

• Well-being – the more you satisfy your preferences and fulfil your desires

the higher your well-being is considered to be.

• In line with utility theory– preferences inferred from the choices people make

• Concerns:– Do people want/know what is good for them?

– What to do about “anti-social” preferences?

– How do we price public goods then?

Page 41: The Measurement and Validity of Well-being

41

Mental state accounts• Well-being

– how individuals feel / think• Self-reported mood, emotions

– happy / sad / excited / bored• Self-reported evaluation

– “how satisfied are you with your life?”• Concerns:

– Adaptation and changing aspirations: hedonic treadmill

– Personality traits– These mean that objective and subjective may not

“match”.

Page 42: The Measurement and Validity of Well-being

42

Adaptation is not universal• We do not fully adapt to some circumstances and

experiences– Positive

• e.g. friendships

– Negative • e.g. pain, noise, unemployment, poverty

• Important differences in degree and speed of adaptation and

• some evidence that baseline levels of SWB can change over time (for example, following unemployment)

Page 43: The Measurement and Validity of Well-being

43

BHPS Well-being questionsThe British Household Panel Survey (BHPS). • See <http://www.iser.essex.ac.uk/ulsc/bhps/>• Annual panel (longitudinal) survey since 1991. • Wave 18 in September 2008• Wide range of variables from same individuals

and households each year. • E.g. in Wave 12 (2002):

– N = 17,339, aged 18-85

Page 44: The Measurement and Validity of Well-being

The General Health Questionnaire 12 (GHQ-12)

Have you recently:

1. been able to concentrate

2. lost much sleep over worry

3. felt that you were playing a useful part in things

4. felt capable of making decisions

5. Felt constantly under strain

6. felt you could not overcome difficulties

7. been able to enjoy normal activities

8. been able to face up to problems

9. Been feeling unhappy and depressed

10. been Losing confidence

11. been thinking of yourself as worthless

12. been feeling reasonably happy44

Page 45: The Measurement and Validity of Well-being

Satisfaction Questions

Here are some questions about how you feel about your life. Please tick the number which you feel best describes how dissatisfied or satisfied you are with the following aspects of your current situation.

Your life overall

[ 1 ] [ 2 ] [ 3 ] [ 4 ] [ 5 ] [ 6 ] [ 7 ]not satisfied at all   completely satisfied

This question is also asked about domains of life:

e.g. health, income, house, partner ...

45

Page 46: The Measurement and Validity of Well-being

These “behave” the way we think that they should:

Global life satisfaction by health

0

5

10

15

20

25

30

35

40

45

1 2 3 4 5 6 7

Pe

rce

nta

ge

re

sp

on

de

nts

'Other' health Good/excellent health

Page 47: The Measurement and Validity of Well-being

These “behave” the way we think that they should:

Page 48: The Measurement and Validity of Well-being

48

Does subjective well-being mean anything? (1)

Concern:Does it make sense to treat the happiness or life satisfaction scores as if they were cardinal and interpersonally comparable?

Reality: Econometric models assuming cardinality and ordinality give roughly same results

Meaning: people “split up” verbal labels into roughly equal blocks

Page 49: The Measurement and Validity of Well-being

49

Does subjective well-being mean anything? (2)

Concern:Are the life satisfaction or happiness questions reliable? Are they valid? Can people recall?

Reality:• Sensitive to wording, and question ordering.• Can be experimentally manipulated (Schwarz’s dime

on the photocopier: but hard to replicate)• But correlate well with proxies of well-being.• People are not good at recalling their own

experiences.

Page 50: The Measurement and Validity of Well-being

50

Does subjective well-being mean anything? (3)

Concern:

If happiness and life satisfaction became the policy maximand, one effective intervention might be to dampen peoples’ expectations; or give out happiness pills.

Reality:

People care about the causes and processes of higher/lower life satisfaction.

Page 51: The Measurement and Validity of Well-being

51

What is “experienced utility”?• “Experienced utility”: an economists’ interpretation

of life satisfaction and happiness – a mental state account

– the level of utility that is actually felt

• cf. “decision utility” (preference satisfaction)– the level of utility that people think they will feel

– utility inferred from observed choices

• People often mis-want, or get it wrong.

• So that satisfying preferences won’t bring well-being

Page 52: The Measurement and Validity of Well-being

52

Measuring experienced utility (1-1)Experience sampling method (ESM)

• Participants carry palm top instrument.• Random selection of times of day as participant

goes about daily life.• Rating of various feelings such as “happy” or

“frustrated/annoyed”.• Record what they are doing.• Aggregate each ‘moment’ to obtain time profile

of affect.

Page 53: The Measurement and Validity of Well-being

53

Measuring experienced utility (1-2)

Advantages of ESM

• Real, experienced utility, as life events are lived.

• No bias and distortion due to recall

Disadvantages of ESM

• Costly

• Possibly disruptive (eg. while driving)

Page 54: The Measurement and Validity of Well-being

54

Measuring experienced utility (2-1)Day reconstruction method (DRM)

• Reconstruct previous day into a series of episodes

• Where, doing what, with whom• Rating of various feelings such as “happy” or

“frustrated/annoyed”.• U-index: proportion of time in negative

emotion.

Page 55: The Measurement and Validity of Well-being

Measuring Well-being: The Day Reconstruction Method

Respondents reconstruct the previous day: like a retrospective TIME USE DIARY

Day is split into a sequence of episodes.Respondents report the key features of each

episode, including (1) When the episode began and ended(2) What they were doing(3) Where they were(4) Whom they were interacting with, and (5) how they felt on multiple affect dimensions

Page 56: The Measurement and Validity of Well-being

For each of the episodes that individuals identify during the day, they are asked the following questions:

Page 57: The Measurement and Validity of Well-being
Page 58: The Measurement and Validity of Well-being
Page 59: The Measurement and Validity of Well-being

59

Measuring experienced utility (2-2)

Advantages of DRM

• Less costly than ESM

• Does not rely on participant self perception of life domain

Disadvantages of DRM

• Element of recall: possible bias– ie. it’s not how people felt then and there

Page 60: The Measurement and Validity of Well-being

60

Evidence from ESM/DRM

Activity % of sample Time (hrs) Net affect

Intimate relations 11 0.21 4.74

Socialising after work 49 1.15 4.12

Dinner 65 0.78 3.96

Exercising 16 0.22 3.82

Watching TV 75 2.18 3.62

Cooking 62 1.14 3.24

Shopping 30 0.41 3.21

Childcare 36 1.09 2.95

Working 100 6.88 2.65

Commuting 61 0.43 2.03

Page 61: The Measurement and Validity of Well-being

61

Measuring experienced utility (3)Life satisfaction questions

Advantages• Easy to administer• Everyone understands them

Disadvantages• Neglect of duration – not life as you live it but life as

you remember it• More cognitive than affective

Page 62: The Measurement and Validity of Well-being

62

Issues with Measuring SatisfactionSocial Desirability

Possible bias if we ask individuals sensitive questions: they want to look good in front of the interviewer.

“computer-assisted self-interviewing (CASI) and self-completion (SC) paper questionnaires are generally preferred to face-to-face interviewing as a way of assuring a greater degree of confidentiality and inducing more truthful responses”

This is why the GHQ questions discussed above are a drop-off questionnaire. Self-reporting means that individuals are more likely to report their true response to questions like

“have you recently been thinking of yourself as worthless”

Page 63: The Measurement and Validity of Well-being

63

Some BHPS results, from Conti, G., and Pudney, S. (2011). "Survey design and the analysis of satisfaction". Review of Economics and Statistics, 93, 1087-1093.

• Oral interviews conducted by an interviewer tend to produce more positive reports of satisfaction than private self-completion questionnaires – the “let’s put on a good show for the interviewer” effect.

• When children are present during the interview, adult interviewees tend to give still more positive responses – the “not in front of the children” effect.

• The presence of the interviewee’s partner during the interview tends to depress the level of reported satisfaction – the “don’t show your partner how satisfied you are” effect, which we speculate may have something to do with the desire to maintain a strong bargaining position within the relationship.

Page 64: The Measurement and Validity of Well-being

64

Issues with Measuring Satisfaction

Which response scale?

Even if the question is a good one, on what scale would we want them to respond?

A satisfaction question can be answered on a three-point scale, a four-point scale, etc.

May want an odd number of response categories in order for there to be a natural neutral

Page 65: The Measurement and Validity of Well-being

65

We would like a scale to be both reliable and valid

Pretests for the European Social Survey suggested that reliability and validity were higher using an 11-point scale compared to a four-point scale.

Page 66: The Measurement and Validity of Well-being

66

Labelling categories?A small change can have large effects…Job satisfaction labels in the BHPS changed from Wave 1 to Wave 2

Label for category one changed. In Wave 2 all seven categories were labelled, as opposed to only three of them in Wave 1.

Page 67: The Measurement and Validity of Well-being

67

Could this have any effect? Compare the JS distributions in Waves 1, 2 and 3.

Huge rise in the use of response six, now that it is labelled. The only three labelled responses in Wave 1 attracted “too many” responses.

This particularly seemed to affect women

Page 68: The Measurement and Validity of Well-being

Is Happiness Everything?

Do questions about happiness and satisfaction pick up everything that is important about individual lives?

Or could there be “non-happiness” elements that are important too?

Page 69: The Measurement and Validity of Well-being

69

Maslow’s Hierarchy of Needs

Page 70: The Measurement and Validity of Well-being

This is relevant in the context of the debate over hedonia vs. eudaimonia.

Eudaimonia refers to the idea of flourishing or developing human potential, as opposed to pleasure, and is designed to capture elements such as mastery, relations with others, self-acceptance and purpose.

Practically, eudaimonic well-being is measured by questions on autonomy, determination, interest and engagement, aspirations and motivation, and a sense of meaning, direction or purpose in life.

Arguably picked up by last of the four ONS questions.

Page 71: The Measurement and Validity of Well-being

These “behave” the way we think that they should:

Page 72: The Measurement and Validity of Well-being

Here is a measure of flourishing, based on Huppert and So (2009).

All of these six questions on the right were asked in Wave 3 of the European Social Survey

Page 73: The Measurement and Validity of Well-being

The first two of these are defined by Huppert and So as “core features”, in that someone who is flourishing has to agree with these statements. The measure they propose of flourishing is thus agreement with the first two questions, plus agreement with at least three of the next four questions.

Fifty six percent of the ESS sample is flourishing according to this definition.

The second measure we appeal to is based on the New Economics Foundation (2008), and measures i) Vitality, ii) Resilience and Self-Esteem, iii) Positive Functioning, Supportive Relationships, And Trust and Belonging.

Each of these three is constructed as the unweighted sum of the answers to a number of z-score transformed questions (such that each of the questions has a mean of zero and a variance of one).

Page 74: The Measurement and Validity of Well-being

Vitality consists of answers to questions on how much of the time during the past week the individual felt tired, felt that everything they did was an effort, could not get going, had restless sleep, had a lot of energy, and felt rested when they woke up in the morning, plus the respondent's general health and whether their life involves a lot of physical activity.

All of these are recoded so that higher values reflect greater vitality.

Page 75: The Measurement and Validity of Well-being

Similarly, resilience and self-esteem is given the sum of the answers to the four following z-score transformed questions:

• "In general I feel very positive about myself“• "At times I feel as if I am a failure“• "I’m always optimistic about my future“• "When things go wrong in my life, it generally takes

me a long time to get back to normal".

Again, all of these are recoded so that higher numbers reflect greater resilience.

Page 76: The Measurement and Validity of Well-being

Last, positive functioning is determined by the answers to the following questions:

• "In my daily life I get very little chance to show how capable I am“

• "Most days I feel a sense of accomplishment from what I do“• "In my daily life, I seldom have time to do the things I really

enjoy“• "I feel I am free to decide how to live my life“• "How much of the time during the past week have you felt

bored?“• "How much of the time during the past week have you been

absorbed in what you were doing“• "To what extent do you get a chance to learn new things?“• "To what extent do you feel that you get the recognition you

deserve for what you do?“• "I generally feel that what I do in my life is valuable and

worthwhile"

Page 77: The Measurement and Validity of Well-being

These eudaimonia scores end up being pretty closely correlated with the hedonic measures of happiness and satisfaction

“Taking all things together, how happy would you say you are?”, with answers on a 0 to 10 scale, where 0 corresponds to “Extremely Unhappy” and 10 to “Extremely Happy”. Life satisfaction from the question “All things considered, how satisfied are you with your life as a whole nowadays?” , with answers on a 0 to 10 scale.

Page 78: The Measurement and Validity of Well-being

Someone with high life satisfaction or happiness is fairly likely to also be flourishing, have vitality, resilience and functioning as well.

Page 79: The Measurement and Validity of Well-being

A second simple way of evaluating the difference, if any, between hedonic and eudaimonic measures of well-being is to carry out a regression analysis using "standard" socio-demographic variables as controls.

Here’s the regression table, just to prove that we did it….

Page 80: The Measurement and Validity of Well-being

Life Satisfaction Happiness Flourishing Vitality Resilience FunctioningMale -0.052** -0.074** 0.090** 0.946** 0.582** 0.021

(0.014) (0.014) (0.018) (0.060) (0.036) (0.052)Age -0.051** -0.056** -0.005 -0.116** -0.105** -0.054**

(0.004) (0.004) (0.005) (0.018) (0.010) (0.015)Age-squared/1000 0.539** 0.565** -0.014 1.325** 1.125** 1.070**

(0.047) (0.047) (0.059) (0.205) (0.121) (0.178)Secondary Education 0.047** 0.025 0.149** 0.349** 0.328** 0.487**

(0.017) (0.017) (0.022) (0.076) (0.045) (0.066)Tertiary Education 0.090** 0.069** 0.243** 0.408** 0.357** 0.946**

(0.020) (0.020) (0.025) (0.085) (0.050) (0.074)Separated -0.267** -0.339** -0.085** -0.471** -0.177** -0.284**

(0.022) (0.022) (0.028) (0.096) (0.056) (0.083)Widowed -0.310** -0.492** -0.127* -1.699** -0.385** -0.266

(0.039) (0.039) (0.050) (0.173) (0.101) (0.152)Never in Couple -0.200** -0.322** -0.129** -0.271** -0.337** -0.259**

(0.019) (0.019) (0.025) (0.084) (0.050) (0.073)Log Income 0.201** 0.164** 0.116** 0.545** 0.437** 0.517**

(0.009) (0.009) (0.012) (0.040) (0.024) (0.035)FT Education 0.093** 0.079** -0.019 -0.232 -0.121 0.197

(0.028) (0.028) (0.035) (0.121) (0.071) (0.104)Active Unemployed -0.429** -0.273** -0.293** -0.847** -0.518** -1.531**

(0.034) (0.034) (0.043) (0.150) (0.088) (0.131)Inactive Unemployed -0.366** -0.295** -0.427** -1.535** -0.801** -1.400**

(0.043) (0.043) (0.057) (0.191) (0.113) (0.168)Sick or Disabled -0.473** -0.376** -0.470** -5.745** -1.542** -2.043**

(0.038) (0.038) (0.049) (0.166) (0.097) (0.146)Retired 0.030 -0.007 -0.125** -1.000** -0.156* -0.156

(0.028) (0.029) (0.036) (0.125) (0.074) (0.109)Community or Military Service 0.145 0.019 -0.068 0.473 0.282 -0.052

(0.154) (0.155) (0.196) (0.670) (0.406) (0.595)Housework, looking after children, others 0.028 0.040* 0.003 -0.079 -0.055 -0.052

(0.017) (0.017) (0.022) (0.076) (0.045) (0.066)Other 0.022 0.047 0.100 -0.336 0.063 0.018

(0.050) (0.051) (0.064) (0.219) (0.130) (0.192)Austria 0.462** 0.213** 0.172** 1.442** 0.077 1.250**

(0.039) (0.039) (0.050) (0.173) (0.102) (0.150)Belgium 0.287** 0.265** -0.164** -0.148 -1.032** 0.142

(0.038) (0.038) (0.048) (0.165) (0.098) (0.142)Bulgaria -0.404** -0.468** 0.134* 0.848** 0.280* 0.683**

(0.048) (0.048) (0.062) (0.216) (0.126) (0.186)Switzerland 0.555** 0.486** 0.259** 0.903** -0.200* 1.032**

(0.040) (0.040) (0.051) (0.171) (0.102) (0.148)Denmark 0.901** 0.681** 0.251** 0.086 -0.198 2.299**

(0.041) (0.041) (0.051) (0.174) (0.103) (0.150)Spain 0.452** 0.413** 0.166** -0.334 0.018 -1.343**

(0.043) (0.043) (0.054) (0.185) (0.110) (0.161)Finland 0.590** 0.528** 0.130** 0.154 -1.287** 0.175

(0.038) (0.038) (0.047) (0.163) (0.096) (0.140)France -0.149** 0.044 -0.256** -0.346* -0.978** -0.928**

(0.037) (0.037) (0.047) (0.162) (0.096) (0.140)United Kingdom 0.136** 0.152** -0.025 -1.275** -0.990** -1.027**

(0.037) (0.037) (0.047) (0.162) (0.096) (0.140)Ireland 0.304** 0.287** 0.262** 0.318 -0.355** 0.512**

(0.041) (0.041) (0.052) (0.179) (0.105) (0.155)Latvia -0.094* -0.183** -0.080 -0.017 -0.910** -1.295**

(0.040) (0.040) (0.051) (0.177) (0.104) (0.154)Netherlands 0.372** 0.294** -0.007 0.441** -0.608** 0.702**

(0.038) (0.038) (0.047) (0.163) (0.096) (0.141)Norway 0.362** 0.361** 0.079 0.493** -0.986** 0.325*

(0.037) (0.037) (0.047) (0.161) (0.096) (0.139)Poland 0.250** 0.148** -0.012 0.360* -0.143 0.459**

(0.041) (0.041) (0.052) (0.180) (0.106) (0.157)Portugal -0.435** -0.224** 0.279** -1.778** -0.095 -0.963**

(0.044) (0.045) (0.056) (0.194) (0.115) (0.168)Russia -0.286** -0.225** -0.301** -0.030 -0.210* 0.082

(0.041) (0.041) (0.053) (0.183) (0.107) (0.160)Sweden 0.536** 0.460** 0.110* -0.019 -0.684** -0.193

(0.037) (0.037) (0.047) (0.160) (0.095) (0.139)Slovenia 0.243** 0.203** 0.099 0.668** -0.138 -0.315*

(0.042) (0.042) (0.053) (0.184) (0.109) (0.159)Slovakia -0.117** -0.135** -0.121* -0.717** -1.322** -0.420*

(0.044) (0.044) (0.055) (0.193) (0.114) (0.166)Constant -0.562** -1.911** -0.788** -3.665**

(0.146) (0.504) (0.297) (0.437)Observations 24297 24247 23773 23694 23917 23317Log-Likelihood -47346.81 -44715.03 -15496.34 -68824.05 -56948.91 -64182.61Log-Likelihood at zero -50460.01 -47167.79 -16299.51 -70480.96 -58139.32 -65784.43R-squared 0.131 0.095 0.128

Note: The omitted categories are: primary education, married, employed and Germany. Standard errors in parentheses. * significant at 5%; ** significant at 1%

Page 81: The Measurement and Validity of Well-being

Are the data patterns in these regressions the same?

Page 82: The Measurement and Validity of Well-being

The measures of happiness and life satisfaction produce extremely similar data shapes. Some say that satisfaction is more cognitive, but we don’t see that here.

The correlation between the hedonic measures and the eudaimonic measures, in terms of how they fit the observable explanatory variables, is reasonably high.

There is, however, one exception, with respect to resilience. This concept does not seem to be particularly closely related to either happiness or satisfaction, which is perhaps a finding that is worthy of future investigation

Page 83: The Measurement and Validity of Well-being

The same approach is taken by Helliwell (2012), comparing life satisfaction to the Cantril ladder in Gallup World Poll data.

The Cantril Self-Anchoring Striving Scale (Cantril, 1965) has been included in several Gallup research initiatives, including the Gallup World Poll of more than 150 countries, representing more than 98% of the world's population.

The Cantril Self-Anchoring Scale, developed by pioneering social researcher Dr.

Hadley Cantril, consists of the following: Please imagine a ladder with steps numbered from zero at the bottom to 10 at the

top. The top of the ladder represents the best possible life for you and the bottom of

the ladder represents the worst possible life for you.

On which step of the ladder would you say you personally feel you stand at this time? (ladder-present)

On which step do you think you will stand about five years from now? (ladder-

future)

Page 84: The Measurement and Validity of Well-being

The country-by-country rankings for life satisfaction in the Gallup World Poll are very similar to those for the Cantril ladder.

The correlation between the country rankings for life satisfaction and the Gallup ladder responses - asked of the same respondents, and in the same survey - is very high (r=0.935). Analysis of the resulting data show that while there were significant differences in average scores, with the mean of life satisfaction being higher by about 0.5 on the 11-point scale, the two variables are explained by the same factors, including the same effects of income .

Page 85: The Measurement and Validity of Well-being

We can do something of the same thing in the BHPS, looking at the correlation between life satisfaction and GHQ regressions.

The Pearson correlation between the two sets of estimated regression coefficients (of which there are 48) is 0.775.

In other words, the “same kinds of things” are correlated with both life satisfaction and GHQ.

Page 86: The Measurement and Validity of Well-being

Equally, in the BHPS, the pattern of adaptation seems to be very similar between life satisfaction and GHQ.

Page 87: The Measurement and Validity of Well-being
Page 88: The Measurement and Validity of Well-being

Slight suggestion that children might do more for you in terms of GHQ than in terms of life satisfaction.

Page 89: The Measurement and Validity of Well-being

Which well-being measure better predicts behaviour?: Benjamin et al. (2012), “What Do You Think Would Make You Happier? What Do You Think You Would Choose?”, American Economic Review.

They consider a series of sequence of hypothetical pairwise-choice scenarios.

Page 90: The Measurement and Validity of Well-being
Page 91: The Measurement and Validity of Well-being

Individuals don’t always choose the option that they say will make them happier:

Although the percentage not doing so is only around ten per cent

Page 92: The Measurement and Validity of Well-being

In a student sample, respondents are asked the hypothetical choice and overall happiness questions, as well as the effect of the choice on eleven non-SWB aspects of life:

• Family happiness• Health• Life's level of romance• Social life• Control over your life• Life's level of spirituality• Life's level of fun• Social status• Life's non-boringness• Physical comfort• Sense of purpose

Page 93: The Measurement and Validity of Well-being

OLS choice regressions:

Page 94: The Measurement and Validity of Well-being

As shown by the R2, 0.38 of the variation in choice is explained by SWB (own happiness) alone.

Regressing choice on both SWB and the eleven non-SWB aspects yields a barely higher R2 of 0.41.

But:“the four scenarios we designed to be representative of typical important decisions facing our college-age Cornell sample…socialize versus sleep, family versus money, education versus social life, and interest versus career… are among the scenarios with the lowest univariate R2 and, correspondingly, the highest incremental R2 from adding non-SWB aspects as regressors”

Eudaimonia may then matter much more in certain real-life situations

Page 95: The Measurement and Validity of Well-being

Validation: Do these numbers mean anything?

Page 96: The Measurement and Validity of Well-being

96

Cross-Rater Validity

• It is presumed that asking A how happy she is will provide information about her unobserved real level of happiness.

• A simple validity check is then to ask B whether he thinks A is happy.

• Individuals do seem to be able to a large extent to recognise and predict the satisfaction level of others

Page 97: The Measurement and Validity of Well-being

97

• Respondents shown pictures or videos of others accurately identify whether the individual shown to them was happy, sad, jealous, and so on.

• This is also the case when respondents were shown individuals from other cultures

• Individuals in the same language community have a common understanding of how to translate internal feelings into a number scale, simply in order to be able to communicate with each other.

• Respondents translate verbal labels, such as 'very good' and 'very bad', into roughly the same numerical values.

• A tempting conclusion is that an evolutionary advantage accrues to the accurate evaluation of how others are doing.

Page 98: The Measurement and Validity of Well-being

98

• Friends and family reports of how happy they believe the respondent is correlate with the respondent’s own report.

• Another obvious choice is the interviewer: again, the answer the interviewer gives tallies with that of the respondent.

• Respondents are sometimes given open-ended interviews in conjunction with standard questions about their well-being. When third parties, who do not know the respondent, are played these open-ended interviews their evaluation of the respondent’s well-being matches well with the respondent’s own reply

Page 99: The Measurement and Validity of Well-being

99

Physiological and Neurological Evidence

• There is a strong positive correlation between emotional expressions like smiling, and frowning, and answers to well-being questions

• Recent work has looked at the relationships between positive and negative states, on the one hand, and neurological measures, on the other

• Obtaining physical measures of brain activity is an important step in showing that individuals’ self-reports reflect real phenomena

Page 100: The Measurement and Validity of Well-being

100

• Particular interest has been shown in prefrontal brain asymmetry.

• In right-handed people, positive feelings are generally associated with more alpha power in the left prefrontal cortex (the dominant brain wave activity of awake adults are called alpha waves), and negative feelings with more alpha power in the right prefrontal cortex (approach and avoidance).

• Relationship initially suggested by the observations of patients with unilateral cortical damage

• More recently has been explored using techniques to measure localised brain activity, such as electrodes on the scalp in Electro-encephalography (EEG) or scanners in Magnetic Resonance Imaging (MRI)

Page 101: The Measurement and Validity of Well-being

101

• Urry et al. (2004) consider 84 right-handed individuals (from the Wisconsin Longitudinal Study)

• They answer questions on positive and negative affect, measures of hedonic well-being using global life satisfaction scores, and measures of eudaimonic well-being.

• Brain activity is measured via EEG.

• Left-right brain asymmetry is shown to be associated with higher levels of positive affect, and with both hedonic and eudaimonic well-being.

Page 102: The Measurement and Validity of Well-being

102

• Brain asymmetry is also associated with physiological measures, such as cortisol and corticotropin releasing hormone (CRH)

• These are involved in response to stress, and with antibody production in response to influenza vaccine.

• In general, brain asymmetry is not only associated with measures of subjective well-being, but general measures of wellness of the organism’s functioning.

Page 103: The Measurement and Validity of Well-being

103

• How does brain asymmetry come about? • Probably a role for genetics: the form of a certain gene

regulating the serotonin system (5HTT) is a predictor of neuroticism, which is related to left-right asymmetry

• Not only genetics though: there is a role of early social experiences in determining some aspects of brain circuitry.

• L-R balance can be manipulated in adults by showing pleasant or unpleasant pictures or films, and by stimulating the left frontal portion of the brain (via magnetic fields)

• In a controlled experiment those randomly assigned to a meditation group (compared to a neutral control) showed an increase in left-right brain activation

• The meditation group also showed an increase in antibody production in response to influenza vaccine (cf the control)

Page 104: The Measurement and Validity of Well-being

104

SWB scores are correlated with observable characteristics in ways that make sense

Variables often associated with higher SWB:– being in employment– having good health– being married– being female– having higher income– not having children– being young; or being old

Page 105: The Measurement and Validity of Well-being

105

• This is also true at the more aggregate level

• Oswald and Wu (Science, 2010) look at life satisfaction scores (1-4) using US BRFSS data from 2005-2008.

• Run satisfaction regressions on individual demographics and 49 State dummies.

• This gives a State-by-State picture of well-being.

• Satisfaction with life is lowest in New York.

• The particularly high-satisfaction states are Louisiana and Hawaii.

Page 106: The Measurement and Validity of Well-being

106

• Objective measure: Weighted sum for each U.S. state of variables such as precipitation, temperature, wind speed, sunshine,coastal land, inland water, public land, National Parks, hazardous waste sites, environmental “greenness,” commuting time, violent crime, air quality, student-teacher ratio, local taxes, local spending on education and highways, and cost of living. [This is actually another way of weighting the elements in an objective list]

• The weights in the sum come from the coefficients in regional wage and house price equations. This is an objective measure of what these amenities are worth (in a compensating differentials approach)

• This gives a ranking, from 1 (best) to 50 (worst) across US States.

Page 107: The Measurement and Validity of Well-being

107

Are the objective and subjective figures regarding quality of life correlated?

Page 108: The Measurement and Validity of Well-being

108

• It is nice that this works at both levels. • No reason why it should • One particular point in this context is the present of

well-being spillovers• Something that makes you happy may make me

unhappy: your income for example.• I have also argued that this works the other way

round with unemployment.• So finding that richer people are happier…• does not mean that richer areas/countries are

happier• This is the Easterlin paradox

Page 109: The Measurement and Validity of Well-being

109

Predicting Health Outcomes

• Respondents seem to act on what they say, i.e. they behave as if they were maximising their subjective well-being

• And the pattern of outcomes is “as if” those with low satisfaction scores really were not doing very well

• The medical literature has found high correlations in the expected sense between low well-being scores and coronary heart disease, strokes, suicide and length of life.

• Individuals with higher life satisfaction scores were less likely to catch a cold when exposed to a cold virus, and recovered faster if they did.

Page 110: The Measurement and Validity of Well-being

The Nun Study

• A study of 180 nuns in Milwaukee examined the diaries of the sisters of Notre Dame when they joined back in the 1930s

• Each nun was asked to write a short sketch of her life on this momentous occasion

Page 111: The Measurement and Validity of Well-being

One of the nuns wrote:

“God started my life off well by bestowing upon me grace of inestimable value… The past year which I spent as a candidate studying at Notre Dame has been a very happy one. Now I look forward with eager joy to receiving the Holy Habit of Our Lady and to a life of union with Love Divine”

Page 112: The Measurement and Validity of Well-being

• Whilst another nun wrote:

“I was born on September 26, 1909, the eldest of seven children, five girls and two boys… My candidate year was spent in the motherhouse, teaching chemistry and second year Latin at Notre Dame Institute. With God’s grace, I intend to do my best for our Order, for the spread of religion and for my personal sanctification.”

Page 113: The Measurement and Validity of Well-being

• After joining the order their lives were almost exactly the same - same food, same work, same routine

• But not the same life expectancy…

• Among the less-positive nuns, two thirds died before their 85th birthday. Among the happy nuns, 90% were still alive.

Page 114: The Measurement and Validity of Well-being
Page 115: The Measurement and Validity of Well-being
Page 116: The Measurement and Validity of Well-being

Wave 2 of ELSA took place in 2004/5.

This covers individuals aged 50 or over.

We can model deaths by Wave 5 in 2010/11, six years later.

Which measures of well-being at Wave 2 best predict death by Wave 5?

This is work by Andrew Steptoe and colleagues at UCL, available from the ELSA website.

http://www.ifs.org.uk/ELSA

Page 117: The Measurement and Validity of Well-being
Page 118: The Measurement and Validity of Well-being

i.e. controlling for age and sex, those in the highest enjoyment tertile had a 57% lower chance of death than those in the lowest enjoyment tertile.

Page 119: The Measurement and Validity of Well-being
Page 120: The Measurement and Validity of Well-being
Page 121: The Measurement and Validity of Well-being
Page 122: The Measurement and Validity of Well-being

122

Predicting Labour Market Outcomes

• Panel data studies have found that subjective well-being at time t predicts future behaviour

• Individuals clearly choose to discontinue activities associated with low levels of well-being

• In the labour market, job satisfaction at time t is a strong predictor of job quits, even when controlling for wages, hours of work and other standard individual and job variables.

Page 123: The Measurement and Validity of Well-being

123

A first example using SOEP data: predict the probability that the individual has quit their job at the time of the next interview, at wave t+1.

High-satisfaction individuals quit less

Page 124: The Measurement and Validity of Well-being

124

Also true in the BHPS when estimating duration models (predicting the order of quits)

Page 125: The Measurement and Validity of Well-being

125

• Not only true for employees. • Analogous work in Georgellis et al. (2006) shows

that job satisfaction predicts leaving self-employment.

• Clark (2003) shows that the fall in well-being on entering unemployment predicts unemployment duration: those who suffered the sharpest drop in well-being upon entering unemployment were the quickest to leave it.

• Even despite the obvious endogeneity bias (those who know their unemployment will be of short duration will be less worried about entering unemployment)

Page 126: The Measurement and Validity of Well-being

BHPS Results from Clark (2003)

Page 127: The Measurement and Validity of Well-being

SOEP Results from Clark et al. (2010)

Page 128: The Measurement and Validity of Well-being

128

Predicting Marital Outcomes

In panel data, those with higher well-being at time t are less likely to divorce at t+1.

The same results are found in both BHPS and HILDA

Page 129: The Measurement and Validity of Well-being

129

Some Quirks

1) Levels or Changes?

In SOEP data, the change in wages does a good job of predicting quits; the level of wages is insignificant

Page 130: The Measurement and Validity of Well-being

130

2) The gap between individuals

Not only does the level of happiness predict divorce, so does the gap between the man and the woman

Divorce is more likely in unhappy households, and when the woman is unhappier than the man

Page 131: The Measurement and Validity of Well-being

131

3) Which satisfaction domain is most important?

If we have multiple satisfaction measures we can see which predicts behaviour the best

The least negative log-likelihood (the regression with the greatest explanatory power) is that including overall job satisfaction, as might be hoped.

With respect to the seven domain satisfaction variables, the most powerful is satisfaction with job security.

Page 132: The Measurement and Validity of Well-being

132

4) Which well-being measure is the most important?• With multiple well-being measures we can see which predicts behaviour the best• Green (2010) uses panel data from the UK Skills Survey. • Measures there are of job-related subjective well-being involving both an overall measure of job satisfaction, and items to construct two Warr scales measuring job-related well-being along the Depression–Enthusiasm and the Anxiety–Comfort axes.

Page 133: The Measurement and Validity of Well-being

133

Both depression-enthusiasm and anxiety-comfort predict future quitting

Page 134: The Measurement and Validity of Well-being

134

• But job satisfaction is the best predictor of quitting.

• Once job satisfaction is controlled for, depression-enthusiasm and anxiety-comfort play no significant role in predicting future quitting

Page 135: The Measurement and Validity of Well-being

135

5) Well-being profiles and behaviourIs it the level of well-being that predicts behaviour, or some function of the change in well-being?

Inspired by Danny Kahneman

Page 136: The Measurement and Validity of Well-being
Page 137: The Measurement and Validity of Well-being

• Peak-end evaluation:

• “The remembered utility of pleasant or unpleasant episodes is accurately predicted by averaging the Peak (most intense value) of instant utility (or disutility) recorded during an episode and the instant utility recorded near the end of the experience” (Kahneman, Wakker and Sarin, QJE, 1997, p. 381).

• Apply this to quitting decisions using panel data with a history of job satisfaction scores

Page 138: The Measurement and Validity of Well-being

Job Satisfaction MeasurePeak-end (with maximum) -0.321 -11140.2 Peak-end (with minimum) -0.183 -14913.7

(.020) (.011)Running Maximum -0.314 -11143.3 Running Minimum -0.167 -14916.6

(.019) (.010)Current -0.248 -11168.4 Current -0.167 -14935.3

(.017) (.011)Running Average -0.275 -11175.4 Running Average -0.153 -14976.3

(.021) (.012)Peak-end (with minimum) -0.211 -11198.2 Peak-end (with maximum) -0.140 -14989.4

(.019) (.012)Running Minimum -0.141 -11229.7 Running Maximum -0.076 -15040.0

(.018) (.012)

N 23245 54149Log Likelihood at zero -11781.54 -16061.67

Table 2. Ranking of Job Satisfaction Measures as Predictors of Quits

Great Britain Germany(BHPS) (GSOEP)

We are currently unsure how stable this is…