the idea of construct validity. construct validity theory observation causeconstructeffectconstruct...

22
The Idea of Construct The Idea of Construct Validity Validity

Post on 22-Dec-2015

233 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The Idea of Construct ValidityThe Idea of Construct ValidityThe Idea of Construct ValidityThe Idea of Construct Validity

Page 2: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Construct ValidityConstruct Validity

TheoryTheoryTheoryTheory

ObservationObservationObservationObservation

CauseCauseConstructConstruct

EffectEffectConstructConstruct

ProgramProgram ObservationsObservations

What you What you dodo What you What you seesee

What you What you thinkthink

cause-effect constructcause-effect construct

program-outcome relationshipprogram-outcome relationship

Can we generalize to the Can we generalize to the constructsconstructs??

Page 3: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The Analogy to LawThe Analogy to LawThe Analogy to LawThe Analogy to Law

Page 4: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The Analogy to LawThe Analogy to LawThe Analogy to LawThe Analogy to Law

The The truth…truth… The The truth…truth…

Page 5: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The Analogy to LawThe Analogy to LawThe Analogy to LawThe Analogy to Law

The The truth…truth… The The truth…truth…

the the wholewhole truth, truth,the the wholewhole truth, truth,

Page 6: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The Analogy to LawThe Analogy to LawThe Analogy to LawThe Analogy to Law

The The truthtruth … …The The truthtruth … …

the the wholewhole truth, truth,the the wholewhole truth, truth,

and and nothing but nothing but the truth.the truth.and and nothing but nothing but the truth.the truth.

Page 7: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

In Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct Validity

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

Page 8: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

In Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct Validity

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

The The construct…construct…The The construct…construct…

Page 9: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

In Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct Validity

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

The The construct…construct…The The construct…construct…

the the wholewhole construct, construct,the the wholewhole construct, construct,

Page 10: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

In Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct ValidityIn Terms of Construct Validity

12

34

5

12

34

5

3Scan a multitu

de of inform

ation and decide

what is im

portant.

12

34

5

12

34

5

12

34

5

12

34

5

12

34

5

1Manage tim

e effectively

2Manage resources effectively.

3Scan a multitu

de of information and

decide what is im

portant.

4Decide how to manage multip

le tasks.

5Organize the work when directions are not specific

.

1Manage tim

e effectively

Rating Sheet

The The construct…construct…The The construct…construct…

the the wholewhole construct, construct,the the wholewhole construct, construct,

and and nothing but nothing but the construct.the construct.and and nothing but nothing but the construct.the construct.

Page 11: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

What Is the What Is the GoalGoal??What Is the What Is the GoalGoal??

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Page 12: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

What Is the What Is the GoalGoal??What Is the What Is the GoalGoal??

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Didn’t measure Didn’t measure anyany of the construct of the construct

The The constructconstruct

Page 13: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

What Is the What Is the GoalGoal??What Is the What Is the GoalGoal??

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Measure Measure partpart of the construct and of the construct and partpart of of construct Bconstruct B

The The constructconstruct

Other Other construct: Dconstruct: D

Page 14: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

What Is the What Is the GoalGoal??What Is the What Is the GoalGoal??

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Measure Measure partpart of the construct and of the construct and nothing elsenothing else

Page 15: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

What Is the What Is the GoalGoal??What Is the What Is the GoalGoal??

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Measure Measure allall of the construct and of the construct and nothing else.nothing else.

Page 16: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

The ProblemThe ProblemThe ProblemThe Problem

Concepts are Concepts are notnot mutually exclusive. mutually exclusive. They exist in a They exist in a webweb of overlapping of overlapping

meaning.meaning. To enhance construct validity, you must To enhance construct validity, you must

show where the construct is in its show where the construct is in its broader network of meaning.broader network of meaning.

Page 17: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Could Show That...Could Show That...Could Show That...Could Show That...

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

The construct is slightly related to the other The construct is slightly related to the other four.four.

Page 18: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Could Show That...Could Show That...Could Show That...Could Show That...

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Constructs A and C and constructs B and D Constructs A and C and constructs B and D are related to each other.are related to each other.

Page 19: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Could Show That...Could Show That...Could Show That...Could Show That...

The The constructconstruct

Other Other construct: Aconstruct: A

Other Other construct: Cconstruct: C

Other Other construct: Bconstruct: B

Other Other construct: Dconstruct: D

Constructs A and C are Constructs A and C are notnot related to related to constructs B and D.constructs B and D.

Page 20: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Example: You Want to MeasureExample: You Want to MeasureExample: You Want to MeasureExample: You Want to Measure

Self -Self -esteemesteem

Page 21: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

Example: Distinguish From...Example: Distinguish From...Example: Distinguish From...Example: Distinguish From...

Self- Self- esteemesteem

Self-worthSelf-worth

ConfidenceConfidence

Self- Self- disclosuredisclosure

OpennessOpenness

Page 22: The Idea of Construct Validity. Construct Validity Theory Observation CauseConstructEffectConstruct ProgramObservations What you do What you see What

To Establish Construct ValidityTo Establish Construct ValidityTo Establish Construct ValidityTo Establish Construct Validity You have to set the construct within a You have to set the construct within a

semantic (meaning) net.semantic (meaning) net. You have to provide evidence that your You have to provide evidence that your

data support the theoretical structure. data support the theoretical structure. (Constructs that should be (Constructs that should be moremore related, related, are; constructs that should be are; constructs that should be lessless related, are.)related, are.)

Supply evidence that you Supply evidence that you controlcontrol the the operationalization of the construct (that operationalization of the construct (that your theory has some correspondence your theory has some correspondence with reality).with reality).