chapter 4 validity robert j. drummond and karyn dayle jones assessment procedures for counselors and...

Chapter 4Chapter 4ValidityValidity

Robert J. Drummond and Karyn Dayle JonesAssessment Procedures for Counselors and Helping Professionals, 6th editionCopyright ©2006 by Pearson Education, Inc.Upper Saddle River, New Jersey 07458All rights reserved.

ValidityValidity

The extent to which the test measures what it's The extent to which the test measures what it's supposed to measuresupposed to measure

Content ValidityContent Validity Face ValidityFace Validity Criterion-Related ValidityCriterion-Related Validity Construct ValidityConstruct Validity


Content ValidityContent Validity

The items on a test are representative of some The items on a test are representative of some defined universe or content domain.defined universe or content domain.

Usually decided by expert judges who evaluate the Usually decided by expert judges who evaluate the test’s content to determine if there is a relationship test’s content to determine if there is a relationship between the test and the content domain.between the test and the content domain.


Face ValidityFace Validity

Does the test appear superficially to Does the test appear superficially to measure what it's supposed to measure?measure what it's supposed to measure?


Criterion-Related ValidityCriterion-Related Validity Are test scores related to one or more external variables Are test scores related to one or more external variables

(criteria)?(criteria)?

Two types:Two types: Concurrent validityConcurrent validity: the test score and criterion information : the test score and criterion information

are obtained at the same time (e.g., Beck Depression are obtained at the same time (e.g., Beck Depression Inventory score predicting a Inventory score predicting a currentcurrent diagnosis of depression) diagnosis of depression)

Predictive validityPredictive validity: the test is used to estimate criterion : the test is used to estimate criterion scores in the future (e.g., SAT scores in the future (e.g., SAT predictingpredicting future college future college success)success)


Validity coefficientValidity coefficient: indicates the : indicates the correlation between the test and its correlation between the test and its criterion score. criterion score.

A coefficient of 1.00 indicates a perfect A coefficient of 1.00 indicates a perfect positive correlationpositive correlation

The higher the correlation, the better the The higher the correlation, the better the validityvalidity 0 to +0.3 = little or no correlation0 to +0.3 = little or no correlation +0.3 to +0.7 = moderate positive correlation+0.3 to +0.7 = moderate positive correlation +0.7 to +1.0 = strong positive correlation+0.7 to +1.0 = strong positive correlation


What do these correlations mean? What do these correlations mean?

Concurrent Validity: Concurrent Validity: Correlation between the score on an exam and test Correlation between the score on an exam and test

anxiety is .73.anxiety is .73.

Predictive Validity: Predictive Validity: Correlation between the GRE and success in an Correlation between the GRE and success in an

Educational Research master’s program is .90. Educational Research master’s program is .90. Correlation between the GRE and success in Correlation between the GRE and success in

Counselor Education is .65.Counselor Education is .65. Correlation between the GRE and success in a Correlation between the GRE and success in a

graduate degree in Drama is .35.graduate degree in Drama is .35.Robert J. Drummond and Karyn Dayle JonesAssessment Procedures for Counselors and Helping Professionals, 6th editionCopyright ©2006 by Pearson Education, Inc.Upper Saddle River, New Jersey 07458All rights reserved.

Construct ValidityConstruct Validity

What do test scores mean or signify? What do test scores mean or signify? What does the score tell us about the What does the score tell us about the

individual? individual? Does the test score correspond with some Does the test score correspond with some

meaningful trait or construct that will help us meaningful trait or construct that will help us understand the person?understand the person?


Construct: DefinedConstruct: Defined

Used to describe the grouping of variables or behaviors Used to describe the grouping of variables or behaviors that make up observed behavior patterns (e.g., that make up observed behavior patterns (e.g., intelligence, anxiety, motivation, self-concept)intelligence, anxiety, motivation, self-concept)

The construct itself is not measurable; only the The construct itself is not measurable; only the behaviors or variables that make up the construct can behaviors or variables that make up the construct can be measuredbe measured

ExamplesExamples: What behaviors make up self-concept? : What behaviors make up self-concept? What behaviors or variables make up depression?What behaviors or variables make up depression?


Methods Used in Gathering Methods Used in Gathering Construct-Related EvidenceConstruct-Related Evidence

Correlations with other testsCorrelations with other tests Convergent and discriminant validationConvergent and discriminant validation Factor analysisFactor analysis


Convergent and Convergent and Discriminant ValidityDiscriminant Validity

Convergent and discriminant validity are both considered Convergent and discriminant validity are both considered subcategories or subtypes of subcategories or subtypes of construct validityconstruct validity. .

Convergent validityConvergent validity: correlates highly with other measures : correlates highly with other measures designed to assess the same construct.designed to assess the same construct.

Discriminant validityDiscriminant validity: should not correlate with other constructs.: should not correlate with other constructs.

The important thing to recognize is that they work together—if you The important thing to recognize is that they work together—if you can demonstrate that you have evidence for both convergent and can demonstrate that you have evidence for both convergent and discriminant validity, then you have, by definition, demonstrated discriminant validity, then you have, by definition, demonstrated that you have evidence for construct validity. that you have evidence for construct validity.


Example of Convergent ValidityExample of Convergent Validity

r r 1,11,1 = 1.00 = 1.00r r 1,21,2 = .83 = .83r r 1,31,3 = .89 = .89r r 1,41,4 = .91 = .91


Example of Discriminant ValidityExample of Discriminant Validity

r r 1,21,2 = .06 = .06


chapter 4 validity robert j. drummond and karyn dayle jones assessment procedures for counselors and...

Documents