chapter 16 the computer in assessment robert j. drummond and karyn dayle jones assessment procedures...

Chapter 16Chapter 16 The Computer in Assessment The Computer in Assessment

Robert J. Drummond and Karyn Dayle JonesAssessment Procedures for Counselors and Helping Professionals, 6th editionCopyright ©2006 by Pearson Education, Inc.Upper Saddle River, New Jersey 07458All rights reserved.

The Computer in AssessmentThe Computer in Assessment

• Tremendous growth in measurement instruments Tremendous growth in measurement instruments created for administration, scoring, and created for administration, scoring, and interpretation by the computer.interpretation by the computer.

• The Internet is also changing the current landscape The Internet is also changing the current landscape and the future of testing by providing 24/7 access, and the future of testing by providing 24/7 access, ease-of-use, and immediate scoring. ease-of-use, and immediate scoring.


The computer is currently used for:The computer is currently used for:

• Test administrationTest administration• Test scoringTest scoring• Computing normsComputing norms• Assessing reliabilityAssessing reliability• Assessing validityAssessing validity• Providing interpretative feedbackProviding interpretative feedback• Computing factor analysis and other statistics Computing factor analysis and other statistics

needed in testingneeded in testingRobert J. Drummond and Karyn Dayle JonesAssessment Procedures for Counselors and Helping Professionals, 6th editionCopyright ©2006 by Pearson Education, Inc.Upper Saddle River, New Jersey 07458All rights reserved.

Advantages of Computer-based TestingAdvantages of Computer-based Testing

• Reproduce closely the instructions and presentation Reproduce closely the instructions and presentation formats of pencil-and-paper versionsformats of pencil-and-paper versions

• More cost effectiveMore cost effective• Provide immediate feedbackProvide immediate feedback• 24/7 access24/7 access• Extensive written reportsExtensive written reports• Adaptive testingAdaptive testing


Are computer-based tests Are computer-based tests and traditional tests the same?and traditional tests the same?

Studies have compared computerized Studies have compared computerized administration of psychological instruments administration of psychological instruments with standard tests and have found a high with standard tests and have found a high degree of similarity between the two degree of similarity between the two formats. formats.


Potential Problems and Limitations Potential Problems and Limitations

of Computer-based Testsof Computer-based Tests

• May depersonalize the clientMay depersonalize the client• Compromise the confidentiality of clients Compromise the confidentiality of clients • Use of computerized narrative reports by Use of computerized narrative reports by

unqualified personsunqualified persons• Individuals may be uncomfortable using the Individuals may be uncomfortable using the

computercomputer


Computer-Adaptive TestingComputer-Adaptive Testing

• Presents the test taker with a test specifically Presents the test taker with a test specifically tailored for his or her individual ability leveltailored for his or her individual ability level

• Chooses the test taker’s next test item based upon Chooses the test taker’s next test item based upon the answer of the last item the answer of the last item

• If the test taker answers the question correctly, If the test taker answers the question correctly, he/she is given a more difficult itemhe/she is given a more difficult item


Computer-based Personality TestingComputer-based Personality Testing

• MMPI: most researched of computer-based testsMMPI: most researched of computer-based tests• Computer-based personality tests can generate test narratives Computer-based personality tests can generate test narratives

and reports and reports • Tend to be more reliable than the interpretations of individualsTend to be more reliable than the interpretations of individuals• Due to its objective nature, computer-generated test results may Due to its objective nature, computer-generated test results may

be easier for clients to hearbe easier for clients to hear• Computer-generated test reports may be more comprehensive Computer-generated test reports may be more comprehensive

then individual clinicians’ reportsthen individual clinicians’ reports• Computer-generated test reports provide more objective Computer-generated test reports provide more objective

informationinformation


Internet-based AssessmentInternet-based Assessment

• There are hundreds of assessment-related There are hundreds of assessment-related websites. websites.

• Internet-based assessment websites vary in Internet-based assessment websites vary in content, quality, and function. content, quality, and function.


Advantages of Internet-based AssessmentAdvantages of Internet-based Assessment

• The large population accessThe large population access• Less costLess cost• The possibility of providing the tools around the The possibility of providing the tools around the

clock, without any time limitationclock, without any time limitation• The completely voluntary participation, which The completely voluntary participation, which

usually improves respondents’ motivationusually improves respondents’ motivation


Concerns about Internet-based AssessmentConcerns about Internet-based Assessment

• Concerns about the reliability and validity of the data Concerns about the reliability and validity of the data collected collected

• Although many people have access to the Internet, not Although many people have access to the Internet, not everyone does, which can be a confounding variable in a everyone does, which can be a confounding variable in a research study research study

• Questions regarding test security Questions regarding test security • Nearly impossible to positively identify a person taking an Nearly impossible to positively identify a person taking an

online assessment if the test is not taken at a special site online assessment if the test is not taken at a special site • No human contact while participants received No human contact while participants received

feedback/results feedback/results


Electronic PortfoliosElectronic Portfolios

• A portfolio is essentially a collection of a student’s work A portfolio is essentially a collection of a student’s work that can be used to demonstrate his or her skills and that can be used to demonstrate his or her skills and accomplishments. accomplishments.

• With traditional portfolios, folders, boxes, or 3-ring With traditional portfolios, folders, boxes, or 3-ring binders hold papers, pictures, cassette tapes, and more. binders hold papers, pictures, cassette tapes, and more.

• With electronic portfolios, information can be stored With electronic portfolios, information can be stored digitally on a computer hard drive or some sort of digitally on a computer hard drive or some sort of removable media (pen drive, floppy disk, CD, etc.). Sound, removable media (pen drive, floppy disk, CD, etc.). Sound, pictures, graphics, and video can be easily added to an pictures, graphics, and video can be easily added to an electronic portfolio.electronic portfolio.


Computer Simulation In TestingComputer Simulation In Testing

• Computer simulations are the technique of representing the Computer simulations are the technique of representing the real world by a computer program. real world by a computer program.

• Long-established technique for conducting training and Long-established technique for conducting training and assessing the readiness of individuals, crews, teams, assessing the readiness of individuals, crews, teams, groups, and units to perform military operations.groups, and units to perform military operations.

• Rather than taking individuals through a series of test Rather than taking individuals through a series of test items, assessments involving computer simulations items, assessments involving computer simulations immerse them in situations like the ones for which they are immerse them in situations like the ones for which they are being selected or prepared. being selected or prepared.


chapter 16 the computer in assessment robert j. drummond and karyn dayle jones assessment procedures...

Documents