atc (national seminar,2000)
TRANSCRIPT
Jump to first page
TTesting,
Kanchana Prapphal
for Quality Assurance in Teaching
MMeasurement
and EEvaluation
Jump to first page
TTests, ests, MMeasurement easurement and and EEvaluationvaluation
Test: 1. Measurement instrument
2. Designed to elicit specific sample of behavior
Measurement:
1. Quantification: assigning numbers
2. Characteristics: abilities, traits, attributes, constructs
3. Rules and procedures: must be replicable
Jump to first page
Evaluation: 1. Systematic
2. Gathering of information
3. Making decisions: value judgments
Measurement = Testing+ Quantitative Data
Evaluation = Testing + Quantitative Data + Qualitative Data
+ Judgment
(Bachman, 1990)
TTests, ests, MMeasurement easurement and and EEvaluationvaluation
Jump to first page
Uses of tests in Uses of tests in educational educational programsprograms� Individuals
� a. students� b. teachers� c. administrators
� Programs� a. effectiveness� b. appropriateness� c. efficiency� d. revision
Jump to first page
Assumptions Assumptions necessary for using necessary for using teststests
� 1. Information regarding
educational outcomes is essential to
effective formal education.
� 2. Educational outcomes are
measurable.
(Bachman,
1990)
Jump to first page
Learning Learning OutcomesOutcomes
� Learning outcomes are statements of what is expected that a student will be able to DO as a result of a learning activity.
� Quality Assurance:INPUTINPUT PROC
ESSPROCESS
OUTCOMES
OUTCOMES
Descriptors
Descriptors
Jump to first page
Bloom’s Bloom’s TaxonomyTaxonomy
� Three domains of educational activities:
� Cognitive Domain: involves knowledge and the development of intellectual attitudes and skills
� Affective Domain� Psychomotor Domain
(Bloom, 1956)
Jump to first page
Cognitive Cognitive ObjectivesObjectives
� Knowledg
e� Comprehe
nsion
� Application
� Analysis� Synthesis� Evaluation
SimpleSimple
Complex
Complex
Jump to first page
KnowledgeKnowledge
The remembering of previously learned material
Examples of learning objectives:-know common terms
-know specific facts
-know methods and procedures
-know basic concepts
-know principles
Jump to first page
Knowledge Knowledge (Example)(Example)
Who wrote Brave New World?
A. D.H. Lawrence
B. Aldous Huxley
C. Hemmingway
D. Shakespeare
Jump to first page
ComprehensionComprehensionThe ability to grasp the meaning
of material
Examples of learning objectives:
-understand facts and principles
-interpret verbal materials
-interpret charts and graphs
-translate verbal material to mathematical formulae
justify methods and procedures
Jump to first page
Comprehension Comprehension (Example)(Example)
What is the main idea of this
paragraph?
A. Nitrous oxide can cause an
environmental problem.
B. Nitrous oxide is a potent
greenhouse gas.
C. Nitrous oxide destroys the earth’s
ozone layer.
D. Nitrous oxide’s concentration
appears to be rising.
Jump to first page
ApplicatApplicationion
� The ability to use learned material in new and concrete situations
� Examples of learning objectives:� -apply concepts and principles to
new situations� apply laws and theories to practical
situations� solve mathematical problems� construct graphs and charts� demonstrate the correct usage of a
method or procedure
Jump to first page
Application Application (Example)(Example)
Which one of the following values approximates best to the
volume of a sphere with radius 5m?A. 2000 m3
B. 1000 m3
C. 500 m3
D. 250 m3
E. 125 m3 (MCQ)
Jump to first page
AnalyAnalysissis
� The ability to break down material into its component parts
� Examples of learning objectives:� - recognize unstated assumptions� -recognize logical fallacies in
reasoning� distinguish between facts and
inferences� evaluate the relevancy of data� analyze the organizational structure
of a work
Jump to first page
Analysis Analysis (Example)(Example)
Here are the five Basic Needs
determined by Maslow:
1. Comfort and survival
2. Safety
3. Belongingness and love
4. Self-esteem and the esteem of others
5. Self-actualization
Jump to first page
Analysis Analysis (Example)(Example)
Determine in what way the Germans meet these needs and to
what extent the German pattern differs from the American
pattern. Give examples.
(Valette)
Jump to first page
SynthSynthesisesis
� The ability to put parts together to form a new whole
� Examples of learning objectives:� -write a well organized theme� -give a well organize speech� write a creative short story� propose a plan for an experiment� integrate learning from different
areas into a plan for solving a problem
Jump to first page
Synthesis Synthesis (Example)(Example)
Write a paragraph summarizing the text you have read. Your
summary should have a topic sentence defining the problem,
some of the causes, some of the effects, and a conclusion.
Jump to first page
EvaluationEvaluation
The ability to judge the value of material for a given purpose based on definite criteria
Examples of learning objectives:
- judge the logical consistency of written material
-judge the adequacy with which conclusions are supported by data
judge the value of a work by the use of internal criteria (organization) or external standards of excellence
Jump to first page
Evaluation Evaluation (Example)(Example)
“The United States took part in the Gulf War against Irag BECAUSE of the lack of civil liberties imposed on the Kurds by Saddam Hussein’s regime.”A. The assertion and the reason are
both correct and the reason is valid.
B. The assertion and the reason are both correct but the reason is invalid.
Jump to first page
Evaluation Evaluation (Example)(Example)
C. The assertion is correct but the reason is
incorrect.
D. The assertion is incorrect but the reason
is correct.
E. Both the assertion and the reason are
incorrect.
(MCQ)
Jump to first page
Verbs specifying Verbs specifying different sorts of different sorts of outcome (Knowledge)outcome (Knowledge)
arrange order define recognize duplicate
label recall list repeat memorize
state relate reproduce
Jump to first page
ComprehensionComprehension
classify locate describe recognize discuss
report explain restate express review
identify select indicate translate
Jump to first page
ApplicationApplication
apply operate choose practice demonstrate
schedule dramatize sketch employ solve
illustrate use interpret write
Jump to first page
AnalyAnalysissis
analyze differentiate appraise discriminate calculate
distinguish categorize examine compare experiment
contrast question criticize test
Jump to first page
SynthesSynthesisis
arrange formulate assemble manage collect
organize compose plan construct prepare
create propose design write
Jump to first page
EvaluaEvaluationtion
appraise judge argue predict assess
rate attach score choose select
compare support estimate evaluate
Jump to first page
Advantages of Advantages of specifying specifying learning learning outcomesoutcomes� Help students learn more
effectively.� Make it clear what students can
hope to gain from a course.� Help instructors to design their
materials more effectively.� Help instructors select the
appropriate teaching strategy.� Assist in setting examinations
based on the materials delivered.� Ensure that appropriate assessment
strategies are employed.
Jump to first page
Behavioral Behavioral ObjectivesObjectivesBehavioral Behavioral ObjectivesObjectives
Process Process DescriptoDescripto
rsrs
Process Process DescriptoDescripto
rsrs
Product Product DescriptDescript
orsors
Product Product DescriptDescript
orsors
Quality Quality AssuranAssuran
cecein in
TeachinTeachingg
Quality Quality AssuranAssuran
cecein in
TeachinTeachingg
Jump to first page
References
� Bachman, L.F. 1990. Fundamental Considerations in Language Testing. Oxford: Oxford University Press.
� Bloom, B.S. (Ed.) 1956. Taxonomy of Educational Objectives: The Classification of Educational Goals: Handbook I, Cognitive Domain. N.Y.; Toronto: Longmans, Green.
� Cronbach, L.J. 1989. Essentials of Psychological Testing. Fourth Edition. N.Y.: Harper & Row
Jump to first page
References (continued)
� Gronlund, N. and Linn, R.L. 1990. Measurement and Evaluation in Teaching (6th ed.). N.Y.: Macmillan.
� Thorndike, R. L. and Hagen, E. (1969). Measurement and Evaluation in Psychology and Education (3 rd ed.). N.Y. :Wiley.
� http://www..coun.uvic.ca� http://www. reach.ucf.edu� http://www.uct.ac.za
Jump to first page
Chulalongkorn UniversityChulalongkorn University -- Academic Testing Center (CU-ATC)Academic Testing Center (CU-ATC)Http://www.cuatc.chula.ac.th