assessment development: building valid and reliable tests habeeb quadri, m.ed denis jarvinen, ph.d
TRANSCRIPT
ASSESSMENT DEVELOPMENT:BUILDING VALID AND RELIABLE TESTS
Habeeb Quadri, M.Ed
Denis Jarvinen, Ph.D.
Overview
Good and Bad of Standardized Testing in Religious Studies Courses
Review General Test Development Model Purpose and Design Shape Assessments Important Questions to be Asked The Development and Review Process
Making Sense of Data within Islamic Studies Courses
Standardized Testing and Religious Studies
Future of Standardized Testing
- Evaluate curriculum effectiveness
- Evaluate student achievement
- Track student achievement over time
- Ensure transferability of students
- Evaluate instructional methods and best practice
- Market the School
- Muslim Common Core
- Experiential learning can not be measured
- Formal Assessments is one tool to measure student mastery of a concept
General Test Development Sequence
Establish a Clear Purpose for the Assessment
Define the Content for the Assessment
Begin Item Development/Selection
Field Test Items
Implement the Assessment
Step 1
Step 2
Step 3
Step 4
Step 5
Establish a Clear Purpose for the Assessment
Why is the assessment being administered?
What knowledge/skills will be assessed?
Who will take the assessment?
When will the assessment be administered?
How will the assessment be scored?
Information?
How will the assessment data be used? What decisions will be made using the
data (e.g., accountability, curriculum, instruction)?
By whom (e.g., administrators, staff, teachers, students)?
How will information from this assessment be integrated with other schools?
Research Process: Islamic Standards
Selected Panel Members
Experts Revise Standards
Incorporate Feedback
Develop Accepted
Standards
Educators
Researched Textbooks
I Love Islam IQRA’ Good Word
Charted Commonalities
Pilot Test
Textbooks
Approached Major Schools
Gathered Curricula
Charted Commonalities
Schools
Content for Assessment – Comparing Curriculums
ISST Advisory Committee
What item formats will be used
(item specifications)?
How will appropriate test content be determined?
Who will review and approve the specific
learning objectives to be covered (pacing guide)?
Who will create final test specifications
(content/item matrix)?
Meeting with
Panel
Since 2010 Over 27 schools across the U.S. implemented
formal assessments
for Islamic Studies
Implementing the Assessment
How will standards for judging test performance be set?
Who develops/reviews final test administration manuals?
Who set rules for who will be tested and when?
What procedures will be used to monitor implementation process across administration sites?
Which staff will receive training on using the test data?
HOW WILL TEST DATA BE CONNECTED TO CLASSROOM INSTRUCTION?
Making Sense of Data Individual Report
Making Sense of Data Class Report
Making Sense of Data School Report
Sample Items Qur’anic Studies Sirah and Hadith
Sample Item
Sample Item
Sample Item
Sample Item