expertise-oriented approach & consumer-oriented approach
TRANSCRIPT
Expertise-Oriented Approach&
Consumer-Oriented Approach
Definition: Direct reliance on professional expertise as the primary evaluation strategy
Contributors: Flexner & Eisner
Historical Foundations: Began in the late 1800s (schools, universities and hospitals) “Accreditation”
Not a member of the profession he presumed to judge
Argued common sense was the most relevant form of expertise
He was a layman in terms of education, but he was an educator, and his judgments were directed at medical education rather than the practice of medicine.
(what implications does this have for you as an aspiring administrator?)
Connoisseurship and Criticism
What did Eisner use as an analogy for connoisseurship?
The art of appreciation – not necessarily a liking or a preference for that which is observed.
“to recognize differences that are subtle but significant in a particular qualitative display” (p. 140)
Criticism – is the public side of connoisseurship.
Educational connoisseurship: “… process and effect of education. In an age of high-stakes testing, it is a perspective we badly need” (p. 141)
Examples of Accreditation “Middle States”http://www.msche.org/
Why do institutions of higher education seek accreditation?
How is the process for accreditation organized?
How has it impacted the Ed Admin program at Wilkes University?
1. To improve programs (formative or summative)
2. Provides consumers and stakeholders with an indication of quality (formative or summative?)
3. Ensures the government and those providing financial assistance that the programs are worthwhile (formative or summative?)
1. Self-study (confidential, why?)
2. Report Review by experts
3. Visits with interviews (all stakeholders) and records review.
4. Recommendations for improvement or approval
Consistency Curriculum Assignments/Assessments Rubrics
Continual Review Collection of Assessments (see syllabus) Item Analysis
1. Conflict of interest2. Regional seen as formative and too light
handed3. US Dept. summative and outcomes based4. Confidentiality in Self-Report5. Transparency in Final Report6. Competition from other sources (popular
ratings - U.S. News and World Report)
Specific to Education
NCATEhttp://www.ncate.org/
TEAChttp://teac.org/
What current issue in PA is related to this type of Ad Hoc Panel Review?
How will it impact you as a future educational leader?
http://www.corestandards.org/
http://www.corestandards.org/articles/9-nga-and-ccsso-comment-on-ccssi-governance-suggestions
1. What are the arguments for and against using professional judgment as the means for evaluating programs?
2. What are the different types of expertise-oriented approaches? How are they alike and how do they differ?
3. Why is accreditation of institutions of higher education controversial today? How do these controversies reflect the controversies that frequently arise in many evaluations?
Definition: Establish the value, merit or worth, of a product, program or policy.
Application of the system: The evaluator is a person with expertise in judging things, but not with the particular content expertise-oriented or connoisseur evaluations.
Scriven
Developed checklists (p. 146 – 147)NeedMarket“Performance” (multiple types)Cost-EffectivenessExtended Support
WWChttp://ies.ed.gov/ncee/wwc/
Buroshttp://buros.unl.edu/buros/jsp/search.jsp
4. How is the consumer-oriented evaluation approach like the expertise-oriented approach? How is it different?
5. How do these approaches influence the practice of evaluation today?