expertise-oriented approach & consumer-oriented approach

Expertise-Oriented Approach&

Consumer-Oriented Approach

Definition: Direct reliance on professional expertise as the primary evaluation strategy

Contributors: Flexner & Eisner

Historical Foundations: Began in the late 1800s (schools, universities and hospitals) “Accreditation”

Not a member of the profession he presumed to judge

Argued common sense was the most relevant form of expertise

He was a layman in terms of education, but he was an educator, and his judgments were directed at medical education rather than the practice of medicine.

(what implications does this have for you as an aspiring administrator?)

Connoisseurship and Criticism

What did Eisner use as an analogy for connoisseurship?

The art of appreciation – not necessarily a liking or a preference for that which is observed.

“to recognize differences that are subtle but significant in a particular qualitative display” (p. 140)

Criticism – is the public side of connoisseurship.

Educational connoisseurship: “… process and effect of education. In an age of high-stakes testing, it is a perspective we badly need” (p. 141)

Examples of Accreditation “Middle States”http://www.msche.org/

Why do institutions of higher education seek accreditation?

How is the process for accreditation organized?

How has it impacted the Ed Admin program at Wilkes University?

1. To improve programs (formative or summative)

2. Provides consumers and stakeholders with an indication of quality (formative or summative?)

3. Ensures the government and those providing financial assistance that the programs are worthwhile (formative or summative?)

1. Self-study (confidential, why?)

2. Report Review by experts

3. Visits with interviews (all stakeholders) and records review.

4. Recommendations for improvement or approval

Consistency Curriculum Assignments/Assessments Rubrics

Continual Review Collection of Assessments (see syllabus) Item Analysis

1. Conflict of interest2. Regional seen as formative and too light

handed3. US Dept. summative and outcomes based4. Confidentiality in Self-Report5. Transparency in Final Report6. Competition from other sources (popular

ratings - U.S. News and World Report)

Specific to Education

NCATEhttp://www.ncate.org/

TEAChttp://teac.org/

What current issue in PA is related to this type of Ad Hoc Panel Review?

How will it impact you as a future educational leader?

http://www.corestandards.org/

http://www.corestandards.org/articles/9-nga-and-ccsso-comment-on-ccssi-governance-suggestions

1. What are the arguments for and against using professional judgment as the means for evaluating programs?

2. What are the different types of expertise-oriented approaches? How are they alike and how do they differ?

3. Why is accreditation of institutions of higher education controversial today? How do these controversies reflect the controversies that frequently arise in many evaluations?

Definition: Establish the value, merit or worth, of a product, program or policy.

Application of the system: The evaluator is a person with expertise in judging things, but not with the particular content expertise-oriented or connoisseur evaluations.

Scriven

Developed checklists (p. 146 – 147)NeedMarket“Performance” (multiple types)Cost-EffectivenessExtended Support

WWChttp://ies.ed.gov/ncee/wwc/

Buroshttp://buros.unl.edu/buros/jsp/search.jsp

4. How is the consumer-oriented evaluation approach like the expertise-oriented approach? How is it different?

5. How do these approaches influence the practice of evaluation today?