topic #3 - critical thinking key evidence 1 provided by amarillo college offices of institutional...
TRANSCRIPT
Topic #3 - CRITICAL THINKING
Key Evidence
1
Provided by Amarillo College Offices of Institutional Research and
Outcomes Assessments
Critical Thinking:General Education Competency
• Amarillo College uses an embedded assessment approach across the college to assess four general education competencies including critical thinking.
• Instructors from all areas/campuses submit student work for assessment.
• Target is to assess100 samples of student work per year.
2
Critical Thinking Rubric Standards
• Upon completion of a minimum of 30 credit hours taken at Amarillo College, a student should be able to demonstrate the successful application of higher order analytical and creative cognitive processes.
• Benchmark: 60% of students must attain a rubric level of 3 or better
• Assess the assigned task as:– Exemplary (5)– Excellent (4)– Competent (3)– Needs work (2)– Unacceptable (1)
3
Explanation of Critical Thinking Rubric: 60% will score in 3, 4 or 5
5 (Exemplary) Consistently does all or almost all of the following:
• Innovative interpretation of evidence, statements, graphics, questions, etc. Identifies exceptional arguments (reasons and claims) pro and con.
• Presents superior explanations of complex analyses and values alternative problem-solving methods.
• Draws well-supported, logical conclusions which follow a logical chain of thought.
• Follows the evidence and creatively presents clear, unambiguous conclusions from the evidence and reasons presented.
4 (Excellent) Consistently does all or almost all of the following:
• Accurately interprets evidence, statements, graphics, questions, etc.
• Identifies the salient arguments (reasons and claims) pro and con.
• Thoughtfully analyzes and evaluates major alternative points of view.
• Draws warranted, judicious, non-fallacious conclusions.
• Justifies key results and procedures, explains assumptions and reasons. Fair-mindedly follows where evidence and reasons lead.
3 (Competent) Does most or many of the following:
• Accurately interprets evidence, statements, graphics, questions, etc. Identifies relevant arguments (reasons and claims) pro and con.
• Offers analyses and evaluations of obvious alternative points of view. Draws warranted, non-fallacious conclusions.
• Justifies some results or procedures, explains reasons.
• Fair-mindedly follows where evidence and reasons lead.
4
Explanation of Critical Thinking Rubric (cont.)
2 (Needs work)Does most or many of the following:
• Misinterprets evidence, statements, graphics, questions, etc.
• Fails to identify strong, relevant counter-arguments.
• Ignores or superficially evaluates obvious alternative points of view.
• Draws unwarranted or fallacious conclusions.
• Justifies few results or procedures, seldom explains reasons.
• Regardless of the evidence or reasons, maintains or defends views based on self-interest or preconceptions.
1 (Unacceptable) Consistently does all or almost all of the following:
• Offers biased interpretations of evidence, statements, graphics, questions, information, or the points of view of others.
• Fails to identify or hastily dismisses strong, relevant counter-arguments. Ignores or superficially evaluates obvious alternative points of view.
• Argues using fallacious or irrelevant reasons, and unwarranted claims.
• Does not justify results or procedures, nor explain reasons.
• Regardless of the evidence or reasons, maintains or defends views based on self –interest or preconceptions.
• Exhibits close-mindedness or rigid thinking. 5
Assessment of General Education Competency: Critical Thinking Findings
• Goal (Benchmark): – 60% of 100 students will score a 3 or higher (“competent”)
• Results:– 2007-2008 (N=91)**
• 96% of students scored a 3 or higher– Scoring system was changed mid-year
– 2008-2009 (N=97)**• 95% of students scored a 3 or higher
** Met goal but no specific strengths or suggestions for improvements provided No specific strengths or suggestions for improvements provided
o specific strengths or suggestions for improvements provided6
Assessment of General Education Competency: Critical Thinking Scores
Committee Evaluation
Exemplary
(5)Excellent
(4)Competent
(3)Needs Work
(2)Unacceptable
(1)# Students Assessed
Yr: 2007-20085 57 25 4 0
91
5%63% 27% 4% 0%
Yr: 2008-200918 57 17 4 1
97
19%59% 18% 4% 1%
No specific strengths or suggestions for improvements provided
7
Community College Survey of Student Engagement (CCSSE) 2009
Results for Amarillo College
relevant to
Critical Thinking
8
CCSSE Faculty/Student ResponsesStatement Faculty Students
During the current school year, how much does the coursework in your selected course section emphasize memorizing facts, ideas, or methods so students can repeat them in pretty much the same form
Very Little 13% 8%
Some 32% 30%
Quite a bit 37% 38%
Very Much 18% 25%
During the current school year, how much does the coursework in your selected course section emphasize analyzing the basic elements of an idea, experience, or theory
Very Little 4% 6%
Some 15% 30%
Quite a bit 49% 43%
Very Much 32% 20%
During the current school year, how much does the coursework in your selected course section emphasize synthesizing and organizing ideas, information, or experiences in new ways
Very Little 4% 9%
Some 25% 35%
Quite a bit 41% 38%
Very Much 30% 18%
How often do students in your selected course section work on a paper that requires integrating ideas or information from various sources
Never 29% 21%
Sometimes 29% 34%
Often 23% 32%
Very Often 19% 13%9
CCSSE Faculty/Student Responses (cont.)Statement Faculty Student
During the current school year, how much does the coursework in your selected course section emphasize making judgments about the value or soundness of information, arguments, or methods
Very Little 11% 17%
Some 29% 36%
Quite a bit 38% 33%
Very Much 22% 14%
During the current school year, how much does the coursework in your selected course section emphasize applying theories or concepts to practical problems or in new situations
Very Little 4% 12%
Some 26% 36%
Quite a bit 35% 36%
Very Much 35% 17%
During the current school year, how much does the coursework in your selected course section emphasize having students use information they have read or heard to perform a new skill
Very Little 10% 8%
Some 23% 34%
Quite a bit 34% 37%
Very Much 34% 21%10
CCSSE Faculty/Student Responses (cont’d)
Statement Faculty Student
To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in thinking critically and analytically
None 1% 0%
Very little 3% 4%
Some 9% 22%
Quite a bit 39% 43%
Very much 48% 31%
To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in solving numerical problems
None 20% 0%
Very little 25% 7%
Some 17% 21%
Quite a bit 13% 39%
Very much 25% 32%11
CCSSE AC Students to Large Colleges and all CCSSE Cohorts
Statement AC Large Colleges
CCSSE Cohort
How often do students in your selected course section work on a paper that requires integrating ideas or information from various sources
Never 21.1% 11.1% 11.2%Sometimes 33.9% 28.3% 28.7%
Often 32.2% 37.2% 37.2%Very often 12.9% 23.4% 23.0%
During the current school year, how much does the coursework in your selected course section emphasize analyzing the basic elements of an idea, experience, or theory
Very little 6.2% 4.8% 5.0%Some 30.3% 27.5% 28.4%
Quite a bit 43.5% 43.3% 43.1%
Very much 20.1% 24.4% 23.5%
During the current school year, how much does the coursework in your selected course section emphasize synthesizing and organizing ideas, information, or experiences in new ways
Very little 9.2% 7.8% 7.5%Some 35.1% 33.0% 33.5%
Quite a bit 37.5% 38.4% 38.7%Very much 18.2% 20.8% 20.4%
During the current school year, how much does the coursework in your selected course section emphasize making judgments about the value or soundness of information, arguments, or methods
Very little 16.7% 12.7% 12.4%Some 35.9% 36.0% 36.5%
Quite a bit 33.3% 34.0% 34.1%Very much 14.1% 17.4% 17.0%12
CCSSE AC Students to Large Colleges and all CCSSE Cohorts
Statement AC Large Colleges
CCSSE Cohort
During the current school year, how much does the coursework in your selected course section emphasize having students use information they have read or heard to perform a new skill
Very little 8.1% 9.7% 8.9%Some 33.9% 30.8% 30.5%
Quite a bit 36.8% 35.6% 36.1%
Very much 21.2% 23.9% 24.5%
To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in thinking critically and analytically
Very little 3.5% 7.0% 6.4%
Some 21.8% 25.8% 25.2%
Quite a bit 43.4% 41.1% 41.8%
Very much 31.2% 26.1% 26.6%
To what extent do students' experiences in your selected course section contribute to their knowledge, skills, and personal development in solving numerical problems
Very little 7.2% 17.0% 16.1%
Some 21.0% 29.4% 29.3%
Quite a bit 39.4% 33.0% 33.7%
Very much 32.4% 20.7% 20.9%
During the current school year, how much does the coursework in your selected course section emphasize applying theories or concepts to practical problems or in new situations
Very little 11.5% 10.4% 10.0%
Some 36.4% 34.0% 34.2%
Quite a bit 35.5% 35.4% 35.8%
Very much 16.6% 20.2% 20.0%13
Mean Scores Compared to Large Colleges
* AC average score was significantly different when compared to other large colleges.
14
Statement AC Mean
Large College
Sig*
During the current school year, how much has your coursework at this college emphasized the following mental activities? (1=Very Little, 2=Some, 3=Quite a bit, 4=Very much)
Memorizing facts, ideas, or methods from your courses and readings so you can repeat them in pretty much the same form
2.80 2.82
Analyzing the basic elements of an idea, experience, or theory 2.77 2.87
Synthesizing and organizing ideas, information, or experiences in new ways
2.65 2.72
Making judgments about the value or soundness of information, arguments, or methods
2.45 2.56
Applying theories or concepts to practical problems or in new situations
2.57 2.65
Using information you have read or heard to perform a new skill 2.71 2.74
How much has your experience at this college contributed to your knowledge, skills, and personal development in the following areas? (1=Very little, 2=Some, 3=Quite a bit, 4=Very much)
Thinking critically and analytically 3.02 2.86
Solving numerical problems 2.97 2.57 *
