andrews university school of education assessment report — 2012-2013

Andrews UniversitySchool of Education

Assessment Report

—2012-2013

Outline of Annual Report• Overview of SED Departments &

Programs• Assessment Report/Summary of

Data• Break for Dinner• Job Placements of Recent Grads• MTTC Score Trends• “Closing the Loop”—Plans for

Improvement

Programs in the SED

Teaching, Learning & Curriculum• BSELED (Bachelor of Science in

Elementary Education)• Elementary Certification• Secondary Certification• BS with Secondary Certification• MAT (Master of Arts in Teaching)• MA EdS, EdD, PhD in Education—

Curriculum and Instruction (C&I)

Programs (cont’d)

Graduate Psychology and Counseling• MS in Special Education—Learning

Disabilities• MA in School Counseling• MA in Community Counseling

Programs (cont’d)

Graduate Psychology and Counseling• MS in Special Education—Learning

Disabilities• MA in School Counseling• MA in Community Counseling• MA in Clinical Mental Health

Counseling• EdS in School Psychology• MA, EdD, PhD in Educational

Psychology• PhD in Counseling Psychology

Programs (cont’d)Leadership• Educational Leadership (K-12):

Graduate Certificate, MA, EdS, EdD, PhD

• Higher Education Administration: MA, EdS, EdD, PhD

• Leadership: Undergraduate Certificate, MA, EdS, EdD, PhD

2012-2013 Candidate Enrollments

Program Elementary Secondary

Biology . .

Chemistry . .

Communication . 1

English . 11ESL . 6

Education, Elementary 60 .

History . 1

Integrated Science . 2

Language Arts 2 .

2012-2013 Enrollments (cont’d)Program Elementary Secondary

French . .

Spanish . 8

Math/Math Education . 8

Music Education . 15

Physics . 1

Political Science . .

Religion . 3

Social Studies, Elementary 1 .

Social Studies, Secondary . 2

Visual Arts Education . 6

2012-2013 Enrollments (cont’d)

Program Certificates*, MA, MS, EdS, EdD, & PhD

Curriculum & Instruction 55Educational Leadership* 35Higher Education Administration 13Leadership* 113Special Education-Learning Disabilities 15School Counseling 11School Psychology 17Educational Psychology 27Community Counseling (phasing out) 1Clinical Mental Health Counseling 27Counseling Psychology 29

2012-2013 Enrollments (cont’d)

Total Enrollment = 470

Report of Assessment Data

• Student Outcomes• Program Quality• Faculty Assessment

Student Outcomes by Department

• Teaching, Learning & Curriculum (TLC)

• Graduate Psychology & Counseling (GPC)

• Leadership (LEAD)

Student Outcomes—TLC

Teacher Education Course Assessments• 20+ assessments (rubrics), lowest mean

rating 4.17/5.00• Over 90% of all ratings at least 3/5

• CAS course grades: • 14 disciplines, 300+ students• most ratings over 4.00 (mean)• 2 disciplines under 4.00 • biology (3.86) & math (3.87)

• In 7 disciplines, 100% of students rate at least 3/5


Teacher Education (MTTC Scores)• MTTC = Michigan Test of Teacher

Education • for Content Area Certification• Reported in 3-year blocks (2009-

2012)

MTTC Content Area, 2009-2012

Program A.U. N

A.U. % Pass

Mich. N

Mich.% Pass

Biology 3 504 85.1

Communication 2 26 53.8

English 11 81.8 2,042 88.1

ESL 7 516 91.7

History 3 1,631 87.2

Int Science, El 2 1,345 69.6

Int Science, Sec 3 298 88.3

Language Arts 11 90.9 2,765 78.0

MTTC Content Area, 2009-2012 (cont’d)

Program A.U.N

A.U. % Pass

Mich. N

Mich.% Pass

Math, Elem 5 1,610 86.7

Math, Sec 4 1,118 95.3

Music 7 415 98.6

Physics 2 196 89.8

Social Studies 6 2,677 73.5

Spanish 9 631 88.7

Elem Education 23 100.0 7,618 98.1

All Tests 108 89.8 34,556 88.5


Curriculum & Instruction• In 9 assessment rubrics, lowest mean

rating 4.77/5.00• 100% of all ratings at least 3/5

Student Outcomes—GPC

Assessment Data Across All GPC Programs• In 14 assessment rubrics, lowest mean

rating 3.54/5.00• For all assessments except 2, > 90% of

all ratings at least 3/5• In 6 assessments, 100% at least 3/5

Student Outcomes—LEAD

Educational Leadership• In 10 assessments, lowest mean rating

4.48/5.00• For all assessments, more than 90% of

all ratings at least 3/5

Student Outcomes—LEAD

Leadership (Portfolio Assessments)• Across 14 competencies, lowest mean

rating 3.14/5.00• >98% of all ratings at least 3/5

Program Quality

SED Overall• Alumni Survey (2010-2011)• N = 19• 4.05/5.00 (mean) on 16 questions

addressing program quality

Program Quality by Department

• Teaching, Learning & Curriculum• Graduate Psychology & Counseling• Leadership

Program Quality—TLCCourse Evaluations, Spring 2013

Question% at 4-5

Mean

This course helped me to express my ideas more clearly.

79.8 4.04

The learning objectives or goals for this course were clearly stated.

91.2 4.31

The grading system of this course was appropriate for the objectives of the course.

83.7 4.13

N = 158

Program Quality—TLCCourse Evaluations, Spring 2013 (cont’d)

Question% at 4-5

Mean

Methods of evaluation were fair and accurate measures of my learning.

82.4 4.14

This course helped me to critically evaluate different sources and/or points of view.

75.3 4.07

Independent of the instructor, my overall rating of this course is:

64.6 3.71

N = 158

Program Quality—TLCSenior Exit Survey, Teacher Education (2012-2013)

• Seniors (n = 14) rated program/faculty at least 3.75/5.00 (mean) on all indicators except one. • 3.50 (mean) for “There were adequate

specialized equipment (e.g. computers, instruments, lab supplies, etc.).”

• Similar to ratings across the University.

Program Quality—GPCCourse Evaluations, Spring 2013

Question% at 4-5

Mean


80.4 4.05


90.7 4.31


86.2 4.26

N = 173

Program Quality—GPCCourse Evaluations, Spring 2013 (cont’d)

Question% at 4-5

Mean


83.2 4.13


86.7 4.28


63.7 3.83

N = 173

Program Quality—LEADCourse Evaluations, Spring 2013

Question% at 4-5

Mean


93.5 4.59


90.0 4.45


90.2 4.46

N = 110

Program Quality—LEADCourse Evaluations, Spring 2013 (cont’d)

Question% at 4-5

Mean


91.0 4.47


99.1 4.72


85.7 4.35

N = 110

Faculty Assessment

• Course Evaluations• Advisor Evaluations• Senior Exit Survey

Faculty Assessment

Course Evaluations• N = 464 (all SED)• 4.33/5.00 = mean rating on 9

questions related to the instructor• Highest: “The instructor was

sensitive to and respectful of all people” (4.49)

• Lowest: “Timely, thoughtful, and helpful feedback was provided on tests and other work” (4.16)

Faculty AssessmentAdvisor Evaluations• Difficulty in collecting data• Revised process to begin March 2014• 2012-2013: Only Leadership data• N = 25• All LEAD advisors 4.50/5.00 (mean)

on 10 of 14 indicators• Lowest: “My advisor responds within

two business days to my e-mail and/or telephone messages” (4.15)

• Highest: “My advisor is courteous and respectful” (4.92)

Faculty Assessment

Senior Exit Survey• Teacher Education (undergrads only)• N = 14• 4.50 (mean) on6 of 7 faculty-related

indicators• Lowest: 4.00 for “Faculty used

technology effectively to enhance their teaching” • (cf. 4.10 across all Andrews seniors)• Not so bad!

Faculty Assessment

Senior Exit Survey (cont’d)• Lowest: 4.00 for “Faculty used technology

effectively to enhance their teaching” • (cf. 4.10 across all Andrews seniors)• Not so bad!

• Highest: 4.86 for 2 indicators• “Faculty members showed genuine

interest in each student”• “Faculty taught me how Christian

faith and ethics relate to my field”

Dinner Time

Teacher Education Graduates2011-2012

Roger Alva Integrated Science

Jefferson Christian Acad

Rachel Ballast Spanish Grand Rapids Adv Acad

Katherine Bass

Integrated Science

Anabel Dominguez

Math, Spanish

Justin Groff Elementary Ed

SDA School, California

Erin Hotelling English Spring Valley Acad

Jarrod Lutz English Spencerville Adv Acad

Katherine Miller

Integrated Science

New Zealand

Teacher Education Graduates (cont’d)

2011-2012 (cont’d)Cheri Notice Social Studies,

Sec

Leah Rodriguez

English, Spanish

Milwaukee SDA Acad

Debra Rosengren

Music Education Graduate School

Nolan Williams

Religion Highland Advent Acad


Michelle Adame

English Holbrook SDA Ind Sch

Jessica Catron English

Meredith Chavez Social Studies

Korea, student miss tchr

Tanya Crumley Read, Soc St Springs Adventist Acad

Hannah DeLuca Language Arts

Hinsdale Adventist Acad

Geneva Fraser Language Arts

Columbus Advent Acad

Tom Gammon Language Arts

Columbus Advent Acad

Kimberly Geach Language Arts

Elizabeth Glover Social Studies

2012-2013


2012-2013 (cont’d)Ben Hotelling Social Studies Kettering College

Alicia Hutchinson

Math Korea, student miss tchr

Erica Johnson Language Arts

Ray Kirk Music Education

Pat Leja English

Jeremy McIntyre Music Education

Elem School, Kalamazoo

Ashley Meyer English

Kalicia Morrison Language Arts Charlotte Adventist Sch

John Musselman Math Bridgman High School


2012-2013 (cont’d)Brad Paquette

Political Science

Niles New Tech Entre-preneurial Academy

Jason Park Social Studies

Jessica Ramirez

Visual Arts Educ

Korea, student miss tchr

Nicholas Reichert

English, Spanish

Arizona Conference, asst to Youth Director

Michael Riess History, English

Warren Junior Academy

Styves Romain

Math, Physics

Tonya Mae Ross

Language Arts Central Penn Christian School, PA

Lauren Snell Language Arts

Maxine Umana

Religion, Sec

MTTC Score Trends

• Michigan Test of Teacher Certification for subject areas

• Reported in 3-year blocks• 2006-2009 is missing• 6-Year Trends by Subject/Program

MTTC Score Trends

All Tests (excluding Basic Skills)

Years N % Pass09-12 108 89.808-11 105 86.707-10 131 91.606-09 - -05-08 189 93.104-07 184 91.3

MTTC Score Trends

Elementary EducationYears N % Pass09-12 23 100.008-11 23 95.707-10 34 97.106-09 - -05-08 57 98.204-07 60 98.3

MTTC Score Trends

EnglishYears N % Pass09-12 11 81.808-11 7 *07-10 10 90.006-09 - -05-08 8 *04-07 4 *

MTTC Score Trends

English as a Second LanguageYears N % Pass09-12 7 *08-11 4 *07-10 1 *06-09 - -05-08 0 -04-07 0 -

MTTC Score Trends

Language ArtsYears N % Pass09-12 11 90.908-11 11 100.007-10 15 100.006-09 - -05-08 29 89.704-07 26 88.5

MTTC Score Trends

HistoryYears N % Pass09-12 3 *08-11 4 *07-10 8 *06-09 - -05-08 11 100.004-07 10 90.0

MTTC Score Trends

Political ScienceYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 1 *04-07 1 *

MTTC Score Trends

Social StudiesYears N % Pass09-12 6 *08-11 12 58.307-10 17 70.606-09 - -05-08 16 75.004-07 11 63.6

MTTC Score Trends

BiologyYears N % Pass09-12 3 *08-11 1 *07-10 0 -06-09 - -05-08 1 *04-07 2 *

MTTC Score Trends

ChemistryYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 3 *04-07 5 *

MTTC Score Trends

PhysicsYears N % Pass09-12 2 *08-11 1 *07-10 1 *06-09 - -05-08 2 *04-07 2 *

MTTC Score Trends

Integrated Science (Elementary)

Years N % Pass09-12 2 *08-11 2 *07-10 3 *06-09 - -05-08 2 *04-07 2 *

MTTC Score Trends

Integrated Science (Secondary)

Years N % Pass09-12 3 *08-11 2 *07-10 0 -06-09 - -05-08 1 *04-07 1 *

MTTC Score Trends

Math (Elementary)Years N % Pass09-12 5 *08-11 4 *07-10 7 *06-09 - -05-08 7 *04-07 6 *

MTTC Score Trends

Math (Secondary)Years N % Pass09-12 4 *08-11 4 *07-10 3 *06-09 - -05-08 4 *04-07 7 *

MTTC Score Trends

SpanishYears N % Pass09-12 9 *08-11 12 91.707-10 13 92.306-09 - -05-08 10 90.004-07 7 *

MTTC Score Trends

FrenchYears N % Pass09-12 0 -08-11 1 *07-10 2 *06-09 - -05-08 3 *04-07 2 *

MTTC Score Trends

Music EducationYears N % Pass09-12 1 *08-11 1 *07-10 1 *06-09 - -05-08 10 90.004-07 11 90.9

MTTC Score Trends

MusicYears N % Pass09-12 7 *08-11 9 *07-10 7 *06-09 - -05-08 3 *04-07 1 *

MTTC Score Trends

Visual Arts EducationYears N % Pass09-12 0 -08-11 0 -07-10 0 -06-09 - -05-08 4 *04-07 4 *

MTTC Score Trends

Guidance CounselorYears N % Pass09-12 4 *08-11 3 *07-10 0 -06-09 - -05-08 1 *04-07 1 *

MTTC Score Trends

Learning DisabilitiesYears N % Pass09-12 2 *08-11 0 -07-10 0 -06-09 - -05-08 6 *04-07 7 *

Closing the LoopPlans for Improvement• Are we assessing what we value?• Developing a revised Assessment

Calendar• Renewed efforts to collect rubric

data—LiveText• Developed a new Advisor Evaluation

procedure (online in March)• Considering how to boost return on

Alumni and Employer Surveys

Closing the LoopQuestions we continue to grapple with:• Faith development• Research competency• Technology competency• Dissertation process

Closing the LoopNew Faculty Members• Jay Brand—Leadership • Subir Dass—Leadership• Tammy Overstreet—Teaching,

Learning, & Curriculum• Nadia Nosworthy—Graduate

Psychology & Counseling

Resources

Available soon at the School of Education web page, www.andrews.edu/sed/resources/:

• Complete SED Annual Assessment Report, 2012-2013

• This PowerPoint presentation

http://www.andrews.edu/sed/resources/

The End

Thank you!

andrews university school of education assessment report — 2012-2013

Documents