high-impact educational practices: what are they? · and the first-year seminar: a...

51
High-Impact Educational Practices: What Are They? Misha Turner, Ph.D. Center for Community College Student Engagement 2015 Conference on First-Year Experience Monday, February 9

Upload: others

Post on 22-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

High-Impact Educational Practices: What Are They?

Misha Turner, Ph.D.Center for Community College

Student Engagement

2015 Conference on First-Year ExperienceMonday, February 9

Page 2: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental
Page 3: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Identifying and Promoting High-Impact Educational Practices in Community Colleges

Student and faculty participation in promising practices Institutional conditions within which promising practices

are implemented What extent are promising practices related to: overall student engagement to student-reported outcomes

Page 4: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Identifying and Promoting High-Impact Educational Practices in Community Colleges

- Cont’d

Analyzed data from four surveys Focus groups Institutes National Reports Web-based resources

4

Page 5: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Four Sources of Information

Page 6: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

First in a Three Part Series of Data Collection, Analysis, and Reporting

Page 7: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

•Assessment and Placement•Orientation•Academic Goal Setting and Planning•Registration Before Classes Begin•Accelerated or Fast-Track Developmental Education•First-Year Experience•Student Success Course•Learning Community•Class Attendance•Alert and Intervention•Experiential Learning Beyond the Classroom•Tutoring•Supplemental Instruction

97%59% 59%

54%

High-Impact Educational Practices

Page 8: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Structured Group Learning Experiences

Practices that ensure students are successful in the early weeks and then through the first year of college:

97%59% 59%

54%

• Orientation • Accelerated or Fast-track Developmental Education

• First-year Experience• Student Success Course• Learning Community

Page 9: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Colleges that Have SGLEsAmong responding colleges, the percentage that have any kind of such a program

Source: 2012 CCIS data. US colleges only.

OrientationYes (283 of 476)

Accelerated or fast-track developmental education

Yes (311 of 523)

First-year experience

Yes (402 of 481)

Student success courseYes (274 of 505)

Learning community

Yes (475 of 489)

97%59% 59%

84% 54%

Page 10: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences: Orientation

10

51%

53%

63%

86%

88%

0% 20% 40% 60% 80% 100%

Tutoring

Time-management skills

Use of information resources (e.g., library, finding andevaluating sources)

Information about and/or use of the college’s academic support network

Information about and/or use of the college’s personal/social support services

Among 286 colleges reporting they have one or more programs

Source: 2012 CCIS data.

Page 11: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences: Accelerated or Fast-Track Developmental Education

11

Among 120 colleges reporting they have one or more programs

Source: 2012 CCIS data.

46%

46%

51%

55%

73%

0% 20% 40% 60% 80% 100%

Test-taking skills

Information about and/or use of the college's academicsupport network

Basic technology skills (e.g., using the Internet, wordprocessing)

Study Skills

Tutoring

Page 12: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences: First-Year Experience

12

Among 166 colleges reporting they have one or more programs

Source: 2012 CCIS data.

87%

88%

89%

89%

93%

80% 100%

Information about and/or use of the college'spersonal/social support services

Information about and/or use of the college's academicsupport network

Use of information resources (e.g., library, finding andevaluating resources)

Study skills

Time-management skills

Page 13: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences: Student Success Course

13

Among 238 colleges reporting they have one or more courses

Source: 2012 CCIS data.

88%

91%

92%

95%

96%

80% 100%

Use of information resources (e.g., library, finding andevaluating resources)

Test-taking skills

Note-taking skills

Study skills

Time-management skills

Page 14: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences: Learning Community

14

65%

65%

68%

68%

75%

0% 20% 40% 60% 80% 100%

Study skills

Information about and/or use of the college'sacademic support network

Common reading(s)

Use of information resources (e.g., library, finding andevaluating resources)

Study/assignments focused on a common theme

Among 160 colleges reporting they have one or more programs

Source: 2012 CCIS data.

Page 15: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Components of Structured Group Learning Experiences

15

• First-Year Experience• Accelerated or Fast-Track Developmental Education

• Student Success CourseStudy Skills

• Orientation• Accelerated or Fast-Track Developmental Education

Tutoring

• Orientation• First-Year Experience• Student Success Course

Time-Management

• Orientation• Accelerated or Fast-Track Developmental Education

• First-Year Experience• Learning Community

Information about and/or use of college’s academic support

network

• Orientation• First-Year Experience• Student Success Course• Learning Community

Use of information resources (e.g., library, finding and

evaluating sources)

• Orientation• First-Year Experience

Information about and/or use of the college’s personal/social

support services

Page 16: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

16

Small-scale success does not solve big-scale problems…

Page 17: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Design, Scale, Implementation, and Intensity

Design practices and programs for high impact. Implement with purpose and include evaluation. Engineer programs for scale, and require them for

all students who can benefit from them. Boost intensity by weaving multiple high-impact

practices together.

Page 18: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

SENSE

Page 19: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

I Have a Goal!

On the SENSE survey, entering students say…

80%want to obtain an associate degree.

75%want to transfer to a four-year institution.

58%want to complete a certificate program.

Source: SENSE 2013

Page 20: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

How Long Will It Take Me to Reach My Goal?

Based on my academic goals at this college, I believe it will take me about

1-2 years to reach them...

52%20

Source: 2013 SENSE Promising Practices data

Page 21: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Reality Check…

Only 54%…earn a certificate, a degree, or are still enrolled

six years later.

Nearly half of all community college students entering in the fall term drop out before the second fall term begins.

21

Horn, L., & Skomsvold, P. (2011). Community college student outcomes: 1994–2009 (NCES 2012-253). Retrieved from http://nces.ed.gov/pubs2012/2012253.pdf •ACT, Inc. (2010). What works in student retention? 4th national survey: Community colleges report. Retrievedfrom http://www.act.org/research/policymakers/pdf/droptables/CommunityColleges.pdf

Page 22: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

SENSE Promising Practice Items

Entering students and class attendance

22

76%

24%

All Instructors Explain Class Attendance

Policy

YESNO

74%

26%

Class Attendance In The First Three

Weeks

NotSkippedSkipped

Source: 2013 SENSE data and 2013 SENSE Promising Practices data

Page 23: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

What students say about skipping class

23

Page 24: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

CCSSE and CCFSSE

Page 25: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

CCSSE Promising Practice ItemsDuring my first term at this college

Students Say…

Orientation(first term & prior to beginningof classes)

First-Year Experience

Student Success Course

25

Source: 2014 CCSSE Promising Practices data

63%

23%

18%

Page 26: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

CCFSSE Promising Practice Items combined with Student responses

11% of CCSSE respondents reported that they registered for class after the first class session has started

59%of faculty responders say that at least one student registered late for a class

26

Sources: 2014 CCSSE Promising Practices data and 2014 CCFSSE Promising Practices data 

Page 27: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Students are not always well-informed

27

Page 28: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

CCIS, CCSSE, CCFSSE

Page 29: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

CCIS, CCSSE, CCFSSE Promising PracticesPromising Practice Colleges That 

Report Having It

Students Who Report Doing It

Full‐Time Faculty Who Teach or Facilitate

Orientation 97% 60% 15%

Student Success Course

84% 20% 12%

First‐YearExperience

61% 25% 18%

Learning Community 54% 12% 16%

AcceleratedDevelopmentalEducation

68% 21%  15%

Sources: 2012 CCIS data 2012 CCSSE data, 2012 CCFSSE data 

Page 30: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Supplemental Instruction

30

Students who use it 20%

Faculty who make it available 91%

Colleges that offer it 61%Source: 2012 CCSSE data, CCFSSE 2012 data, CCIS 2012 data

Page 31: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

A Student Speaks about SI

31

Page 32: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Second in a Three Part Series of Data Collection, Analysis, and Reporting

Page 33: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

33

Active and Collaborative LearningStudent EffortAcademic ChallengeStudent Faculty InteractionSupport for Learners

CCSSE Benchmarks

Page 34: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

34

SENSE Benchmarks

Early ConnectionsHigh Expectations and AspirationsClear Academic Plan and PathwayEffective Track to College ReadinessEngaged LearningAcademic and Social Support Network

Page 35: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

2014 CCSSE Benchmark Scores by Orientation

51.7 52.1 52.0 52.0 52.9

46.9 46.1 46.9 46.544.6

Active andCollaborative

Learning

Student Effort AcademicChallenge

Student-FacultyInteraction

Support forLearners

Participated in Orientation

Did Not Participate in Orientation

Sources: 2014 CCSSE data

Page 36: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Views of Orientation

36

Page 37: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

54.3 54.3 53.155.1 56.5

48.0 47.8 48.8 47.7 46.9

Active andCollaborative

Learning

Student Effort AcademicChallenge

Student-FacultyInteraction

Support forLearners

Participated in First Year Experience

Did not participate in First Year Experience

Sources: 2014 CCSSE data

2014 CCSSE Benchmark Scores by First Year Experience Program

Page 38: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

2014 CCSSE Benchmark Scores by Learning Community

59.056.9

54.458.0 58.9

48.4 48.6 49.4 48.6 48.3

Active andCollaborative

Learning

Student Effort AcademicChallenge

Student-FacultyInteraction

Support forLearners

Participated in Learning Community

Did not Participate in Learning CommunitySources: 2014 CCSSE data

Page 39: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

2014 CCSSE Benchmark Scores by Student Success Course

54.5 55.653.3

55.557.3

48.2 47.8 49.0 47.9 47.2

Active andCollaborative

Learning

Student Effort AcademicChallenge

Student-FacultyInteraction

Support forLearners

Participated in Student Success Course

Did not Participate in Student Success CourseSources: 2014 CCSSE data

Page 40: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

2014 CCSSE Benchmark Scores by Accelerated Developmental Education

55.2 55.653.7

56.0 56.1

47.5 47.9 48.5 47.3 47.5

Active andCollaborative

Learning

Student Effort AcademicChallenge

Student-FacultyInteraction

Support forLearners

Participated in Accelerated Developmental Course

Did Not Participate in Accelerated Developmental CourseSources: 2014 CCSSE data

Page 41: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

41

Higher Engagement = Higher Graduation Rates

3 of the 5 CCSSE Benchmarks:

- Active and Collaborative Learning- Student-Faculty Interaction- Support for Learners

“correlated to a statistically significant degree with IPEDS graduation rates.”

Derek Price & Esau Tovar, 2014

Page 42: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Third in a Three Part Series of Data Collection, Analysis, and Reporting

Page 43: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Positive Relationships Between High-Impact Practices and Student Outcomes…

Completion of at least one developmental education course with grade of C or better

Completion of at least one gatekeeper course with a grade of C or better

Persistence (fall-to-spring and fall-to-fall)

43

Page 44: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

OUTCOME

1

44

Completion of at Least One Developmental Education Course With a Grade of C or Better

STUDENT SUCCESS COURSE

44

Source: SENSE-linked student record data (entering students)

OUTCOMES

SENSE developmental students

who reported participating in were to successfully complete

a student success course 1.40 timesmore likely

a developmental math course N=2,834p<0.0001

a student success course 4.49 timesmore likely

a developmental English course N=2,834p<0.0001

than were students who did not report participating in a student success course.

Page 45: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

OUTCOME

2

45

Completion of at Least One Gatekeeper Course With a Grade of C or Better

FIRST-YEAR EXPERIENCE

45

Source: SENSE-linked student record data (entering students)

OUTCOMES

SENSE developmental students

who reported participating in were to successfully complete

a first-year experience 1.52 timesmore likely

a gatekeeper English course N=847p=0.0188

than were students who did not report participating in a first-year experience.

Page 46: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

First-Generation College Student Achievement and the First-Year Seminar: A Quasi-Experimental Design

– Data from 266 first-generation students in an FYS and used a quasi-experimental design incorporating hierarchical propensity score matching techniques to form quasi-control groups.

– The results show the seminar had a significant positive effect on achievement (an overall GPA difference of 0.71 points) and persistence (an overall 17% difference).

Journal of The First-Year Experience & Students in Transition, (Vaughan, Angela; Parra, Janessa; Lalonde, Trent) Volume 26, Number 2, Fall 2014, pp. 51-67(17)

46

Page 47: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

OUTCOME

3

47

Persistence(Fall-to-Spring and Fall-to-Fall)

ORIENTATION

47

Source: CCSSE-linked student record data

OUTCOMES

CCSSE non-developmental students

who reported participating in were to persist

any orientation 1.30 timesmore likely

fall-to-spring N (students)=923N (terms)=3,302p=0.0138

any orientation 1.24 timesmore likely

fall-to-fall N (students)=923N (terms)=3,302p=0.0733

than were students who did not report participating in any orientation.

Page 48: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Key Design Features of Pathways Aligning Levels of Learning

Coalescing Arts and Sciences With Career and Technical Education

Integrating Student Learning and Support

Connecting Classroom Learning to Applied Learning

Merging Curricular and Co-Curricular Learning

Bridging the For-Credit versus Non-Credit Gap

Donna Dare, Kay McClenney and Susan Thomason, 2013.- “Premises and Promise: Developing New Pathways for Community College Students.”

Page 49: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

It’s Not Just About Having a list of High-Impact Practices...

The effectiveness of educational practice depends on:

A Strong Start Clear, coherent pathways Integrated support High expectations Intensive and Inescapable student engagement Design for Scale Professional Development

49

Page 50: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

50

If nothing changes, Nothing changes

What one thing are you personally committed to do this year to improve first-year student engagement?

Write down one “I want” Write down one “I will”

Page 51: High-Impact Educational Practices: What Are They? · and the First-Year Seminar: A Quasi-Experimental Design –Data from 266 first-generation students in an FYS and used a quasi-experimental

Questions ?Today’s presentation is posted on the Center’s

website: http://www.ccsse.org/center/resources/presentations.cfm