jennifer ballard george kuh september 19, 2011. overview nsse and the concept of student engagement...
TRANSCRIPT
Jennifer BallardGeorge Kuh
September 19, 2011
Overview
NSSE and the Concept of Student Engagement
Select Linfield results: NSSE 2011
Brief explanation FSSE
Student Engagement and NSSE
What Really Matters in College:
Student Engagement
Because individual effort and involvement are the critical determinants of college impact, institutions should focus on the ways they can shape their academic, interpersonal, and extracurricular offerings to encourage student engagement. Pascarella & Terenzini, 2005, p. 602
Foundations of Student EngagementTime on task (Tyler, 1930s)
Quality of effort (Pace, 1960-70s)
Student involvement (Astin, 1984)
Social, academic integration (Tinto,1987, 1993)
Good practices in undergraduate education (Chickering & Gamson, 1987)
College impact (Pascarella, 1985)
Student engagement (Kuh, 1991, 2005)
What is Student Engagement?
What students do -- time and energy devoted to studies and other educationally purposeful activities
What institutions do -- using resources and effective educational practices to induce students to do the right things
Educationally effective institutions channel student energy toward the right activities
Seven Principles of Good Practice in Undergraduate
Education
Student-faculty contact Active learning Prompt feedback Time on task High expectations Experiences with
diversity Cooperation among
studentsChickering, A. W. & Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. AAHE: Bulletin, 39 (7), 3-7.
National Survey of Student Engagement(pronounced “nessie”)
Community College Survey of Student Engagement(pronounced “cessie”)College student surveys that assess the extent to which students engage in educational practices associated with high levels of learning and development
NSSE Background
Year Institutions
2001 321
2002 367
2003 437
2004 473
2005 529
2006 557
2007 610
2008 769
2009 640
2010 595
2011 751
Launched with grant from The Pew Charitable Trusts in 1999, supported by institutional participation fees since 2002.
Nearly 1,500 baccalaureate-granting colleges and universities in the US and Canada have participated to date.
Institution types, sizes, and locations represented in NSSE are largely representative of U.S. baccalaureate institutions.
NSSE Survey Content
Student Behaviors in College
Student Behaviors in College
Institutional Actions And RequirementsInstitutional Actions And Requirements
Student Reactions to College
Student Reactions to College
Student BackgroundInformation
Student BackgroundInformation
Student Learning & Development
NSSE Benchmarks ofEffective Educational
PracticeActive &
Collaborative Learning
Enriching Educational Experiences
Student – Faculty
Interaction
Supportive Campus
Environment
Level of Academic Challenge
Survey Administration
First-year & senior students in McM
Seniors in Portland (May grads)
Seniors in ADP Conducted spring
semester Web-based Multiple follow-ups
NSSE 2011 Institutionsby Carnegie Classification
6%8%
6%
27%
12%
6%
17%
20%
6%6%
5%
25%
11%
8%
16%
23%
0%
5%
10%
15%
20%
25%
30%
RU/VH RU/H DRU Master’s L Master’s M Master’s S Bac/A&S Bac/Diverse
Carnegie Classification
NSSESchools
All 4-yearSchools
Selected Linfield Results
NSSE 2011Response Rates
Linfield response rates McM,
• First year students, 45%• Seniors, 44%
Ptd, 62% (seniors only) DCE, 40% (seniors only)
NSSE 2011 Response Rates Overall, 33% (Paper, 30%; Web-only,
34%; Web+, 31%)
Hours spent preparing for class;Number of assigned textbooks/book-length readings; Number of papers or reports of 20 pages or more, between 5 and 19 pages, and fewer than 5 pages; Coursework emphasizes: analysis, synthesis, making of judgments, or applying theories; Working harder than you thought you could to meet an instructor's standards or expectations; Campus environment emphasizes: Spending significant amount of time on academics. 16
First-Year
Senior
0 25 50 75 100
54
57
59
63
57
59
Level of Academic Challenge, McM 2011
Linfield (McM)
Carnegie Peers: A&S
NSSE 2011
Asked questions in class or contributed to class discussions; Made a class presentation; Worked with other students on projects during class; Worked with classmates outside of class; Tutored or taught other students; Participated in a community-based project (e.g., service learning);Discussed ideas from your readings or classes with others outside of class 17
First-Year
Senior
0 25 50 75 100
43
51
47
55
46
55
Active and Collaborative Learning, McM 2011
Linfield (McM)
Carnegie Peers: A&S
NSSE 2011
Discussed grades or assignments with an instructor; Talked about career plans with a faculty member or advisor; Discussed ideas from your readings or classes with faculty members outside of class; Worked with faculty members on activities other than coursework; Received prompt written or oral feedback from faculty on your academic performance; Worked on a research project with a faculty member outside of course or program requirements.
18
First-Year
Senior
0 25 50 75 100
34
42
39
52
37
50
Student-Faculty Interaction, McM 2011
Linfield (McM)
Carnegie Peers: A&S
NSSE 2011
Hours spent participating in co-curricular activities; Practicum, internship, field experience, co-op experience, or clinical assignment; Community service or volunteer work; Foreign language coursework and study abroad; Independent study or self-designed major; Culminating senior experience; Serious conversations with students of different religious beliefs, political opinions, or personal values; Serious conversations with students of a different race or ethnicity than your own; Using electronic medium to discuss or complete an assignment; Campus environment encouraging contact among students from different economic, social, and racial or ethnic backgrounds; Participate in a learning community or some other formal program where groups of students take two or more classes together. 19
First-Year
Senior
0 25 50 75 100
28
40
31
53
30
53Enriching Educational Experiences, McM 2011
Linfield (McM)
Carnegie Peers: A&S
NSSE 2011
Campus environment provides the support you need to help you succeed academically; Campus environment helps you cope with your non-academic responsibilities;Campus environment provides the support you need to thrive socially;Quality of relationships with other students;Quality of relationships with faculty members; Quality of relationships with administrative personnel and offices. 20
First-Year
Senior
0 25 50 75 100
63
59
68
65
67
64
Supportive Campus Environment, McM 2011
Linfield (McM)
Carnegie Peers: A&S
NSSE 2011
21
Benchmark Comparisons: Portland Campus
Ac. Challenge
Active/Collab
Student-Fac
Enriching Exp.
Supportive Env.
0 25 50 75 100
60
62
41
44
66
61
57
50
48
67
57
51
42
40
59
NSSE 2011
Carnegie Peers: A&S+Pf
Portland Campus
22
Benchmark Comparisons: Adult Degree Program
Ac. Challenge
Active/Collab.
Student-Fac
Enriching Exp.
Supportive Env.
0 25 50 75 100
61
43
33
30
64
58
54
45
40
63
57
51
42
40
59
NSSE 2011
Carnegie Peers: Diverse
Adult Degree Program
23
McMinnville Campus, Portland Campus, Adult Degree Program
Ac. Chal-lenge
Active/Col-lab
Student-Fac
Enriching Exp.
Supportive Env.
0 25 50 75 100
59
55
50
53
64
60
62
41
44
66
61
43
33
30
64
Adult Degree Program
Portland Campus
Linfield (McM)
Comparison of Distance Education and Campus-Based Learners
Benchmarks of Effective Educational Practice
First-Year Senior
Level of academic challenge + +
Active & collaborative learning – –
Student-faculty interaction + =
Enriching educational experiences + =
Supportive campus environment = +
Comparison of Distance Education and Campus-Based Learners
Gains
First-Year Senior
Practical competence + +
Personal & social devlpmt + +
General education = +
Satisfaction = +
Comparison of Distance Education and Campus-Based Learners
Deep Learning
First-Year Senior
Higher-order learning = +
Integrative learning = =
Reflective learning + +
Benchmarks Over Time: LAC (McM)First Years Seniors
27
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
53.4 55.0 56.7
Level of Academic Challenge (LAC)
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
58.4 58.6 58.9
Level of Academic Challenge (LAC)
Benchmarks Over Time: ACL (McM)First Years Seniors
28
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
43.5 45.0 46.0
Active and Collaborative Learning (ACL)
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
55.4 54.0 55.1
Active and Collaborative Learning (ACL)
Benchmarks Over Time: SFI (McM)First Years Seniors
29
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
35.9 36.2 37.0
Student-Faculty Interaction (SFI)
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
52.3 51.1 49.7
Student-Faculty Interaction (SFI)
Benchmarks Over Time: EEE (McM)First Years Seniors
30
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
27.329.6 29.9
Enriching Educational Experiences (EEE)
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
49.452.0 52.9
Enriching Educational Experiences (EEE)
Benchmarks Over Time: SCE (McM)First Years Seniors
31
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
63.866.7 67.2
Supportive Campus Environment (SCE)
'04 '05 '06 '07 '08 '09 '10 '1115
25
35
45
55
65
75
85
61.9 63.0 64.4
Supportive Campus Environment (SCE)
Comparison to Highly Engaging Institutions: McM
Linfield (McM) compared with
Linfield (McM) NSSE 2011
Top 50% NSSE 2011
Top 10%
Mean a Mean a Sig b
Effect size c Mean a Sig b
Effect size c
First-
Year
LAC 56.7 56.7 .00 60.6 *** -.32
ACL 46.0 48.0 -.12 52.1 *** -.34
SFI 37.0 39.4 * -.12 43.7 *** -.31
EEE 29.9 30.5 -.05 33.7 *** -.28
SCE 67.2 67.4 -.01 71.2 *** -.22
Senior
LAC 58.9 60.5 -.11 64.1 *** -.39
ACL 55.1 56.2 -.07 60.1 *** -.29
SFI 49.7 49.3 .02 56.0 *** -.28
EEE 52.9 46.7 *** .35 55.3 -.15
SCE 64.4 64.9 -.02 68.7 ** -.23
On the up side: The average Linfield senior is about as engaged in enriching experiences as the average senior at institutions in NSSE’s top 10%. Other experiences consistent with students at the top 50% of institutions, but not with the top 10%.Surprise: The average first year student’s experience of student-faculty interaction appears to be below the average student’s experience in the top 50%. Other experiences not very different than the top 50%, but all are below the top 10%. 32
Comparison to Highly Engaging Institutions: Ptd, ADP
Good news: The average Portland Campus senior is about as engaged in active and collaborative learning and reports a supportive campus environment similar to the average senior at institutions in NSSE’s top 10%.
The average ADP senior is about as engaged in academic challenge and reports a supportive campus environment similar to the average senior at NSSE’s top 10%.
33
Linfield (Ptd)
NSSE 2011
Top 50% NSSE 2011
Top 10%
Mean a Mean
a Sig b
Effect size c
Mean a Sig b
Effect size c
Senior
LAC 59.9 60.5 -.04 64.1 ** -.32ACL 61.7 56.2 ** .32 60.1 .09
SFI 41.1 49.3 ** -.38 56.0 *** -.66EEE 43.8 46.7 -.16 55.3 *** -.70
SCE 65.9 64.9 .06 68.7 -.15
Senior
LAC 60.7 60.5 .02 64.1 -.26ACL 42.9 56.2 *** -.78 60.1 *** -.97SFI 33.4 49.3 *** -.73 56.0 *** -1.00
EEE 30.3 46.7 *** -.92 55.3 *** -1.50
SCE 64.0 64.9 -.05 68.7 -.26
Linfield (ADP)
NSSE 2011(McM) – SFI Seniors
Worked with faculty members on activities other than coursework
Discussed ideas from your readings or classes
Talked about career plans
Discussed grades or assignments
Received prompt written or oral feedback
0% 20%
40%
60%
80%
100%
Never Sometimes Often/Very Often
NSSE 2011(McM) – SFI First Years
Worked with faculty members on activities other than coursework
Discussed ideas from your readings or classes
Talked about career plans
Discussed grades or assignments
Received prompt written or oral feedback
0% 20%
40%
60%
80%
100%
Never Sometimes Often/Very Often
NSSE 2011(McM) –SFI Research Project
First Years
Seniors
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Undecided/Do not plan Plan to doDone
NSSE 2011(McM)
First Years
First Years - Carnegie A&S
Seniors
Seniors - Carnegie A&S
0% 20% 40% 60% 80% 100%
Never Sometimes Often/Very Often
Had serious conversations with students who are very different from you in terms of their religious beliefs, political opinions, or personal values?
NSSE 2011(McM)
Had serious conversations with students of a different race or ethnicity than your own?
First Years
First Years - Carnegie A&S
Seniors
Seniors - Carnegie A&S
0% 20% 40% 60% 80% 100%
Never Sometimes Often/Very Often
High Impact Practices
NSSE 2011(McM)
Serv
ice
Lear
ning
Inte
rnsh
ip/P
ract
.
Lear
ning
Com
mun
ity
Resea
rch
Proj
ect
Stud
y Ab
road
Inde
pend
ent S
tudy
Capst
one
0
20
40
60
80
100% of seniors reporting participation
Seniors Carnegie A&S NSSE11
NSSE 2011(Ptd)
Serv
ice
Lear
ning
Inte
rnsh
ip/P
ract
.
Lear
ning
Com
mun
ity
Resea
rch
Proj
ect
Stud
y Ab
road
Inde
pend
ent S
tudy
Capst
one
0
20
40
60
80
100
% of seniors reporting participationSeniors Carnegie A&S+Pf NSSE11
NSSE 2011(ADP)
Serv
ice
Lear
ning
Inte
rnsh
ip/P
ract
.
Lear
ning
Com
mun
ity
Resea
rch
Proj
ect
Stud
y Ab
road
Inde
pend
ent S
tudy
Capst
one
0
20
40
60
80
100% of seniors reporting participationSeniors Carnegie Diverse NSSE11
How Do Students Spend Their Time?
NSSE 2011
Class LinfieldCarnegie Peers
First-Year 54% 53%
Senior McM(98% FT)
49% 52%
Senior Ptd(100% FT)
30% 47%
Senior ADP(81% PT)
34% 41%
What percentage of students spent more than 15 hours per week preparing for class?
NSSE 2011
Class LinfieldCarnegie Peers
First-Year 42% 35%
Senior McM(98% FT)
74% 52%
Senior Ptd(100% FT)
44% 48%
Senior ADP(81% PT)
0% 28%
What percentage of students worked for pay ON campus?
NSSE 2011
Class LinfieldCarnegie Peers
First-Year 15% 15%
Senior McM(98% FT)
32% 29%
Senior Ptd(100% FT)
62% 40%
Senior ADP(81% PT)
81% (69% 30+ hours) 58%
What percentage of students worked for pay OFF campus?
NSSE 2011
Class LinfieldCarnegie Peers
First-Year 54% 46%
Senior McM
51% 49%
Senior Ptd 20% 38%
What percentage of students spent more than 5 hours per week participating in co-curricular activities?
Coming this spring to Linfield: FSSE (Faculty Survey of Student Engagement – “fessie”)
Course Emphasis
FACULTY report very much or quite a bit of emphasis on memorizing
STUDENTS report very much or quite a bit of emphasis on memorizing
30% / 23%
Lower Division
Upper Division
67% / 60%
1st yr. Students
Seniors
Prompt Feedback
FACULTY gave prompt feedback often or very often
STUDENTS received prompt feedback often or very often
88% / 90%
Lower Division
Upper Division
53% / 63%
1st yr. Students
Seniors
Questions & Discussion