the second year at emory program: assessing a … · phd or master’s, pre-mba • please mark any...

43
THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A RESIDENTIAL SECOND-YEAR INITIATIVE Ben Perlman John Lynch Brett Page Emory University 15 th National Students in Transition Conference 2008

Upload: others

Post on 05-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A RESIDENTIAL SECOND-YEAR INITIATIVE

Ben PerlmanJohn LynchBrett Page

Emory University

15th National Students in Transition Conference 2008

Page 2: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

GOALS FOR PRESENTATION

Explain the basics of building a living-learning community for second-year students

Understand the history of Emory’s program

Learn about different ways to assess your new initiative

Identify implications for student affairs practice

Page 3: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SNAPSHOT OF EMORY UNIVERSITY

Private, selective, research university w/an undergraduate population <6,000

2-year live-on requirement Undergrad students admitted to

liberal arts college Some students pursue education

in business or nursing school after 2nd year of college

Many of our students are interested in pre-health or pre-professional majors and programs

Page 4: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

THE SECOND YEAR AT EMORY PROGRAM

Living-Learning Community dedicated to second-year student success

4th year of program Programs

Career Planning Academic Advising Faculty Interaction Life Skills Traditions

Page 5: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SYE TIMELINE @EMORY

• Nov 2002: support and approval of the Campus Life Committee of the Board of Trustees

• Nov 2003: SYE Committee formed• Fall 2004: began pilot program in

predominately sophomore hall• Summer 2005: extensive renovation of

Woodruff, home to the program• Fall 2005: official start of the program• Fall 2007: Incorporation of second residence

hall• Fall 2008: Expansion to all of second-year

housing

Page 6: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SOPHOMORE STUDENT DEVELOPMENT MODEL

Staged model in which second-year students move through 4 different stages: Random Exploration Focused Exploration Tentative Choices Commitment

Student focus on these stages in three areas: Peer relationships Self Academic choices

Schaller (2005)

Page 7: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SCHALLER (2005)

Friendships Self Academics

Stage 1Random

Exploration

Accepts friendships as they come, may be very unhealthy

Wanders through life choices, not sure of

what to believe

Has not yet considered

academic/major choice

Stage 2Focus

Exploration

Is disenchanted with friendships,

frustrated with options

Recognizes problems within self,

bothered but not clear what to do

Looking for major or career idea that might fit with self

Stage 3Tentative Choices

Decides to keep some relationships and leave others

Begins to make statements about beliefs, desires, describes self

Found major or career, but still not

clear how it will “work out”

Stage 4Commitment

Makes healthy choices, “college

buddies”

Firm in description of self, knows what

wants

Sees how future will unfold, committed to

career

Page 8: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SCHALLER (2006)

Implications for Community Colleges Financial Issues

Use of credit/loans Loss of first-year aid

Developmental Education Not directed enough in educational choices to

make a choice of major Transfer Preparation

Page 9: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

EMORY NEEDED TO PURSUE SYE

Gap between wealth of services for first-year students and absence of services for upperclassmen

Concerns about students transferring and satisfaction issues

New second-year living requirement

Page 10: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

STAFFING

2 Buildings Woodruff Hall Clifton Tower

Area Director Full-Time Post-master’s degree Live-in

Graduate Student Hall Director Part-time Live-in

Hall Director Fellow Full-time Post-bach Live-in

Academic Advisor Part-time Graduate student Live-in

Page 11: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

STUDENT STAFFING

1 Senior Resident Advisor (Senior) 17 Resident Advisors (Juniors and

Seniors)

26 to 1 - Resident to RA Ratio

Page 12: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SEMI-SUITE STYLE

APARTMENT STYLE

Page 13: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •
Page 14: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

WOODRUFF SPACES

Grilling Area

Study Rooms

RA Office

Grilling Area

Study Rooms

RA Office

Smart ClassroomsSmart Classrooms

Exercise RoomExercise Room

Page 15: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

WOODRUFF SPACES

Drop-In Spaces

Professional Staff Offices

Drop-In Spaces

Professional Staff Offices

Academic Advising OfficeAcademic Advising Office

Dining FacilitiesDining Facilities

Page 16: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •
Page 17: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

ASSESSMENTS WE’VE DONE

Page 18: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

ASSESSMENTS

• National instruments:– Educational Benchmarking Incorporated (EBI)– National Study of Living Learning Programs

(NSLLP)• Local instruments:

– Sophomore specific survey– SYE registration form– ResLife Rewards program– Program evaluations

Page 19: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

EBI

Measures resident satisfaction and perceptions of learning experiences and climate

Distributed online 3,000 undergraduate residents

sampled 25% response rate EBI provides an in-depth statistical

analysis accessible online and in paper format

Page 20: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM EBI

Sophomores in SYE residence halls were much more satisfied than sophomores not in SYE residence halls

Sophomores in SYE residence halls reported higher perceptions of learning than sophomores in other SYE residence halls

Students, in general, reported higher satisfaction and learning when they reported going to programs “often”

Page 21: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

NSLLP

• Relatively new national instrument• Uses the I-E-O model of assessment• Measures input variables, environmental factors,

and learning outcomes• Distributed online• Compares students in living-learning programs

to students not in living-learning programs• 17% response rate• NSLLP provides a statistical analysis accessible

in paper format

Page 22: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM NSLLP

Significantly higher than other LLP participants in terms of: Influences on signing up for program:

wanted to live in a specific residence hall Perceived growth in cognitive complexity Perceived confidence in college success Confidence in problem-solving ability

Page 23: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SOPHOMORE SURVEY

Asked about learning, perceptions, and feedback

Locally developed questions based on anecdotal feedback

Distributed online Sent to all sophomores 30% response rate

Page 24: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM SOPHOMORE SURVEY Second-Year students want more support from

Residence Life Where students live as a second-year greatly

impacts their perception of and participation in SYE.

Programming for and interactions with second-year students must be different from those with first-year students

Second-Year students want a stronger cohort identity/community

Page 25: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM SOPHOMORE SURVEY More programming on…

Page 26: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SYE REGISTRATION

• Locally developed• Originally used as an “application” into the

SYE program• Online• All rising sophomores were required to

complete the form if they wanted to live in the SYE designated buildings: Woodruff and Clifton

• 85% participation

Page 27: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SYE REGISTRATION

• Name, student ID #• Please mark if you are interested in any business or

graduate school programs: Pre-BBA, Pre-Health, Pre-Law, PhD or Master’s, Pre-MBA

• Please mark any majors you are currently pursuing or are interested in: (60 majors listed)

• Please mark the topics you would be interested in learning about at future SYE programs: Choosing a major, Health and Wellness, Career decision-making/Internships, Academic advising, etc.

• How would you contribute to or participate in the Second Year at Emory program?

Page 28: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM SYE REGISTRATION Interest in professional or graduate

programs

Page 29: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM SYE REGISTRATION Top five majors:

1. Business Administration2. Economics3. Psychology4. Biology5. Chemistry

Page 30: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

HIGHLIGHTS FROM SYE REGISTRATION Top five programming interests:

1. Study Abroad2. Career Decisions & Internships3. Community Service4. Planning for Junior & Senior Year5. Choosing a Major

Page 31: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

ADAPTATIONS OF SYE REGISTRATION

Require all rising sophomores to complete form as part of their housing sign-up process

Make some questions more specific Ask about extracurricular involvement Use the form as a tool to get students

to think about their sophomore year and future plans

Page 32: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

RES LIFE REWARDS

• Stemmed from our finding that more engaged students generally were more satisfied and reported higher levels of learning

• Attendance at events is carefully tracked• For every six programs a student attends he/she receives

a reward– Water bottle, hydro-clock, t-shirts, journals, etc.

• Analyze what types of programs students are interested in• Analyze demographics and residence hall location

associated with high attendance at programs• Eventually we will analyze differences associated with high

engagement versus low engagement

Page 33: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

PROGRAM EVALUATIONS

Distribute online Normal satisfaction questions (how did

you like this program?) Learning outcome related questions

Page 34: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

USING THE DATA

Page 35: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SHARING AND INTERPRETATION

Share data with RA’s and Hall Directors for programming and Coke Conversations

Share aggregate data with other offices (particularly the Career Center, Business School, and Academic Advising) to assist them in their own planning

Ask students and RA’s to interpret the data

Page 36: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

IDENTIFIED A NEED FOR CHANGE

Sophomores felt left out of SYE programs

Students did not have a clear sense of the purpose of SYE

Students wanted more support and programming

Residents felt disconnected from their student staff (Coke Conversations felt awkward)

Page 37: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

DEVELOPED PLAN FOR SYE

• Form partnerships with more campus offices• Offer programs and services that all sophomore

residents can utilize• Offer programs and services that support student

development so that the students:– Develop greater self awareness – Define goals for their Emory experience– Utilize campus resources – Connect with others through meaningful relationships

• Use assessment to plan and evaluate programs and show what learning occurs as a result of participation in SYE programs

Page 38: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SYE LEARNING OUTCOMES

• Developing Self-Awareness Demonstrated self reflection skills Identify personal strengths

• Setting Goals Articulating their goals Choosing a major Think about possible career fields

Page 39: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

SYE LEARNING OUTCOMES

• Finding Resources Identify required classes for their major Creating and maintaining a resume Identify co-curricular and extracurricular interests Identify university resources

• Connecting With Others Displaying social skills necessary to live and work Forming meaningful relationships with students,

staff, faculty, and alumni Feel stronger ties to the university

Page 40: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

ASSESSMENT PARADIGM SHIFT

Old assessment model: Compare students in SYE to students not in

SYE (“experimental group” vs. “control group”)

New assessment model: Use involvement in SYE programs

Page 41: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

FUTURE ASSESSMENTS

Research project: long term outcomes of the SYE program

Development of a pre- and post- test survey instrument for sophomores

Connecting assessment with 1st year program and upperclassmen experience to do a longitudinal analysis

Page 42: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

DISCUSSION GROUPS

Page 43: THE SECOND YEAR AT EMORY PROGRAM: ASSESSING A … · PhD or Master’s, Pre-MBA • Please mark any majors you are currently pursuing or are interested in: (60 majors listed) •

CONTACT INFO

Ben Perlman [email protected]

John Lynch [email protected]

Brett Page [email protected]