a national problem: across the nation, over 40% of students entering college are unprepared for...

48

Upload: cameron-moody

Post on 27-Dec-2015

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 2: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 3: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

A National Problem:

• Across the nation, over 40% of students entering college are unprepared for college-level mathematics coursework.

• 10.9% of students place into remedial math, and 43% fail to successfully complete the course at first try.

• Over 30% of students place into pre-college-level intermediate algebra; 38% don’t pass.

(National Data taken from Principal Indicators of Student Academic Histories in Postsecondary Education, U.S. Dept. of Education, March 2004.)

Page 4: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

The Local Problem:

• 10% of students entering UW-Stout in Fall 2004 placed into beginning algebra (Math 010). Over the four most recent years using the traditional lecture approach, the non-pass rate has averaged 29.0%.

• 35% of students placed into intermediate algebra (Math 110). Over the four years prior to Fall 2004, the non-pass rate has also averaged 29.2%.

Page 5: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Potential Impact on Retention:• National and local studies show the single

strongest predictor of retention from first to second year of college is taking and passing a math class in the first year.

• In each of the past three years, nearly 45% of ~1600 first-year UW-Stout students placed into Math 010 or 110.

• Non-pass rates near 30% therefore put more than 200 students at high risk of dropping out each year based on this risk factor alone.

Page 6: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Why are students failing math classes taught using the

traditional teaching approach?

• Not doing homework

• Not attending class

• Not using instructors’ office hours

• Not using available tutoring services

Page 7: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 8: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

The New Approach:

Since Fall 2004, for all sections of Math 010/110:

• Homework is graded daily by computer and counts towards course grade.• Daily lectures complement online work, attendance is taken and earns credit points.• Instructors hold office hours in classroom.• Tutor lab next to classroom is geared specifically to these two classes.

Page 9: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Basics of the New Approach:

1. Daily computer-graded homework• Counts toward the course grade (~25%)

• MyMathLab software provides online help for each problem, any time, anywhere

• Immediate feedback; each problem can be repeated until student gets it right

• Gives instructor daily information on students’ progress

Page 10: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Basics of the New Approach:

2. Regular class sessions

• Dedicated classroom for Math 010/110

• Attendance counts towards grade (~5-10%)

• In-class lecture complements online work

• “Live” homework help available in class every day

• Quizzes/tests must be taken in the classroom

• Motivated, well-prepared students can work ahead, even finish course early

Page 11: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 12: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Basics of the New Approach:

3. Open tutor lab for one-on-one help• Located right next to regular classroom

• Specifically targeted to Math 010/110

• Staffed 50 hours/week:

• Each Math TLC instructor holds a portion of weekly office hours in the open lab

• Specially trained undergraduate student tutors provide peer-to-peer assistance

Page 13: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 14: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

3-Year Cumulative Results:

• Median time spent: 95 minutes per day• Assignment completion:

95.2% in 110, 96.4% in 010• Average homework score:

93.8% in 110, 96.5% in 010• Number of homework assignments:

110: 35-38 per semester, plus 11 practice

quizzes/tests010: 20 per semester, plus 7 practice

quizzes/tests

Homework

Page 15: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Quiz and Test Results:

• Math 010:– Quiz Average: 77.1% (5 quizzes)– Test Average: 72.4% (midterm, final)

• Math 110:– Quiz Average: 71.4% (7 quizzes)– Test Average: 70.0% (4 exams + final)

Page 16: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Attendance Results:

At lectures: 88.3% for Math 110

88.5% for Math 010

At tutor lab: Weekly visits averaged 150-200 out of total enrollment of ~350.

Total visits per semester average ~2800, vs. 80 visits all semester to the campus Tutoring Center for these two courses under the traditional teaching approach in Fall 2003.

Page 17: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 18: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results to Date – Math 010:55% drop in F/W rate

for 4 years with Math TLC vs. previous 4 years without( 528 total students took Math 010 in the Math TLC in the last 8 semesters)

Percent of F/W grades: Math 010

Math TLC: Fall 2004 - Sp 08PreMTLC: Fall 2000 - Sp 04

13.1

29.0

0

10

20

30

PreMTLC MTLC

% o

f F

ail/

Wit

hd

raw

gra

de

s

Math 010 (Beginning Algebra): Percent F/W grades(Math TLC program began Fall 2004)

0

10

20

30

2000

/01

2001

/02

2002

/03

2003

/04

2004

/05

2005

/06

2006

/07

2007

/08

Pe

rce

nt

of

en

roll

ed

stu

de

nts

re

ce

ivin

g F

or

W g

rad

es

Page 19: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results to Date – Math 110:40% drop in F/W rate

for 4 years with Math TLC vs. previous 4 years without(1802 total students took Math 110 in the Math TLC in the last 8 semesters)

Percent of F/W grades: Math 110

Math TLC: Fall 2004 - Sp 08 PreMTLC: Fall 2000 - Sp 04

29.0

17.5

0

10

20

30

PreMTLC MTLC

% o

f F

ail/

Wit

hd

raw

gra

de

s

Math 110 (intermediate Algebra): Percent F/W grades

(Math TLC program began Fall 2004)

0

10

20

30

40

2000

/01

2001

/02

2002

/03

2003

/04

2004

/05

2005

/06

2006

/07

2007

/08P

erc

en

t o

f e

nro

lled

stu

de

nts

re

ce

ivin

g F

or

W g

rad

es

Page 20: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Estimated effect on student numbers over the past four years:

• Math 110: – 1802 enrolled students– 316 actual F/W (17.5%) vs. predicted 523 (29%)

– Net estimated effect: 207 more students passed

• Math 010: – 528 enrolled students– 69 actual F/W (13.1%), vs. predicted 153 (29%)

– Net estimated effect: 84 more students passed

Page 21: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

• Combined estimated effect of the Math TLC program over the past 4 years:

291 more students passed than predicted vs. the pre-Math TLC F/W rate.

• This number translates to 3.5% of the entire Stout undergraduate student population over those four years, many of whom would likely have dropped out if they hadn’t passed these math classes.

Page 22: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

The Big Question:How are these Math TLC students

doing in their subsequent math courses compared to those taught

previously using the traditional approach?

Page 23: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

• More students are passing Math 110 since the start of the Math TLC. (The cumulative F/W rate since Fall 04 is 17.5%, vs. 29% in the four years prior to the Math TLC.)

• This has occurred despite the institution of tougher standards. (Passing now requires a "C" grade; homework is assigned and graded every day, and quizzes and tests are more frequent and more rigorous than in most pre-Math TLC sections of Math 110.)

• Although more students are passing, grade inflation in Math 110 has not occurred. (The average GPA for Math 110 in the two year pre-Math TLC was 2.79, average for first two years of Math TLC was 2.40.)

Results for Intermediate Algebra:

Page 24: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results for Intermediate Algebra (ct’d):

• Although more students are passing Math 110, there has been no reduction in the proportion of Math 110 students who go on to take a Level 2 math class in the subsequent semester. – 51% are going on to take Math 120 [College Math 1] the next

semester, vs. 50% pre-Math TLC; 14% are going on to take Math 123 [Finite Math], vs. 16% pre-Math TLC.

– Consequently, a higher number of students are now able to choose STEM or business majors requiring math beyond Level 1.

• Even though many more students are now passing Math 110, the average grade of Math TLC-Math 110 students who go on to take Math 120 next has actually increased slightly. – The average subsequent Math 120 grade for first-year students who

took Math 110 in Fall 2002 or 2003 (pre-Math TLC) was 2.24 1.09 (SD, n = 51) vs. 2.38 0.97 (SD, n = 160) for first year students who took Math 110 in the Fall of 2004 or 2005.

Page 25: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results for Intermediate Algebra (ct’d):

• Some students who take Math 110 do opt to take Math 118 (Concepts of Math, a Level 1 course) as their subsequent math class, due to a change of major and/or a lack of success in Math 110. For these students:– The grade in the subsequent Math 118 course has been much

higher since the Math TLC (2.73 vs. 2.38 pre-Math TLC)

– This occurred even though Math 110 students opting for Math 118 are coming out of Math 110 with lower average grades than before the Math TLC (Math 110 average grade = 1.67 post vs. 2.48 pre.)

• Of those Math 110 students who go on to take Math 123 (Finite Math) in the following semester:– The subsequent course grade is similar for Math TLC students (2.80

0.83 [SD, n = 43]) vs. pre-Math TLC ( 2.91 0.61 [SD, n = 16] ).

– The Math 123 grades earned by Math TLC Math 110 students are much more highly correlated with their Math 110 grade (R = 0.47, p = 0.0019) than for the pre-math TLC students (R = 0.02, p = 0.94).

Page 26: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results for Intermediate Algebra (ct’d):

• Of those who failed Math 110 under the Math TLC program and went on to repeat it the next semester, 75% passed the course on the second try.

• Also, those who fail Math 110 now are much more likely to take the course again.

– 20 failed students repeated the course the next semester in the first two years of the Math TLC program, vs. only one such student in the two years pre-Math TLC.

– This indicates that many of those who fail under the new system are still experiencing enough success to want to try the course again right away, and to pass it on the second attempt.

Page 27: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

More students are passing Math 010 since the start of the Math TLC.

The cumulative F/W rate since Fall 04 is 13%, vs. 29% in the four years prior to the Math TLC.

Results for Beginning Algebra:

Average ACT scores of first year UW-Stout Math 010 students

17.0

8

17.5

7

16.7

6

16.7

5

16.20

16.40

16.60

16.80

17.00

17.20

17.40

17.60

17.80

Fall 2002 Fall 2003 Fall 2004 Fall 2005

Ave

rag

e M

ath

AC

T S

core

This has occurred despite a decline in the math skills of these students coming in to the course, as measured by Math ACT scores.

Page 28: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results for Beginning Algebra (ct’d):

• Although more students are passing, grade inflation in Math 010 has not occurred. (The average GPA for Math 010 pre-Math TLC was 3.08, average for first two years of Math TLC was 2.83.)

• Although retention data has not yet been completely analyzed, a recent report from the UW-Stout Budget, Planning and Analysis office noted that the fall-to-spring retention of the Fall 2007 cohort of first-year students who took Math 010 was 93.6%, exceeding the retention rate for all incoming first-year students.

Page 29: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Results for Beginning Algebra (ct’d):

• The average subsequent course grade for Math 010 students who go on to take Math 110 the following semester dropped by similar amounts for Math TLC students (average drop = 0.90 grade point) compared to pre-Math TLC (average drop of 0.85.)

• The average subsequent course grade for Math 010 students who go on to take Math 118 the following semester was somewhat lower for Math TLC students (average Math 118 grade = 2.49 compared to 2.88 pre-Math TLC , but the grades in the subsequent Math 118 course were much more highly correlated with the Math 010 grade for Math TLC students (R = 0.34, p = 0.027) than for the pre-Math TLC students (R = 0.03, p = 0.93).

Page 30: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Student Survey Comments:

– I REALLY like the way this class operates thus far, and let it be known that I can’t even remember “not minding” a math class since Jr. high school!

– I want to fulfill my math requirements at Stout before I transfer because the computer was such an invaluable tool.

– I thought doing math homework on a computer would be pretty difficult, but as it turns out…It’s really not. I even somewhat enjoy it!

Page 31: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

More Student Comments: – This class completely changed my views on

math. Before this class I hated math and never wanted to do it. I hated math even in grade school! After this course I LOVE math and am considering a math minor. I’m even thinking of being a tutor in the Math TLC next year. I would never have imagined ME teaching and helping others with math.

– I just really appreciate all your help. Thank you for making me come to class every day.

– I learned more in this one course than I learned in all my math classes in high school.

Page 32: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Student Comments on the Software:

– I loved Course Compass homework.– Very good, you got to see what we did wrong.– Was the best helpful tool ever.– Figuring it out on my own really helped me to understand

it. Using the “Show Example” and “Help Solve” features were nice to have.

– Course Compass is sweet.– The online videos and examples helped.– I loved the online homework and tests/quizzes. I believe

that helped me a lot!– Very, very helpful, you could look to see how to do the

problem if you just couldn’t figure it out.– It was very helpful, with step by step instructions and

online book.– Don’t get rid of it!

Page 33: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Please rate each of the following items on how much it helped you personally to learn the material in this course:

Item: 0 =

Not at all 1 =

A little bit 2 =

A fair amount 3 =

Quite a bit 4 =

Very much

Class Lectures

Homework Assignments

Open Lab sessions

Textbook

On-line help (tutorials, examples, videos, etc.)

My teacher

The student TA’s

Page 34: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Degree to which each item helped my learning

0.000.501.001.502.002.503.003.50

Page 35: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Minority Student Results:

Percent of students with F/W grades in Math 010,

2003-2004 vs. 2004-2005

0

10

20

30

40

50

60

70

pre MTLC MTLC

Per

cen

t F

/W g

rad

es

minorities

non-minority

Gap between %F/W rate for non-minority vs. minority students in Math 010,

2003-2004 vs. 2004-2005

0

5

10

15

20

25

30

35

40

45

pre MTLC MTLC

No

nm

ino

rity

F/W

% m

inu

s m

ino

rity

F/W

%

in

Ma

th 0

10

Page 36: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

The Math Lab Rap Songby Marvin Ealy, aka: EknolegeGraduate of Math 010 and110

On YouTube: http://www.youtube.com/watch?v=_VcE2RvG87Q

Streaming video on UW Stout Math TLC web site: http://www.uwstout.edu/lts/multimedia/streams/foleyj/mathlab.wvx

Page 37: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

"I Will Derive" from MindofMatthew; posted to YouTube 5/8/2008Link: http://www.youtube.com/watch?v=P9dpTTpjymE

Page 38: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

The Math Lab Rap Song by Marvin Ealy, aka: EknolegeGraduate of Math 010 and110

Page 39: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Impact on Non-Traditional Students:

– Non-traditional students comprised over half of the 3rd quarter Math 010 class in Spring 2005.

– Time since last math class ranged from 4 to 35 years for this group (average 13 years).

– Combined F/W rate: 4% (1 out of 23)

Page 40: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Impact on Non-Traditional Students:• Quote: Two years ago my life forever changed

having enrolled as a full-time student at UW-Stout. As a non-traditional student out of high school for 20 years, anxiety ensued thinking about completing the algebra credits needed for my program. Given my history, I believe that I am predisposed to and suffered from 'Algebra Anxiety Syndrome'. Learning algebra has been the biggest challenge of my college career thus far. Aside from the psychological road blocks; I had to start at ground zero with my algebraic inadequacies. As a student and former permanent fixture in the Math TLC Lab, I have been absolutely blessed... The Math TLC Lab is an invaluable asset to our university for people like me thanks to the caring and dedicated staff.

Page 41: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

New Developments:

• Incorporated MyMathLab software into some sections of six additional courses:

• College Math 1 & 2• Concepts of Math• Finite Math• Calculus 1• Elementary Statistics

• Developed new targeted tutoring program for College Math 1 .

Page 42: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Grant Funding• We are currently in the second year of a 3-year FIPSE

grant from the U.S. Department of Education to study the impact of the Math TLC approach on subsequent course performance and retention and to offer workshops like this one for other institutions.

• We just received word that the UW System has funded our proposal for a two-year project to adapt portions of the Math TLC program for a new initiative to reduce the achievement gap between minority and non-minority students.

• Previous funding includes small grants from the Stout Foundation and the NSF-funded Wisconsin Alliance for Minority Participation.

Page 43: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Program Costs:A. Startup (first year)

• Program Development• Summer salaries for training/course redesign work

• Program Director/Administrator • At least 1/4 time, preferably half time for first year, especially if grant-

writing is involved

• Facilities (mostly a startup cost)

• Classroom: Dedicated classroom makes a big difference, especially if equipped with computer access

• Tutor lab: Key feature is convenience of location, near classroom and teacher’s offices

• Software/Textbooks (for institutions where this cost is not borne by students)

• Student Tutors

(Our first year total was ~ $60,000, mostly via special allocation from the Chancellor’s office)

Page 44: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Program Costs:

B. Ongoing Costs (subsequent years)

• Program Director/Administrator – Minimum ¼ released time during academic year– Summer salary for course revision and evaluation

• Student Tutors/TAs• Software Access Codes

– NOTE: No new code needed for• Subsequent course with same book • Repeating a course with same book

• Miscellaneous – printing, spare calculators, bulletin board, frames, etc.

Page 45: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Program Savings: Immediate savings from decreased failure rates: Using the pre-Math TLC rates, the projected number of drops and withdrawals

for Fundamentals of Algebra for Fall 2006 would have been 19 students and for Intermediate Algebra 83 students. The actual number of drops and withdrawals were 4 and 40 respectively, a decrease of 15 students in Fundamentals and 43 in Intermediate Algebra.

• FTE Savings: – Based on these numbers the University saved 0.5 teaching position for

the Fall, 2006 semester. The corresponding salary savings were approximately $8,750 plus $3894 in benefits, for a total of $12,644.

• Software Savings:– The department saved approximately $2000 in its service and supply

budget by not having to purchase access codes to the software used for these courses.

• Tuition Savings– Students also benefitted from the higher pass rates. Since current

tuition is $232.11 per credit, the tuition saved by students during the Fall, 2006 semester was $6,963.30 for Fundamentals of Algebra, a two credit course, and $39,922.92 for Intermediate Algebra, a four credit course.

Estimated combined annual savings for 2006-07: $120,000

Page 46: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Program Savings:Other Potential Savings and Benefits:

• Higher Retention Rates: – Saves tuition dollars– Reduces costs for student recruitment

• Program Reputation:– Can serve as a marketing tool for student recruitment,

especially in underserved populations, both by official university channels and by word of mouth from satisfied students.

– Long-term potential for attracting corporate and alumni financial sponsorship

• Basis for Grant Funding:– Proven results from pilot studies make good case for

future funding

Page 47: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students
Page 48: A National Problem: Across the nation, over 40% of students entering college are unprepared for college- level mathematics coursework. 10.9% of students

Coming up Next:• 10:45 - 11:15:

Session 1B:

Software Registration and Course Creation

• 11:15 - 12:15:

Session 1C: Syllabus Development

• 12:15 - 1:30:

Lunch at Ted’s Pizza

(Courtesy of Pearson Education/ MyMathLab)