assessing the efficacy of third-party moocs in hybrid instruction (166255620)

7/29/2019 Assessing the Efficacy of Third-Party MOOCs in Hybrid Instruction (166255620)

http://slidepdf.com/reader/full/assessing-the-efficacy-of-third-party-moocs-in-hybrid-instruction-166255620 1/12

ASSESSING THE EFFICACY OF

MOOCS IN HYBRID INSTRUCTION

Rebecca Griffiths

Program Director for Online Learning, Ithaka S+R



• At least comparable student outcomesas face-to-face

• Potential to reduce costs

However…

• Need for more high quality, interactivelearning materials and platforms

• Need for much more evidence of whatworks

Some useful references:

• Interactive Learning Online at Public Universities: Evidence

from Randomized Trials and Barriers to Adoption of Online

Learning Systems in U.S. Higher Education, Ithaka S+R,

2012.

• Online and Hybrid Course Enrollment and Performance in

Washington State Community and Technical Colleges,

Community College Research Center, 2011.

• Evaluation of Evidence-Based Practices in Online

Learning: A Meta-Analysis and Review of Online Learning

Studies by the Department of Education, 2010.

STUDIES SUGGEST

POTENTIAL

BENEFITS OFHYBRID FORMATS



• High quality content

• Interactive formats

• Feedback loops forcontinualimprovement

However, many

questions remain…

COULD MOOCS

BE USED FOR

HYBRIDCOURSES?



• Close collaborationwith Coursera and theOpen LearningInitiative

• Support from GatesFoundation

COLLABORATIVEEFFORT TO

EXPLORE HOW

MOOCS CAN BEUSED IN HYBRID

FORMATS



• Can MOOCs be used to improvestudent outcomes?

• What models of adoption arethere? What are the potentialbenefits and challenges of each?

• What implementation challengesarise, and how can these beovercome?

• What can we learn about costsavings?

RESEARCH

QUESTIONS



SUMMARY OF RESEARCH DESIGN

5-7 Controlled Tests

• Large enrollment gateway courses

• Side-by-side comparison of hybridsection(s) using MOOC with face-to-face

section(s)• Control for selection bias and student

background

• Empirical analysis of outcomes

Case Studies

• Lower enrollment courses (<50students)

• More experimental implementations

• Document implementation processand experience

• Qualitative assessment of outcomes

Cost Analysis

• Analysis of start‐up and recurring costs to offer hybrid course using MOOC



CONTROLLED TESTS

Registration and recruitment• Students register for course• Students recruited to participate in study in first meeting

Collect data to control for selection bias/student background

• Student survey

• Student background data from Registrar

Baseline measures (beginning of semester)• Pre-test to be administered in some subjects (Pre-Calculus, not Intro to Sociology)

Outcome measures (end of semester)• Completion rate• Pass rate• Score on common final exams• Score pre-test (second administration of test)• Student satisfaction survey



UNDERSTANDING COSTS

Instruction Technology Administration Facilities

One‐

time Track

faculty

time Track

interactions& support time Track interactions

& support time

Recurring Interviews with

faculty

Projected license

fees

Pilots

Interviews with IT

staff to

understand

difference from

norm

Interviews with

admin staff to

learn different

from norm

Room hours

Size of room



• Introduction to Sociology from Princetonat Frostburg State University andCommunity College Baltimore County

• Pre-Calculus from University of California Irvine at Towson University

• Introduction to Philosophy fromUniversity of Edinburgh in a summeronline course at Frostburg StateUniversity

• Ancient Greeks from Wesleyan in aLearning Community at University of

Baltimore

EXAMPLES OF

TEST CASES



General reactions from faculty

• Mix, reorder, cut, add

• Enhance online courses• What about personal

interaction?

• What about global community?

Implementation challenges

• Alignment with existing courses

• Time for planning

• Overlapping technology

WHAT HAVE WE

OBSERVED SO

FAR?



What won’t this study tell us?

What will / might this study tellus?



TIMELINE – WORK IN PROGRESS

•Pilot of Statistics atUMCP

Spring 2013 Summer 2013 Fall 2013 Winter 2013/14

• Pilot of Pre‐Calculus

at Towson University

• Developmental Math

at Bowie State

University*• Intro to Philosophy

at Frostburg State*

• Pre‐Calculus at

Towson

• Intro to Sociology at

FSU and CCPC

• Genetics at UMES*

• Art History at UMES*

• Train Your Brain at

FSU*

• Biology at Towson*

• Human

Communications at

Bowie State*

• More…

• Final report

*Still being confirmed

assessing the efficacy of third-party moocs in hybrid instruction (166255620)

Documents