olc quality scorecard review: performance measurement for online programs (288878990)

Online Learning Consortium ● onlinelearningconsortium.orgOnline Learning Consortium ● onlinelearningconsortium.org

OLC Quality Scorecard Review: Performance Measurement for Online Programs


PresentersMatt NorsworthyMembership Services RepresentativeOnline Learning Consortium

Debbie FairesDirector of Online LearningSchool of InformationSan Jose State University


Online Learning Is Who We Are

And What We Do.


23 years in research and development of online learning through publications, conferences, research and faculty development…

CON·SOR·TI·UM (kn-sôrt-ēum, -shēum)

AN INDUSTRY LEADER

Over 600 institutional members from 49 states and 14 countries dedicated to quality online education


Established in 1992, we’ve been leading the charge for excellence in online learning for two decades.

Our foundation for successful online learning:OLC’s Five Pillars of Quality Online Education.

QUALITY FRAMEWORK

Click the image to learn more.

http://onlinelearningconsortium.org/about/quality-framework-five-pillars/


Our Foundation:

Learning effectiveness is concerned with ensuring that online students are provided with a high quality education -- meaning that online students’ learning should at least be equivalent to that of traditional students.

Scale is the principle that enables institutions to offer their best educational value to learners and to achieve capacity enrollment – that means a commitment to quality resources for continuous improvement policies for cost-effectiveness measures and practices.

Access provides the means for all qualified, motivated students to complete courses, degrees, or programs in their disciplines of choice. The goal is to provide meaningful and effective access throughout the entire student’s life cycle.

Faculty Satisfaction means that instructors find the online teaching experience personally rewarding and professionally beneficial – including three categories: support, rewards, and institutional study/research.

Student satisfaction reflects the effectiveness of all aspects of the educational experience. The goal is that all students who complete a course express satisfaction with course rigor and fairness, with professor and peer interaction, and with support services.


Leading professional organization devoted to excellence in online learning.

• We offer professional development, instruction, best practice publications and guidance to educators, online learning professionals and organizations around the world

• We provide premium opportunities to network, discover and share views on online learning at conferences and events

• Founded over two decades ago, we continue to be a key factor in the transformation of the e-Education field

The real value…being part of a global community


Quality Scorecard (2010)• Delphi research study (2010) • 6 rounds and 6 months of getting a consensus from

experts• 43 experts in online education administration • 86% had 9 or more years of experience Large and

small public • Large and small private institutions• Community colleges • Large for-profit

• 2014 version: Added/replaced indicators, clarified language, reviewed for consistency


Results: Quality Scorecard Evaluation Instrument • Institutional Support • Technology Support • Course Development & Instructional Design • Course Structure • Teaching & Learning • Social & Student Engagement • Faculty Support • Student Support • Evaluation & Assessment


Guidelines for Scoring • 0 points = Deficient. The administrator does not observe any

indications of the quality standard in place.

• 1 point = Developing. The administrator has found a slight existence of the quality standard but difficult to substantiate. Much improvement is still needed in this area.

• 2 points = Accomplished. The administrator has found there to be moderate use and can substantiate the quality standard. Some improvement is still needed in this area.

• 3 points = Exemplary. The administrator has found that the quality standard is being fully implemented, and there is little to no need for improvement in this area.


Guidelines for Scoring • 75 Indicators…a perfect score = 225 points

• 90-99% = 202 - 225 - Exemplary (little improvement is needed)

• 80-89% = 180 - 201- Acceptable (some improvement is recommended)

• 70-79% = 157 - 179 - Marginal (significant improvement is needed in multiple areas)

• 60-69% = 134 - 156 - Inadequate (many areas of improvement are needed throughout the program)

• 59% and below = 133 and below – Unacceptable


Online Learning Consortium (OLC) Interactive Scorecard• On the OLC website • Must have an institutional

membership • Justification notes • Upload artifacts for support

- Organizational chart - Faculty training materials - Student survey results


Why Deploy the Quality Scorecard?

• Engage entire campus community

• Facilitate cross-departmental communication

• Identify opportunities for continuous improvement efforts

• Validate quality using a research-based tool

• Support accreditation activities

• Focus on quality • Differentiate your

online program from others in the market


WHO IS USING THE OLC QUALITY SCORECARD?• The OLC Quality Scorecard is being utilized by

institutions all over the United States and Latin America.

• It is also being translated and normed into Mandarin for use in China.

• Online education program administrators find that by using the Scorecard for quality evaluation, they are able to develop strategic objectives for program improvement.

• They can also demonstrate to accrediting bodies the breadth of quality in program administration.


OLC Institutional Members currently using the Quality Scorecard include:Adler School of Professional PsychologyCabarrus CollegeClayton State UniversityGeorge Mason UniversityIllinois Institute of TechnologyLSU – Baton RougeNorth Carolina State UniversitySouthern Arkansas UniversityUniversity of Alabama – BirminghamUniversity of Alaska FairbanksUniversity of Maryland University CollegeWest Georgia Technical College

Butler UniversityCalifornia University of PennsylvaniaExcelsior CollegeGolden Gate University-San FranciscoJohns Hopkins UniversityNew York Institute of TechnologySan Jose State UniversityTexas Tech UniversityUniversity of Alaska AnchorageUniversity of Central MissouriUtah State University


Scorecard use at San José StateSchool of Information• Accreditation• Strategic Planning• Program Development


http://ischool.sjsu.edu/about/scorecard/institutional-support/1


Matt NorsworthyOnline Learning

Consortium912-977-0459

[email protected]

Debbie FairesSan Jose State

University408-924-2498

[email protected]

olc quality scorecard review: performance measurement for online programs (288878990)

Documents