LMS Evaluation CommitteeRubric for Evaluation

Category Weight

Category LMS #1 LMS #2 LMS #3

1 Other FactorsRate this based on the following:

5 – Positive response1 – Negative response

Involved with standards organizations (SCORM)Company listens to customer to change productBranding customization capabilitiesSelf-registration/open entry-open exitCompany has been used in Corporate Training environment

2 CompanyRate this based on the following:

5 – Positive response1 – Negative response

Size of Company/mrkt shareTime serving higher educationNumber of large institutions using their productTechnical support model (fixing software)Time between upgrades to new versionsDuration of version supportTiered technical supportCustomizations completed

3 Optional but desired featuresRate each feature based on the following:

5 –Present, simple and intuitive to use, rich features within the tool3 –Present, requires some thought and effort, has some features2 - Present but does not meet users needs1 – Not present

WhiteboardCustomization of look and feelStudent Collaboration Tools Glossary ToolCompile to Print ToolSurvey ToolIntegration with social mediaIntegration with SPOCAbility to cc to external email

4 CompanyRate this based on the following:

5 – Positive response1 – Negative response

Migration support providedStrategy to provide support for various browser versions

Category Weight

Category Blackboard Canvas D2L

Integration with other products (Turnitin, Equella, Studymate, Respondus, Collaborate, etc.)Response time for support issuesAbility to customize – flexibilityFeedback from customers (other colleges)Current, relevant resources and documentation

4 Migration of CoursesRate each feature based on the following:

5 – Ease of migrating courses1 – Difficulty of migrating courses

Content migrates easilyQuizzes migrate as expected

Assignments are present in the migrated courseMigrated course content is organized similar to the original courseGrade book is organized similar to the original coursePercentage of migrated course content typically requiring attentionAssociated content functions as expected

4 Total Cost of OwnershipRate this based on the following:

5 – Inexpensive1 – Expensive

Initial/get started product licensing costAdd-on or ancillary modules necessaryHardware CostsSoftware CostsSupport CostsTraining CostsAnnual maintenance and support feesConsultant FeesResponsivenessCustomization costs for special programsCost of integration with SISCost of LMS upgrades or additional functionalityMigration Costs incl. possible ECH for instructor efforts

Category Weight

Category Blackboard Canvas D2L

Integration fees for 3rd party products (Turnitin, Equella)

Cost limited ANGEL license for 1 year (if courses cannot be ported easily to the new LMS)

5 Feature SetRate each feature based on the following:

5 –Present, simple and intuitive to use, rich features within the tool3 –Present, requires some thought and effort, has some features2 - Present but does not meet users needs1 – Not present

Email Tool - internalEmail Tool - externalQuizzesVariable quiz question formats- incl. multiple choice, fill-in-theblank, short essay, etc) with ability to add image to question/answer-Feedback can be text as well as correct answer.-Quiz question delivery -one by one, all at once-Quiz access can be password protected-Deliver quiz feedback dependent on submission or specified grade. -Feedback in form of email, message, url, text, etc-Allow partial points to be awarded-Allow quiz to count for a different amount of points in Gradebook than the quiz points do-Accommodate extra creditItem analysis-RegradeItem analysis (whodunnit)Conferencing ToolsSelective release (actions, agents, dates, team override, etc.)

Adaptive (for user actions)

Discussion BoardEase of grading of discussions and direct connection to gradebookGradebook (integration with content)Calendar (no recur in Canvas)File Management Tool

Category Weight

Category Blackboard Canvas D2L

Assignment Drop box, peer reviewDropbox feedback via

notifications Reporting Tools (Student)Reporting Tools (Faculty)Reporting Tools (Admin)Announcements/NoticesURL Tool (no new window in Canvas)Content Module (Canvas easier to use but less robust)Last Page Tool (bookmark)Spell CheckerBuilt-in HTML EditorTransferability of courses between systems (live, development, archive, etc.)Math symbols/equation editorIntegration with SISIntegration with publisher content & e-textsAllows Active Directory authentication/single sign-on508 complianceAbility to share content across courses/instructorsMobile accessAnalyticsePortfolioAttendanceAbility to distinguish which class you’re in

TOTAL WEIGHTED SCOREOverall Rating

Last revised 4/11/13