Learning Outcomes & Learner Achievements Management in Higher Ed
Jad NajjarInstitut for Information Systems and New
Media
2010-12-14Tallinn, Estonia
Outcome-based education
• Bologna Process: focus on learning outcomes (student centered view)
• Learning outcomes state what a learner
• knows, understands (knowledge), and
• is able to do (skills, competences)
after completing a learning process.
Learning outcomes
Teaching methods
Workload (ECTS)
Assessment techniques
Focus•Define and manage Learning
Outcome Definitions - ICOPER LOD specification
•Describe and share Personal Achieved Learning Outcomes - ICOPER PALO specification
Learning outcomes: Examples
Students are able to …
… explain the greenhouse effect
… enumerate the most influential politicians of the 20th century
… design an interactive website that complies with Web Accessibility Guidelines
… filter out relevant literature for a given research problem.
… guide their team mates in improving the architectural model of a system.
… moderate a virtual task-force meeting
Knowledge
Skills
Competence
Example: nursing competencies
Competency No. Capability Subject Matter Content Attitude C00 Use Ethical principles Values C10 Apply Ethical issues Actively C11 Demonstrate Client confidentiality Respectfully C12 Identify Ethical Issues Sensitively C20 Use Professional regulation Actively C21 Evaluate Professional regulation Considerately C22 Identify Limitation in own practice Values C23 Recognize Need for referral Willingly C24 Recall Professional regulations Willingly
From Sitthisak, Gilbert, & Davis (2007)
Pilot applications
Learning outcomes
Teaching methods & Learning designs
Assessment
Learning opportunite
sLearning content
OpenGLM
author42Learn@WU
LernXact
dotLRN
IMC Clix
MoodleELGG
Repo
sitory
(OIC
S)
Domain Analysis
Learning Opportunities
Required profile (LODs)
Learning Content Assessment Resource
Needs Analysis &goal setting
Gap Analysis
Start
Learn
er
Planning Learning
Studiescompleted
Learning Activities
Assessment Activities
PD
Goal setting
Goal setAnalyze profile
Diagnostic Assessment
Gap Analysis
Learning needsestablished
Get Result
PALO
Start
Professional Development Scenario Example of a Learner Driven Scenario
Exter
nal A
ctors
Profile and Personal
Data Management
Edu
catio
nal
Inst
itutio
n A
dmin
istra
tion
Planning And
ManagementEvaluationStrategic
Analysis Administration
Strategy and Goal Setting
Stakeholder Analysis
Gap Analysis
Time and Budget
Planning
Rights Management
LOD / PALO Managment
Planning
Learning Outcome Definition
Data ad-ministration
Course Administration
Learner data management
Context Analysis
Evaluation planning
Learning Needs
Analysis
HE Institutional View - Learning Needs
Learning Outcome Definitions (LOD) Schema
• An application profile of IEEE Reusable Competency Definitions (IEEE RCD)
• Describes the characteristics of a learning outcomes
• Enable storage, referencing, sharing Learning outcomes data• Identifier• Title • Description• Type
• An extension to IEEE RCD• Takes values {skill, knowledge, competence}
“explain the greenhouse effect”
Learning Outcome Definition (LOD)
http://oics-dev.km.co.at/LOD/
Learning Outcome Definition Sources
• Open Learn (OUUK)• All course have defined learning outcomes• Stored in IEEE LOM metadata classification category• IEEE/ACM Computer Science Curricula (Task Force)• All course descriptions have learning outcomes• Pdf file• Used worldwide by many universities• 21st Century Engineer (NSF project)• 36 generic learning outcomes• Engineering domain• .ppt file• European Computer Science Driving License (ECDL)• Full list of learning outcomes per topic• Excel sheets
LODs and Learning Design
Find Outcome-based Learning Design
http://develix.iml.umu.se/moodle/
Personal Achieved Learning Outcomes (PALO) profile
This is just a test XML ATOM example
ATOM binding
http://oics-dev.km.co.at/icoper-user-service/users/2720436/palo.atom
Contributed and part of CEN InLOC proposal
PALO – Instance Example
Exporting achieved LODs and Recommendation
Sharing PALO Data
Learning Opportunities
http://oics-dev.km.co.at/MLO/
• Course Catalogs transformed into MLO• 1000’s instances of MLO• Liked to LODs
Lessons learned• Adopt standards and put them in real practice
• Extend when needed• Make recommendations
• Advise new specification when there is really no specification that fits your purpose
• Make more learning outcomes available• Publish Learning Opportunities• Compare what is in job profiles and what is in
learner achieved learning outcomes profile