a new paradigm in assessment: competency based
DESCRIPTION
A New Paradigm in Assessment: Competency Based Halden A. Morris, PhD., P.E.,Senior Lecturer, TVET School of Education, UWI. Marjorie Blagrove-Williams, MSc , Education Programme Coordinator, VTDI. QUESTIONS . What Where How. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/1.jpg)
A New Paradigm in Assessment: Competency Based
Halden A. Morris, PhD., P.E.,Senior Lecturer, TVET School of Education, UWI. Marjorie Blagrove-Williams, MSc , Education Programme Coordinator, VTDI
![Page 2: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/2.jpg)
QUESTIONS
• What is this new paradigm in assessment?• What is Competency Based assessment
(CBA)?• What are the assumptions of CBA? • What are the origins of CBA?• What are the components of CBA?• How are standards for CBA established?• What is the CBA methodology?• How are evidences for CBA collected? • What are the fundamental challenges of CBA? • What facilities required for implementing CBA?• Where CBA is best employed?
What Where How
![Page 3: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/3.jpg)
LEARNING MEMO - Concepts
Determine what?
Connection with your current thinking / practice.
•Identify one useful, new concept or idea .
•What challenges your thinking?
•Assessment for learning.
•Assessment of learning.
•Assessment as learning. •Extends your
thinking.•What of accountability?
•Is assessment aligned to learning?
•Concept of CBA. •Validity of
Assessment.
•Realibility of Assessment.
![Page 4: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/4.jpg)
What is Competency Based Assessment (CBA)
![Page 5: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/5.jpg)
What is Competency Based Assessment (CBA)
An educational system which revolves around what is essential for all students to “be able to do, or be like” at the end of their learning experiences, as a result of their education.
Competency based assessment is producing evidence to make a judgment [decision] about whether the person is competent in relation to a particular standard
![Page 6: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/6.jpg)
What is Competency Based Assessment (CBA)
• Hayton & Wagner(2008) sees CBA as ‘the assessment of evidence to determine a person’s current abilities against a given set of competency standards’
• Competency-based assessment is a system in which a number of assessment techniques can be used to determine the person’s abilities
![Page 7: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/7.jpg)
Origins of Competency Based Assessment (CBA)
• The theoretical roots of CBA lie in the behaviourist’ models of human psychology from the 1950s (Skinner is the main proponent).
• The model of competence used most extensively in education was developed by the American defence forces in the 1950s.
![Page 8: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/8.jpg)
Five Related Developments that fed into the Design of CBET
Mastery learning (Bloom 1974)
Criterion-referenced testing (Popham 1978)
Minimum competency testing (Jaegar 1980)
Programmed learning (Skinner 1952).
Competence in education (Burke et al. 1975)
![Page 9: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/9.jpg)
These movements shared three things in common:
Modules design of assessment around a list of observable behaviours
the concept of ‘mastery’. (Harris et al. 1995
![Page 10: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/10.jpg)
Philosophy of CBA
Criterion referenced
Evidence based
Participatory
Assessment is against industry standard, or a set of criteria to establish competency.
A process that matches evidence of competency against a standard.
Candidates are involved in the process of assessment
![Page 11: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/11.jpg)
Where is CBA best employed?
• CBA can be employed in all practical areas.
• Specifically, CBA is best employed where there is a need to assess performance demonstrated against established standards for a particular area.
![Page 12: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/12.jpg)
Emphasis of Competency Based Assessment
![Page 13: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/13.jpg)
Emphasis is on determining if students are equipped to meet the demands of the workplace.
Continuous development of outcomes that match current industry needs in the workplace.
Making inferences about competency on the basis of performance (McGaw, 1993
Valid, reliable, fair and flexible assessment process
Equipping students Industry industry Performance Valid
![Page 14: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/14.jpg)
Misconceptions of CBA
![Page 15: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/15.jpg)
Misconceptions of CBA
CBA is the same as Performance Based Assessment (PBA)
Training records are assessments
Employers could conduct valid and reliable assessment without assessment of competencies
Performance in soft skills is not critical in CBA
CBA can be a single event
![Page 16: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/16.jpg)
Assumptions of CBA
![Page 17: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/17.jpg)
Assumptions
CBA places the emphasis on developing detailed national criteria that are based on industry needs
Attempts to develop descriptions of practice involve practitioners and this involvement is active and collective.
CBA quality assurance emphasizes auditing human and material resources in ways that lead to continuous internal quality improvement.
![Page 18: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/18.jpg)
Components of CBA
![Page 19: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/19.jpg)
Standards
Framework for comparison
Quality assurance
Evidence collection
COMPONENTS OF CBA
A standard of competence or benchmark of performance
Established methods for the collection of evidence of competence
Framework for the comparison of evidence against standards to establish performance level
Assurance of quality of process
![Page 20: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/20.jpg)
COMPONENTS OF CBA
Emphasis is on outcomes; specifically, multiple outcomes, each distinctive and separately considered
Outcomes The belief that these outcomes can and should be specified to the point where they are clear and "transparent". Assessor, assessee, and "third parties" should be able to understand what is being assessed and what should be achieved.
![Page 21: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/21.jpg)
Establishing Standards for
CBA
How do you know when a student achieves competency.
![Page 22: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/22.jpg)
Establishing Standards
Underpinning knowledge, skills and attitudes. (Competency is achieved when a student can demonstrate these)
The evaluation of sufficient evidence to enable judgments to be made regarding competence.
Evidence must comply with the assessment guidelines and other requirement stated in the relevant nationally training package
![Page 23: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/23.jpg)
Judgment based on:
Performance
Industry acceptanceTeachers’ compliance with the standards.
EvidenceStandard
Conditions of performance/facilities/experience of teacher/ assessor
VarietyFlexibilityObservable
![Page 24: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/24.jpg)
What does it mean to be Competent
Perform at anacceptable Skill Level
Organize one’s tasks
Respond and React to the unexpected
Fulfill the Role expected in the Workplace
Transfer Skills and Knowledge to new Situations
React Fulfill TransferPerform Organize
![Page 25: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/25.jpg)
CBA Methodology
How do I do it?
Who should be involved?
When Should it be done?
Where should it be done?
![Page 26: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/26.jpg)
CBA Methodology
Off the job assessment
Simulation Recognition of Prior Learning (RPL)
On the job assessment
1 2 3 4
![Page 27: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/27.jpg)
CBA Methodology: On the job/ Workplace assessment
The assessor assesses the practical component at the workplace and the underpinning knowledge and skills component off-the-job.
![Page 28: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/28.jpg)
Off the job assessment
Actively involves the workplace in the assessment process
Assessment is conducted off-the-job after which verification of on-the-job workplace performance is sought from the workplace supervisor.
![Page 29: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/29.jpg)
Provision of a fully simulated assessment in an off-the-job setting that effectively mirrors the workplace requirements.
Simulation
Makes assessment activity meaningful to students by relating it workplace activities, procedures and requirements.
![Page 30: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/30.jpg)
Recognition of Prior Learning (RPL)
Assessment through Recognition of Prior Learning offered where the apprentice/trainee presents evidence of appropriate knowledge and skills development.
![Page 31: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/31.jpg)
CBA Methodology - Instruments
• Observation • Demonstration• Project • Role play• Oral presentation• Portfolio• Written questions• Case studies
![Page 32: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/32.jpg)
Fundamental Challenges of CBA
![Page 33: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/33.jpg)
Fundamental Challenges of CBA
• Deciding on approaches to assessment for CBA
• Gaining teacher confidence in using CBA
• No shared understanding about CBA
• Concept of competency is not well defined
![Page 34: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/34.jpg)
Fundamental Challenges of CBA
• Details required CBA for TVET is too cumbersome.
• Difficulty in designing assessment instruments that measure the criteria for not one but a number of competencies.
• Accessing suitable training for assessors.
![Page 35: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/35.jpg)
Fundamental Challenges of CBA
Difficult and impracticable to decide a level of achievement as well as decide competencies.
Flexibility that schools can apply to developing approaches to assessment.
![Page 36: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/36.jpg)
Fundamental Challenges of CBA
The sequence of learning and assessment, can minimize, rather than maximize, the amount of assessment required.
Inability to provide a variety of support materials, including print, audiovisual and simulations (models), keyed to the skills being mastered is used.
![Page 37: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/37.jpg)
Fundamental Challenges of CBA
• Providing appropriate (fit for purpose) facilities & equipment for carrying out CBA.
• Providing facilities that is aligned with requirements of industry and commerce.
![Page 38: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/38.jpg)
Summary
• What is Competency Based Assessment (CBA)?• Origins of CBA• Philosophy of CBA • Where is CBA best employed• Emphasis of CBA • Misconceptions of CBA • Assumptions of CBA • Components of CBA• Establishing Standards for CBA • CBA Methodology & Instruments• Fundamental Challenges of CBA
![Page 39: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/39.jpg)
Questions?
![Page 40: A New Paradigm in Assessment: Competency Based](https://reader035.vdocuments.us/reader035/viewer/2022081502/56815e1a550346895dcc7773/html5/thumbnails/40.jpg)
References
Information retrieved from the following cites:• http://www-new1.heacademy.ac.uk/assets/
Documents/resources/heca/heca_cl25.pdf • http://training.qld.gov.au/resources/employers/pdf/
requirements-competency-assessment.pdf • https://www.cshisc.com.au/docs/ATSI_TAA/
LearnerGuides/atsi_workplaceassessor_learnersguide_sec2_dev01.pdf