rm results e-assessment presentation eatp 2015- an integrated e-assessment solution

RM Resul ts and BTLAn Integrated e-Assessment Solut ion

Steve Harrington: RM Results

Innovations in assessment

Innovation:- the action of introducing something new- the act of starting something for the first time- the act of making a change or new arrangement, a new idea or method

05/01/2023 4

Innovation and Partnership.

05/01/2023 5

▪ A little bit about RM & BTL▪ Some trends in assessment▪ An integrated RM / BTL solution▪ Solving some of the assessment challenges

of today (and perhaps tomorrow?)

The next 45 minutes…

05/01/2023 6

Steve Harrington Strategic Account Manager

Ian Castledine Solution Architect

Some Introductions

Dave Dixon Senior Solutions Architect

Tim Burnett Head of Marketing

05/01/2023 7

05/01/2023 8

“The use of technology to manage, deliver and mark

assessments.”

Defining e-Assessment

05/01/2023 9

.

Trends in e-AssessmentRemote

team working

Data drivenitem

banking

Largescale

scanning

Alertsand

updates

Rich media

content

Multi method delivery

Work-flow

controls

Responsive question display

Advanced question

types

Script based

marking

Onscreenhuman

marking

Itembased

marking

Secure exam

distribution

Secure onscreen delivery

Roles basedaccess

05/01/2023 10

The existing options

• Expensive• Time consuming• Heavy on maintenance

Build your own system

• It will never be a perfect fitBuy a ‘one size fits

all’ solution or service

• Heavy on maintenance• Complex to maintain and use

License or buy components and integrate yourself

The Existing Options

Build your own system

• It will never be a perfect fitBuy a ‘one size fits

all’ solution or service

• Heavy on maintenance• Complex to maintain and use

License or buy components and integrate yourself

05/01/2023 11

What’s the risk?

“You’ll get what you want today, but you’ll be stuck with it tomorrow.”

The Challenge

.

Delivering an Integrated Assessment Platform

Discrete systems, integrated with the Awarding Body

+ Best of breed components+ Automated transfer of candidate data

- Awarding Body responsible for data integration (e.g. translation between different data formats)

E-Testing E-Marking

Awarding Body

.

Delivering an Integrated Assessment platform

Integrated Assessment system

Best of breed componentsAutomated transfer of candidate dataProviders responsible for data integrationAwarding Body interfaces with a single systemFlexible approach, enabling other systems to be integrated later

E-Testing

E-Marking

Awarding Body

Integration Engine

05/01/2023 14

.

▪ User experience of an integrated solution

Authoring and delivery of on-screen testing

On-screen marking

RM Assessor is RM Results’ flagship product: used in 2015 to e-mark 160+ million exam pages in 100+ countries.

It is used to mark paper, CBT and coursework for high stakes exams.

05/01/2023 16

.

RM Assessor e-Marking Tool

RM Assessor Marking Tool

Consistent, high quality marking

Continuous monitoring

Team Management

Management of re-marking

Marker training and support

Management reporting

Integrated Assessment Solution

05/01/2023 18

Examinations, Test Schedule

Mark schemesMeta-dataPaper based image zonesStatus info

Computer based testsAnswer keys

ExamCentresCandidates Marks

New CandidatesStatus

MarksExposure

Test ResponsesAuto-marksImages

ExaminationsCentres, CandidatesMarkers

Examinations, Marks, Awards

Item performance

Status info

MarksAwarding boundarie

sStatus info

Marks

Delivery Systems

Authoring System

Awarding Body Systems

Results Analysis

Marking System

(RM Assessor)

Awarding Body

Systems

05/01/2023 19

.Awarding Body Systems

Digital Assessment Integration Engine

Data handling Scheduling Security

ResultsAnalysis

Candidate Registration

Examiner Recruitment

BTL SurpassTest Authoring

BTL Surpass Test Delivery

RM Assessor Marking

Awarding Body Systems

Digital Assessment Integration Engine

Data handling Scheduling Security

05/01/2023 20

.

Delivering an Integrated Assessment Platform

▪ Enables operational best practices▪ Single source of data▪ Secure managed data

transfer▪ Automated data

transformation and business processes

▪ Innovations in Assessment▪ Facilitates joining up of

discrete systems from different vendors

▪ Provides single customer interface to multiple vendor systems

• Enables translation between different data structures

E-Testing E-Marking

Awarding Body

Integration Engine

05/01/2023 21

.

SummaryHow is this innovative?▪ Introducing a new way of leading suppliers working

together▪ Connecting two systems on a technical and

business level for the first time▪ Doing this without significant change to existing

tools and interfaces, all the benefits, no negative impact

05/01/2023 22

Thank you

▪ Steve Harrington sharrington@rm.com▪ Ian Castledine icastledine@rm.com▪ Tim Burnett Tim.Burnett@btl.com▪ Dave Dixon Dave.Dixon@btl.com

@BTLGroup @RM_Results