evaluation and usability - acpet e mentor session

• ACPET e Mentor Program

• Online Session 4

• Wednesday August 17th 2011

High as a kite on expresso

High as a kite on expresso

Having Bex &

good lie down

Having Bex &

good lie down

Calm & ready to rip

Calm & ready to rip

Smiling while multi tasking

Smiling while multi tasking

Fogged InFogged In

Use the text tool to record your current mood state

Use the text tool to record your current mood state

Welcome• Learner

Evaluation• Useability

Testing• Showcase

update• Converge

Where are we?Quick snap shot of where you are with

your project?• Planning• Developing• Snags• Issues – Design, Multimedia,

Software etc

POLL!!!

Multimedia

Description

A Video

B Audio

C Images and Diagrams

D Text

E Absolutely no idea

Clarity..or clear & present danger?

A Clear on what we will be developing

B Clear but struggling for ideas

C Worried about the chosen tools

D Having second thoughts about topic

E Absolutely no idea

Tell us more if you chose the following

C Worried about the chosen tools

D Having second thoughts about topic

E Absolutely no idea

Invite your

cronies!!

Invite your

cronies!!

Visit FocusAMI ECG

Chifley WYN

Career Life

Delivery PhaseReports!!Reports!!

• Deliver to learners• Survey of learners• Evaluation/usability• Showcase• Converge

Lead up activitiesLead up activities

How will you stay in touch with your learners?Induction

& SupportInduction & Support

Checklist

Why Evaluate Training?

Take the mic and tell us!

Take the mic and tell us!

Why Evaluate• Gather information about your resource and how it is

used by learners• Understand the ability of your facilitators to connect

with and assist learners to work together and learn• Make decisions about improving the resource and

approach to facilitation• Share experiences with colleagues to promote best

practice and commitment to continuous improvement• Gathering data to make decisions about whether

learners are learning and improving performance

Evaluation collection? • Online Survey Software– Surveymonkey (web based)– Lime Survey (open source)– Google forms

• Learner Management Systems• Moodle – Questionnaire/Feedback module

Survey Monkey

Moodle• Survey• Feedback• Questionnaire

Evaluation questions –• What information should we capture from

learners in any evaluation process we work through?

• Take a minute or two and addyour ideas to the whiteboard

Evaluation questions –

Delivery reflections for Internal use• Review of your experience delivering

elearning. • Consider your processes– how best to provide

this information• What extras will elearning

require?• Continuous improvement• Admin implication• Staff capacity building

Final Report

Usability Testing

• Help determine how end users may use the online program site

• Identify any potential flaws or issues which hinder end users from using the online program site

• Identify recommendations for improving the online program site

• Is a different process from evaluating the quality/context/appropriateness of the learning material/activities

Useability Testing questions –• What information should we capture from our

testers?• Who are the right people inside (outside?) your

organisation to test your online materials?

• Take a minute or two and addyour ideas to the whiteboard

Useability Testing

questions

Useability Testing

questions

Useability Testing

questions

Useability Testing

questions

Useability Testing

questions

Continuous Improvement

• Progress with learners• Unexpected issues, difficulties in the online

environment• Alterations, adaptations or enhancements

Re-evaluation and adaption of delivery plan• Any additional support or help you require

to enhance the delivery to your learners• Insights and examples of learner feedback• Implications of your experience with this

delivery trial for e learning at your organisation

• Any other issues of relevance

Showcase Update

5 Slides• What attracted you to the

programme?• Have flexible delivery

options helped you to achieve your goal

• Demonstrate one thing you are proud of

• Lessons Learnt• Implications for your

deliveries in 2012

Converge

State elearning conferencewww.eworks.edu.au/converge/

• Next session Wednesday 14 September• 10am – 4pm @ ACPET

Resource Development

Thank you for playing