development, prototyping, and evaluation gautham ... · prototyping and testing • prototyped in...

11
Science. Security. Strategy. Game-based learning Development, prototyping, and evaluation Gautham Venugopalan, PhD Rutgers-WTP Workshop, March 29, 2017

Upload: others

Post on 14-Oct-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Science. Security. Strategy.

Game-based learning Development, prototyping, and evaluation

Gautham Venugopalan, PhD

Rutgers-WTP Workshop, March 29, 2017

Page 2: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Games with defined learning objectives

NLM ToxMystery Uro-Island

NLM: https://toxmystery.nlm.nih.gov/

Uro-Island: Boeker et al., PLOS ONE, 2013

Page 3: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Game-based vs. conventional learning

Game-Based eLearning

• Experiential learning

• Intrinsic motivation

• Low deployment cost

• Progressively lower barriers to entry

Conventional

• Passive learning

• Faster/cheaper development

• Low barrier to entry

3

Page 4: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Building a game-based learning product

Needs assessment

Curriculum Development

Prototyping and testing

Deployment

Page 5: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Case Study: Training Research Responders in

Emergency Operations

5

Page 6: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Needs Assessment

• Work with all stakeholders to identify training needs • Is there a gap in existing training resources?

• Is a game-based solution a good fit to address the gap?

NIEHS DR2 Responders Researchers

6

Page 7: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Curriculum Development

• Federal, state, and local emergency management practitioners contributed subject-matter expertise

• Deployment scenario based on real-world issues faced by experienced Research Responders

7

Page 8: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Prototyping and Testing

• Prototyped in the OpenSim environment (Video)

• Beta tested by disaster research experts and novices to ensure both curriculum quality and teaching effectiveness (total of 9 testers)

• Revised prototype based on training feedback

• Pre-training, post-training, and 3-month assessments, and qualitative feedback to improve usability

8

Page 9: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Reinforcement Via Continued Engagement

• Just-in-time training

• Online resources

• Spaced Repetition

9

Page 10: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Deployment

• Think about deployment during needs assessment and curriculum development

• User needs inform deployment strategy • Engage trusted and respected partners

• Mobile apps/VR

• Doesn’t have to be electronic!

10

Page 11: Development, prototyping, and evaluation Gautham ... · Prototyping and Testing • Prototyped in the OpenSim environment (Video) • Beta tested by disaster research experts and

Game-Based Learning Summary

• Take chances, get messy, make (harmless) mistakes!

• Engage stakeholders and SMEs early and often

• Consider the needs of the user throughout the design process

• Can be low or high tech Acknowledgements

NIH • NLM • DR2 • WTP • SBIR

SMEs • Emergency

Managers • Researchers • Testers

11