luxembourg january 28 th 2013 european commission information society and media 2nd review meeting...

LuxembourgJanuary 28th 2013

European Commission Information Society and

Media

2nd Review Meeting

GaLAGame and Learning Alliance

The European Network of Excellence on Serious Games

Work package 6:Integration into Educational Processes

Work package leader UWS

Professor Thomas M Connolly (UWS), Dr Liz Boyle (UWS) Dr Thomas Hainey (UWS), Dr Pablo Moreno Ger (UCM), Dr Jeffrey Earp (CNR), Dr Michela Ott (CNR), Dr. Dr Michael Kickmeier-Rust (TUG), Dr Francesco Bellotti

(UniGe)



Media

2nd Review Meeting

Aims and tasks of WP6

Aim: to examine how serious games (SGs) and serious virtual worlds (SVWs) can be integrated into formal educational systems

T6.1 User and education stakeholder requirements (UWS)

T6.2 Metrics for SG in education (UniGraz)

T6.3 Integration methodologies (CNR-ITD)

T6.4 Community of teachers and tutors (TU DELFT)



Media

2nd Review Meeting

Tasks, task leaders, partners and person months for WP6

• T6.1 User and education stakeholder requirements

(Task leader: UWS, Thomas Connolly (7))

INESC-ID, Joao Pereira (7) 14

• T6.2 Metrics for SG in education

(Task leader: TUG, Michael Kickmeier (5))

UNI-GRAZ, Elisabeth Friedrich (7)

UNIGE, Francesco Bellotti (4) 16

• T6.3 Integration methodologies

(Task leader: CNR-ITD, Rosa Bottino, Michela Ott (6))

UCM, Pablo Moreno-Ger (8)

UNIGE, Francesco Bellotti (1) 15

• T6.4 Community of teachers and tutors

(Task leader: TU DELFT, Igor Mayer (3))

UU, Remco Veltkamp (3) 10

HWU, Theo Lim (4)

Total 55



Media

2nd Review Meeting

T6.1: Year 1 User and education stakeholder requirements

Online longitudinal surveys:• Scottish HE students (2005, 2007, 2009 and 2011) • HE and FE students in Scotland • HE students in the Netherlands• Secondary school pupils in Greece• Primary school teachers in Scotland

Publications

• Hainey, T. H., Connolly, T. M., Stansfield, M., and Boyle, E. A. (2011). The Differences in Motivations of Online Game Players and Offline Game Players: A Combined Analysis of Three Studies at Higher Education Level. Computers & Education, 57, 2197-2211.

• Razak, A.A., Connolly, T.M. and Hainey, T. (2012). Teachers’ Views on the Approach of Digital Games-Based Learning within the Curriculum for Excellence, International Journal of Game-Based Learning, Vol. 2, Issue 1, pp. 33-51

• Hainey, T., Westera, W., Baxter, G.J., Connolly, T.M., Boyle, E.A. Students’ attitudes toward playing games and using games in education: Comparing Scotland and the Netherlands. Computers and Education (submitted)



Media

2nd Review Meeting5

Year 2 activities for WP6.1 and WP6.2: Change from surveys to meta-analyses

For year 2 the reviewers recommended that we change our approach in WP6.1 from surveys to a meta-analysis as “survey research is a weak methodology”.

“A serious and formal meta-analysis associated with learning outcomes associated with serious games would be highly regarded by the global SG community”

The literature review and meta-analyses of learning outcomes are being carried out under 6.1 and 6.2.



Media

2nd Review Meeting6

Meta-analysis: Results to date

Systematic literature reviews of learning outcomes of games (empirical papers) using UWS online database

1. 2004-2009: age 14+ (7,392 papers: 129: 70)

Connolly, T. C., Boyle, E. A., Hainey, T. McArthur, E. & Boyle, J. M. (2012). A Systematic Literature Review of Empirical Evidence on Computer Games and Serious Games. Computers & Education, 59, 661 – 686.

Boyle, E. A., Connolly, T. M., Hainey, T. & Boyle, J. M. (2012). Engagement in digital entertainment games: a systematic review. Computers in Human Behavior, 28, 771–780.

2. 2004-2013: children: (approx 18,500: 72: 36 papers)

To be submitted April-May 2013.

3. 2009-2013: 14+ still to be carried out

Quantitative meta-analysis of learning outcomes of games



Media

2nd Review Meeting7

Additional systematic reviews of games

Systematic Literature Review of assessment in games

Hainey, T., Connolly, T. M., Baxter, G. J., Boyle, L., Beeby, R. (2012). Assessment Integration in Games-based Learning. 6th European Conference on Games-based Learning (ECGBL), 4-5 October 2012, Cork, Ireland.

A review of neurophysiological methods for monitoring brain activity in serious games and virtual environments

Ninaus, M., Kober, S. E., Friedrich, E., Dunwell, I., de Freitas, S., Arnab, S., Ott, M., Kraycik, M., Lim, T., Louchart, S., Bellotti, F., Hannemann, A., Thin, A. G., Berta, R., Wood, G and Neuper (2012). Evaluating neurophysiological methods for monitoring brain activity in serious games and virtual environments. A review. (Submitted)



Media

2nd Review Meeting8

T6.3: Integration methodologies: Year 2 Activities

Methodologies for integration of SGs in education context: guidelines, best practices, examples, assessment criteria, integration tools, evaluation.

1. Review of literature on integration of games in learning (including implementation experiences as well as empirical studies of outcomes)

2. Survey of GALA partners’ experiences: 2 approaches



Media

2nd Review Meeting9

T6.3: Integration methodologies: Year 2 Activities cont

Online survey: 6 experience reports from 4 partners– Discipline: 2 business, 1 cultural heritage, 1 history, 1 water

management, 1 domain-independent– Kind of game: 2 “adventure“ games, 2 “management” games,

1 role-play, 1 simulation, 1 “collaborative scripting game”

Structured interviews: 35 implementation experiences of Gala partners (Lisbon 2012)

– Discipline: 11 business/commerce/management; 6 mathematics

– Level: 19 university; 9 primary school; 6 adult education; 1 secondary school

– Deployment settings: 11 classroom; 10 computer lab



Media

2nd Review Meeting10

T6.3: Year 3 activities

• CNR and UCM will select a representative set of 10 case studies from GALA partners’ reported experiences and implementation experiences (PLAYING HISTORY- THE PLAGUE; CHERMUG) and from the literature reviews.

• They will:– Develop a common framework for structuring the selected cases– analyse the case studies with a view to definition of best

practices and integration guidelines– Develop a set of supporting tools and technologies to facilitate

the integration of games into the classroom– investigate educators’ conception, design and representation of

SG based interventions



Media


T6.3: Integration methodologies: Year 2 Activities cont

Experimental study

“Stimulating entrepreneurship through serious games in higher education” (eSG) - 21st century and higher-order thinking skills; Erasmus FEXI (Fostering Excellence in Higher Education)

UniGe coordinator; TU Delft, ESADE, CNR



Media


WP6.3: Possible games/projects

Primary School• CNR: mind games• Harri’s game – edu-elements – mathematics and

chemistry – Harri Katemo• The Code of Everand – Ian Dunwell, Coventry Uni, road

safety game • Kristian Kiili’s brain training cell phones • Consolarium in Scotland: Brain training: reasoning

skills; Nintendogs: maths, resource management and communication skills



Media


WP6.3: Possible games/projects

Secondary• UCM: game to teach Resuscitation procedures 12-14

years; 334 students real world knowledge; paper to be published in English in Emergencies

• Me Tycoon (Kam) – extra-curricular• Consolarium in Scotland: Guitar hero: in transfer from

primary to secondary• UWS: - STARTUP



Media


T6.3: Possible games/projects:Tertiary

• UWS: Requirements collection and analysis game for IT students; paper published

• UCM: games for medical students, operating theatre, labwork• ESADE: eFinance game teaching finance concepts to business

students• ESADE: Metavals – teaching statistics to students• BIBA: Risk management and supply chain management for

Masters students in engineering• AAU: investment game for business success• UNIGE Francesco – exploring entrepreneurship; Games for digital

electronics /computer programming• UWS/UCM/PLAYGEN/OUNL: CHERMUG – reviewers

recommended that we “measure learning impact and outcomes” and “report the finds as part of this WP”



Media


Collaboration activities

• “Stimulating entrepreneurship through serious games in higher education” (eSG)

UniGe coordinator; TU Delft, ESADE, CNR• “Continuing Higher Education In Research Methods Using

Games” (CHERMUG): a game for teaching Research Methods and Statistics; EU lifelong Learning Grant

UWS coordinator; UCM, OUNL, PLAYGEN• Edited Book - Psychology, Pedagogy and Assessment in

Serious Games, IGI

UWS and UCM editors

Contributions by OUNL, ESADE, TU Delft, CYNTELIX, INESC, ORT, RWTH AACHEN, UNIGRAZ, BIBA, UNOTT



Media

2nd Review Meeting

T6.4: Community of teachers and tutors (TU DELFT)

The community will emerge to some extent from GALA members and their research and development contacts especially via research participants, conferences, SG academy, SG Society, stakeholders, outreach advisory board

Need to strengthen links to existing communities and networks in the education sector, e. g. those linked to existing LLP projects ( e. g. SEGAN) and those initiated by EUN (European Schoolnet)



Media

2nd Review Meeting

Future work for WP6

• Complete the systematic literature reviews & quantitative meta-analysis

• 10 case studies of integration of games into education; guidelines for effective use

• Publication of edited book on Psychology, Pedagogy and Assessment in Serious Games

• Establish community of teachers and tutors



Media


Conference Papers

1. Hainey, T., Connolly, T. M., Baxter, G. J., Boyle, L., Beeby, R. (2012). Assessment Integration in Games-based Learning. 6th European Conference on Games-based Learning (ECGBL), 4-5 October 2012, Cork, Ireland.

2. Razak, A. A., Connolly, T. M., Baxter, G. J., Hainey, T., Wilson, A. (2012). The Use of Games-based Learning at Primary Education Level within the Curriculum for Excellence: A Combined Result of Two Regional Teacher Surveys. 6th European Conference on Games-based Learning (ECGBL), 4-5 October 2012, Cork, Ireland.

3. Wilson, A., Hainey, T., Connolly, T. M. (2012). Evaluation of Computer Games Developed by Primary School Children to Gauge Understanding of Programming Concepts. 6th European Conference on Games-based Learning (ECGBL), 4-5 October 2012, Cork, Ireland.

4. Scullion, J., Hainey, T., Stansfield, M. H., Connolly, T. M. (2012). A Pilot Implementation of an Immersive Online 3D Environment for Collaboration Among Computing Students in a Scottish University. 6th European Conference on Games-based Learning (ECGBL), 4-5 October 2012, Cork, Ireland.

5. Razak, A.A., Connolly, T.M. and Hainey, T. (2011). “The Implementation of DGBL Approach in Primary Schools across Renfrewshire”, Games and Creativity in Education and Training (GACET’11), 17-18 November 2011, Rome, Italy.

6. Hainey, T., Connolly, T.M., Boyle, E.A. and Stansfield, M.H. (2011). “Motivations for Playing Computer Games in Relation to Gender: A Comparative Analysis of Three Studies at Higher Education”. 5th European Conference on Games-based Learning (ECGBL), 20-21 October 2011, Athens, Greece.

7. Razak, A.A., Connolly, T.M. and Hainey, T. (2011). “Games-Based Learning Application within the Curriculum For Excellence: From the Teacher’s Perspective”. 5th European Conference on Games-based Learning (ECGBL), 20-21 October 2011, Athens, Greece.

8. Hainey, T., Connolly, T.M., Boyle, E.A. and Stansfield, M.H. (2011). “Motivations for Playing Computer Games at Tertiary Education Level: A Comparison of Further Education and Higher Education Computing Students”. 5th European Conference on Games-based Learning (ECGBL), 20-21 October 2011, Athens, Greece.

9. Wilson, A., Connolly, T.M. and Hainey, T. (2011). “Evaluation of Introducing Programming to Younger School Children Using a Computer Game Construction Application”. 5th European Conference on Games-based Learning (ECGBL), 20-21 October 2011, Athens, Greece.

10. Scullion, J., Stansfield, M.H. and Connolly, T.M. (2011). “A Survey of Students’ Improved Mastery of Game Playing Skills Through Informal Online Game-Based Learning”, 5th European Conference on Games-based Learning (ECGBL), 20-21 October 2011, Athens, Greece.

luxembourg january 28 th 2013 european commission information society and media 2nd review meeting...

Documents