Luxembourg Dec.2-3 European Commission Information Society and Media
GaLAGame and Learning Alliance
The European Network of Excellence on Serious Games
GALA WP 8 Support and services
Jannicke Baalsrud Hauge (BIBA)
Riccardo Berta, Francesco Bellotti (UNIGE),
1
Luxembourg Dec.2-3 European Commission Information Society and Media
Activities WP 8
• Serious Games Studies Database (SGS-DB) • Service development of the database and offering tools
via SG• SNA to help the community building • Operation of Living Labs• Development of tools• Transition from GALA to SGS (techn)
2
Luxembourg Dec.2-3 European Commission Information Society and Media
Taks 8.1 – current work-objectives
• offer a service able to easily provide high quality knowledge• Provide access to tools
– Allow an in-depth understanding of SGs through a detailed description of their mechanisms
– Apply existing games into learning and training contexts, considering appropriate pedagogies
– Support design of new games and enhance existing games, identifying their weak points
3
Luxembourg Dec.2-3 European Commission Information Society and Media
SGS-DB
• Currently 78 games• Uses a standard description (GALA Template, WP1)• Easy to use (Backend
http://146.148.31.123/SGRepoBE/)• Allows search
– Filtered– Text
5
Luxembourg Dec.2-3 European Commission Information Society and Media
Usability tests SGS-DB
6
Question Ava. answer
Question Ava. answer
Question Ava. answer
Question Ava. answer
Ease of Use 4.9 Feel comfortable 5.1 Clear
information 4.6 Pleasant Interface 4.4
System simple to use 5.2 System easy to
use 5.3 Information easily found 4.6
Like using the interface of
system4.7
Complete work efficiently 5.3
Became productive
quickly5.1
System information
understandable5.6
Comprises relevant
functionalities and capabilities
5.3
Able to complete work quickly
5.5System gives error & info.
how to fix5.8
Information effect. For task completition
5.3 Overall system satisfaction 5.4
Able to complete work efficiently
5.4 Easily recover after mistakes 5.7
Clear organisation of
information5.1
N=9scale 1 (strongly disagree) to 7 (strongly agree)
Luxembourg Dec.2-3 European Commission Information Society and Media
Tools for different purposes-examples
7
http://journal.seriousgamessociety.org
http://studies.seriousgamessociety.org/
http://www.seriousgamessociety.org/
http://marketplace.seriousgamessociety.org/
Luxembourg Dec.2-3 European Commission Information Society and Media
SG Reusability Point of Reference
• Supports the identification of reusable SG components• Uses a reference-based approach also for non-open source• SGREF manages collections of references to reusable SG assets• Manage a repository with reusable SG assets uploaded by users. • It is a service which is available via the SGS website under
assets, or via www.sgref.net.
• Rich internet application technology
8
Luxembourg Dec.2-3 European Commission Information Society and Media
SGREF Example
• Search functions – full text, – specific reference categories, – tags– user profile.
• Add reference– Step 1: describe ref.– Step 2: Review– Step 3: Share
9
Luxembourg Dec.2-3 European Commission Information Society and Media
Usability tests
• Questionnaire, N=42
10
18-25 Often 26-35 Often 26-35 Sometimes
36-45 Often 36-45 Sometimes
46-55 Sometimes
Soft-ware Ana-lyst
NaN 6 7 NaN 7 NaN
Soft-ware devel-oper
7 10 9.25 10 8.66666666666668
9.33333333333334
Web de-signer
5 7 7 NaN 8 NaN
Web devel-oper
NaN 9 NaN NaN NaN NaN
2.5
12.5
22.5
32.5
Software development experienceFeedback SGREF Updates
Exec. - -
Design - -User Requirements
N= 6 users should be able to save a list with references to submit at a later. A useful reference might be lost because users do not have the time to fill in all the fields in the submission form.
A list of quick reference will be considered in future development.
8 participants have suggested that users should be able to save drafts of the references they are submitting.
An option to safe drafts will be considered in future development.
3 participants have mentioned that tags should be suggested based on the description the user has introduced for the reference.
Tags suggestions will be considered in future development
6 participants have requested that developers consider accessibility issues. Users should have the possibility to increase font size.
Accessibility issues will be addressed.
Luxembourg Dec.2-3 European Commission Information Society and Media
T8.2 Living labs: Coventry
• Ideation space, provides IPR support• Open environment to promote infusion and diffusion of knowledge• 4 Events• Part of Enoll• High involvement of commercial partners• Hub for UK node for Games for health Europe• High number of attendance• Open events with different topics• Will focus more on learning space and ecosystem• Outcome- many ideas, closer collaboration of local stakeholders• Cooperation with association from different application fields• Cooperation with the LL in Bremen
11
Luxembourg Dec.2-3 European Commission Information Society and Media
BIBA
• Focus on SG for logistics and manufacturing• Cover ideation, (development) and testing• Operates with open events, but also with closed groups• Collaborate much with the university, industrials, and SG developers• Outcome
– Various student projects– Closer collaboration between local industry and University– Closer collaboration between local SG developers and Industry– Through the testing, given us relevant evaluation results– Included in development activities– Lead to better collaboration for R&D proposals and industrial project– Best practice exchange among the teachers – Cooperation with the node in Coventry
12
Luxembourg Dec.2-3 European Commission Information Society and Media
Madrid
• Focus on testing games in health sector– Operating room medical personal
• Participants medical staff and developers• 7 events Y4, 5 hospitals, 100+ medical personnel• Outcome
– Improvement of specific knowledge included in the game– New ideas for ways of deliveries– New ideas on how to apply in a medical setting
– Outcome used for improving the tested games
13
Luxembourg Dec.2-3 European Commission Information Society and Media
Paris
• Focus on ideation• Meeting point for many stakeholder
groups• High industry involvement• 3 main events Y4• Core group meeting at Cap Digital
(cluster)• Carry out the larger LL in
connection with other events• LL lead to new collaboration• Developed several ideas• Uses external experts• Will strengthen the cooperation with
clusters in innovation
14
Date of event
October, 2013, Event2
June 17th , 2014, Event3
September 12th, 2014Event 4
number of participants to the workshop 20 50 20academic 10 14 4students 2 8 2sg developers 8 12 3academic 30 0 0students 10 2 2pupils 0 4 4sg developers 10 2 3sg publisher 2authorities 3SG retailers 0SG distributors 2teachers 3consultants 0
Luxembourg Dec.2-3 European Commission Information Society and Media
Genoa
• Focus on primary schools • Learning through gaming• 4 events, 6 classes, 89 pupils• Observation
– Interest among pupils– Pupils familiar with tablets– Teachers very interested, but need training– Support exchange of best practices
15
10
50
100
I think that this SG helps me to learn new English words
a lot fairly so-so a little not at all Overall results; N=122
Could SGs support the English words acquisition?
A lot enough so-so a little not at all
10
5
10
Does this SG have an impact on the pupils' will
to do homework?
A lot enough so-so
a little not at all
Luxembourg Dec.2-3 European Commission Information Society and Media
Network analysis
• Carried out for improving collaboration (coll. WP 1)• 2 studies • Identification of embeddedness
16
Structural embeddedness
Embeddedness in practice
“Organizational” embeddedness
Trust/Freeriders Conflicts / counter-
productive meetings Reciprocity Psychological safety
Network size Network
structure Partner
representatives’ turnover
Lack of Experience
GaLa objective / Common Goal
Personal interests not central
Proposal legacy
Accountability! Transparency
(internal and external)
Luxembourg Dec.2-3 European Commission Information Society and Media
Derived actions
• Improve the transparency• Physical meeting where applicable• More use of minutes• Better integration of partners through dedicated persons• Regularly virtual meetings• Improved usability of ICT infrastructure• Development of different levels• Increase the information flow
• Actions implemented in WP 1
18
Luxembourg Dec.2-3 European Commission Information Society and Media
KPI
19
KPI name and description
Values (achieved Reference value
No. LL products: number of games collaboratively developed
130,35 games collaboratively developed / event
2
No. studies 6 0No. LL products: Project proposal developed 21 0,57 prosposals / event 0,25
Potential project discussed 31 0,81 Project discussion /
event
No. LL products: Tested Games
Tested Games: 27 Participants: 957
Number of testers / game: 35,2
game tested 1,8 per lab/event, 42 user/game
No. LL products: Ideas developed Ideas developed: 55 Average Idea / Event:
1,37
Stakeholders invovlement
Academics: 204;Students incl. PhD: 278; Pupils: 112;SG Developers: 59;SG Publisher: 15; Authorities/Industrials: 66;SG retailers: 3; SG Distributors: 9;Teachers: 88No. Events: 37: Average Participant / Event: 26
Luxembourg Dec.2-3 European Commission Information Society and Media
KPI 2
20
Appropratness of GALA /SGS software and services
DATA: Response time=0.184 sec - Down time=2 days/month - No. Failures=3 each month - DB usage: data received=2.4 MiB per hour; data send=38.1 MiB - DB connections: max concurrent=39, total=702 per hourn - Queries: 10.680 per hour
Response time:<1s; Down time: 5d/month; no failure: 3/month; use of resources, DB transactions- not monitored yet, measuring of utilisation and meas. Of number of transactions will be implemented ; hour spent on development: 1 person full time, hours spent on maintenance: 0,1 full time equi. /month; Number of coding lines and classes :1500/120; no. of serivices:5; For SGREF all 0, since not in operation yet
SGS-DB and SGREF usage
Active Users: SGS=60, SGS DB=20, SGREF=7 Current number of users GALA: 40; KMS:20 SGREF 0
SGS-DB and SGREF usability
3 in the last three months NA
KPI name and description
Values (achieved Reference value
Luxembourg Dec.2-3 European Commission Information Society and Media
What about the future?
• All tools transferred to the SGS• SGS will maintain the SGS system including the SGS-
DB, tools and services• Further development will be in line with SGS work• SG-ref further development with local resources• All 5 LL will continue
– Will support SGS as local hubs offering physical meetings– Continue to evaluate and test games– Continue the ideation and development of R&D proposals – Work on Service and product development (IPR important)– Strengthen collaboration– Increase external collaboration with associations
21
Luxembourg Dec.2-3 European Commission Information Society and Media
LL Future activities
• Discussions on Research Activities:– Both R& D topics and deployment topics, depending on LL
• Stakeholders’ engagement –increase the engagement from other sectors
• Service and product development also through SGS• Exchange of Best Practices• Support potential users through dedicated events• Promote SGS and disseminating actions to different stakeholders• Provide an attractive test environment for different application fields• Collect local result and disseminate through the SGS• Continue collaboration with overseas organisations• Both for awareness raising and development• Fosters active participation
22