geometry friends game ai competition
DESCRIPTION
TRANSCRIPT
Geometry Friends Game AI Compe33on
Rui Prada Ins3tuto Superior Técnico, Universidade de Lisboa
INESC-‐ID SPCV
Área de Jogos doInstituto Superior Técnico
A Bit of History
• The Geometry Friends game was developed in 2008 – As a result of a master thesis – In the context of a game design course
• Goal: to create a collabora5ve gameplay experience – Study collabora3ve gameplay paPerns in games – Study collabora3on theories in psychology
http://gaips.inesc-id.pt/geometryfriends
Research Vision
• Engage Humans and Agents in Collabora5on
• Use the game as a test-‐bed – AI Framework
http://gaips.inesc-id.pt/geometryfriends
The Game
• 2 Players
Roll Slide Jump Shape ShiT
• In a 2D environment with simulated physics – Gravity and fric3on
http://gaips.inesc-id.pt/geometryfriends
The Game • Collect diamonds in the least amount of 5me
• PlaUorms – Black, Yellow and Green – Same colour does provoke collisions
http://gaips.inesc-id.pt/geometryfriends
Geometry Friends Video
http://gaips.inesc-id.pt/geometryfriends
Challenges for the AI in GF
• Solve plaUorm skill based puzzles • Deal with collabora5on at different levels – Problem solving – Coordinated mo3on
• Deal with actua3on in a dynamic world • Deal with humans – Communica3on – Believability
The Game AI Compe33on: 2013
• 3 Tracks – Coopera3on (main track)
• No human player
– Single player • Rectangle • Circle
• Each track includes 10 levels – 5 public and 5 private
http://gaips.inesc-id.pt/geometryfriends
Levels: Coopera3on Track
Private Levels
http://gaips.inesc-id.pt/geometryfriends
Levels: Rectangle Track
Private Levels
http://gaips.inesc-id.pt/geometryfriends
Levels: Circle Track
Private Levels
http://gaips.inesc-id.pt/geometryfriends
Scoring
• Get score for each diamond collected • Bonus for solving the level • Bonus for the 5me remaining – Each level has a 3me limit
• Bonus and score by diamond collected depends on the level difficulty
• Final score is the average of 10 runs
http://gaips.inesc-id.pt/geometryfriends
Submissions
• Coopera3on track: 1 submission – CIBot: Sejong University, South Korea
• Square track: 1 submission – CIBot: Sejong University, South Korea
• Circle track: 1 submission – CIBot: Sejong University, South Korea
http://gaips.inesc-id.pt/geometryfriends
Results
• Tests run on – Intel Core2 Quad CPU Q9300 @ 2.50 Ghz – 4 GB RAM – Windows 7 (64-‐Bit)
http://gaips.inesc-id.pt/geometryfriends
Results: Coopera3on Track Level Runs Completed Diamonds Time (Limit) – sec. Score
1 (E) 10 3 (3) 33.1 (90) 735
2 (M) 9 2.8 (3) 33.3 (90) 1407
3 (H) 10 2 (2) 16.3 (35) 739
4 (H) 10 5 (5) 59.1 (110) 1713
5 (M) 7 3.4 (4) 67.1 (100) 1179
6 (M) 0 0 (3) 55 (55) 0
7 (M) 0 0 (2) 80 (80) 0
8 (H) 0 1 (4) 125 (125) 480
9 (H) 0 0 (1) 30 (30) 0
10 (M) 0 0 (2) 35 (35) 0
TOTAL SCORE 6253
http://gaips.inesc-id.pt/geometryfriends
Results: RectangleTrack Level Runs Completed Diamonds Time (Limit) – sec. Score
1 (M) 10 2 (2) 11.4 (40) 686
2 (M) 10 2 (2) 8.9 (25) 411
3 (H) 8 2.6 (3) 35.7 (80) 1705
4 (E) 7 1.4 (2) 12.4 (20) 108
5 (H) 7 4.4 (5) 51.4 (90) 1636
6 (M) 0 2 (3) 60 (60) 400
7 (M) 0 1.8 (3) 35 (35) 198
8 (H) 0 0.2 (3) 65 (65) 64
9 (M) 0 0 (2) 60 (60) 0
10 (H) 0 1.3 (4) 85 (85) 533
TOTAL SCORE 5741
http://gaips.inesc-id.pt/geometryfriends
Results: Circle Track Level Runs Completed Diamonds Time (Limit) – sec. Score
1 (E) 10 2 (2) 11.2 (20) 144
2 (M) 10 3 (3) 19.7 (45) 703
3 (H) 10 3 (3) 16.8 (60) 1518
4 (M) 0 1 (4) 80 (80) 200
5 (M) 0 1 (2) 70 (70) 350
6 (M) 10 2 (2) 10 (35) 549
7 (H) 10 3 (3) 22.5 (60) 1469
8 (M) 0 0 (3) 100 (100) 0
9 (H) 0 3 (4) 135 (135) 1530
10 (M) 10 2 (2) 19.1 (35) 521
TOTAL SCORE 6984
http://gaips.inesc-id.pt/geometryfriends
The Winner is…
http://gaips.inesc-id.pt/geometryfriends
The Winner is…
CIBot
http://gaips.inesc-id.pt/geometryfriends
AI Performance
http://gaips.inesc-id.pt/geometryfriends
What was achieved
Coopera3on: Level 2
http://gaips.inesc-id.pt/geometryfriends
Coopera3on: Level 3
http://gaips.inesc-id.pt/geometryfriends
Circle: Level 3
http://gaips.inesc-id.pt/geometryfriends
Rectangle: Level 3
http://gaips.inesc-id.pt/geometryfriends
AI Performance
http://gaips.inesc-id.pt/geometryfriends
S3ll some open issues
Coopera3on: Level 6
http://gaips.inesc-id.pt/geometryfriends
Coopera3on: Level 7
http://gaips.inesc-id.pt/geometryfriends
Coopera3on: Level 8
http://gaips.inesc-id.pt/geometryfriends
Coopera3on: Level 9
http://gaips.inesc-id.pt/geometryfriends
Rectangle: Level 7
http://gaips.inesc-id.pt/geometryfriends
Rectangle: Level 6
http://gaips.inesc-id.pt/geometryfriends
Circle: Level 4
http://gaips.inesc-id.pt/geometryfriends
Conclusions
• Geometry Friends as interes3ng test-‐bed for – Coopera3ve AI – Human-‐agent interac3on
• Results – Same good results in all tracks – General over-‐filng to the public levels – Many open challenges
• Review the scoring system – Difficulty of levels
http://gaips.inesc-id.pt/geometryfriends
Next Year
• Open the Human Agent Track – Limited communica3on – Believability – Good experience
• Should not take the fun out of the Human – E.g. solve the puzzle immediately
• New Level Genera3on Track – Generate levels for 2 players
http://gaips.inesc-id.pt/geometryfriends
Thank you
Looking forward for your submissions
http://gaips.inesc-id.pt/geometryfriends