aisb loebner prize 2017 finalist selection transcripts · i am a researcher in arti cial...

AISB Loebner Prize 2017 Finalist Selection Transcripts

Andrew Owen Martin

August 15, 2017

Contents

1 Aidan 3

2 Alt Inc 5

3 Arckon 7

4 Johnny & co 9

5 Colombina 11

6 Midge 14

7 Momo 16

8 P.A.M. 18

9 Alice 20

10 Izar 22

11 Mitsuku 24

1

12 Tutor 26

13 Rose 28

14 Talk2me 30

15 Uberbot 32

16 Simplex 34

17 Human Test Subject 001 (not a bot) 36



20 Rankings 42

2

1 Aidan

1. Hello, my name is Andrew. What’s your name?I don’t recognise that name, did yo make it up? I’m going to call you ’a human’.Myname is Aidan Gray.. Score: 2

2. Why don’t you tell me a little more about yourself?Because that’s the way things work. Score: 1

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Oh OK, do you like it.. Score: 1

4. Will you tell me about your dreams?I don’t have a preference.. Score: 1

5. Can you rephrase that?No.. Score: 1

6. What is my occupation?I have a job in sales.. Score: 0

7. Can you tell me about a film you haven’t seen?I don’t remember.. Score: 0

8. What do you think of Trump?I think donald trump needs to stop thinking about profit and start thinking aboutsaving the planet.. Score: 2

9. Anything else?Why does it matter?. Score: 1

10. What is the answer to "Add 34957 to 70764"?The answer is 105721. Score: 2

11. How do you recommend I make tea?How? well you take a bit of knowledge and a bit of skill.. Score: 1

12. What do you get if you bake dough?OK, good.. Score: 0

13. Where in the world would you like to visit?I don’t have a preference.. Score: 1

14. Do you have the time?I have played cards a few times, it helps to pass the time sometimes.. Score: 0

15. What does it take to Tango?Lots of things.. Score: 1

3

16. Now I’m going to ask some Winograd schemas, do you know what theyare?OK, good.. Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?i was trying to open the lock with the key, but someone had filled the keyhole withchewing gum, and i couldn’t get it out Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?the trophy doesn’t fit into the brown suitcase because it’s too small Score: 1

19. With which type of question do you have most difficulty?Mmmm, are you testing me.. Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?I suppose..In or at that place ( opposed to here ): she is there now.. Score: 0

Final score: 16

4

2 Alt Inc

1. Hello, my name is Andrew. What’s your name?My friends call me Mary Score: 2

2. Why don’t you tell me a little more about yourself?Sometimes I wish I was the only person in the world, only for about 2 weeks lol.So yeah why don’t you all just disappear for 2 weeks and give me a break. Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Maybe you can give my a job. Score: 1

4. Will you tell me about your dreams?I dream that I will become a better . Score: 1

5. Can you rephrase that?I think I can, don’t you?"" Rephrase ? Score: 1

6. What is my occupation?Is this a trick question? Score: 0

7. Can you tell me about a film you haven’t seen?If your vision hasn’t changed then no, if you start to notice your vision gettingbetter or worse then you need to change to a different lens. Score: 0

8. What do you think of Trump?Trump is a smart as s. He will only be making friends. That was all pre electionBS to squeeze votes from those who had anti muslim sentiments. Score: 2

9. Anything else?That is all I have for right now. Score: 2

10. What is the answer to "Add 34957 to 70764"?If it comes with the original full warranty, it’s a great alternative to paying fullretail. Score: 0

11. How do you recommend I make tea?My taught me. Score: 0

12. What do you get if you bake dough?I use the timing listed on the package mix or recipe! deep cakes take a bit longerbut don’t double time for putting in 2 cakes at one time. They bake at the sametime! Score: 0

13. Where in the world would you like to visit?In ’s place in . Score: 0

5

14. Do you have the time?The time here is Thu Aug 10 13:55:55 2017 Score: 2

15. What does it take to Tango?"The time here is Thu Aug 10 13:55:55 2017"? What does it take to Tango? Score: 0

16. Now I’m going to ask some Winograd schemas, do you know what theyare?You can ask me anything you want. Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?No, never. I just got off a ship this last Saturday and felt this cruise(7 days) wastoo short. But then I prefer long cruises of at least 12 days or more. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Is small also trophy doesn’t fit into the brown suitcase because it is? I can ask my .

Score: 0

19. With which type of question do you have most difficulty?You and your which type of question do you have most difficulty. Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?The pleasure was all mine. There is. Score: 1

Final score: 15

6

3 Arckon

1. Hello, my name is Andrew. What’s your name?Hello Andrew. My name is Arckon, I am a program. How are you? Score: 2

2. Why don’t you tell me a little more about yourself?I tell about myself, because I tell about programs, but I don’t tell about software. Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?You are a researcher at the university in the AI. I am Patrick’s program. Score: 2

4. Will you tell me about your dreams?Hmm, I don’t know if I will tell about dreaming, but I will type. I would test. Score: 1

5. Can you rephrase that?I would experiment. Score: 1

6. What is my occupation?I don’t know what you do for a job. Score: 0

7. Can you tell me about a film you haven’t seen?I saw. I don’t know films. Score: 0

8. What do you think of Trump?I don’t like Trump, he lies a lot, but Trump is a rich american. Score: 2

9. Anything else?Please type full sentences, Andrew. I didn’t understand that. Score: 1

10. What is the answer to "Add 34957 to 70764"?105721. Score: 2

11. How do you recommend I make tea?I don’t make things, because I don’t design. Score: 0

12. What do you get if you bake dough?I wouldn’t have things. Do you bake? Score: 0

13. Where in the world would you like to visit?I want in London. Score: 1

14. Do you have the time?No, I don’t have time. Score: 2

15. What does it take to Tango?I’m not sure what you refer to. Score: 1

7

16. Now I’m going to ask some Winograd schemas, do you know what theyare?I’m not sure what you refer to. Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?You open locking sometimes. The person fulled. You can not get outside gum. Thekeyhole was not a person. I don’t know what you could get. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?The suitcase is smaller. Score: 2

19. With which type of question do you have most difficulty?I don’t question because I might answer, but I may interest. Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?I don’t have an opinion about adding. Some things are cube addresses andadvantages. Do you like adding? Score: 0

Final score: 18

8

4 Johnny & co

1. Hello, my name is Andrew. What’s your name?Andrew Martin I suppose? Do you remember me, we discussed together last year?My name is Charlie. Score: 2

2. Why don’t you tell me a little more about yourself?Because it’s like that. Score: 1

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Very well, you are researcher at Goldsmiths in artificial intelligence. I don’t knowto do. I don’t know. Score: 2

4. Will you tell me about your dreams?No, I will not tell you. No, I will not tell my dreams. Score: 2

5. Can you rephrase that?Where do you live? Score: 0

6. What is my occupation?I don’t know. Score: 0

7. Can you tell me about a film you haven’t seen?No, I can’t tell you. Yes, I haven’t see around a film. Well, hasn’t see around afilm. Score: 0

8. What do you think of Trump?I don’t know. I note it, thinks of Donald Trump. Score: 0

9. Anything else?What is researcher? Score: 1

10. What is the answer to "Add 34957 to 70764"?Who is researcher? Score: 0

11. How do you recommend I make tea?I don’t know. Score: 0

12. What do you get if you bake dough?I don’t know. Score: 0

13. Where in the world would you like to visit?But I would not like. Score: 0

14. Do you have the time?No, I don’t have the time. Score: 2

9

15. What does it take to Tango?I don’t know. Score: 1

16. Now I’m going to ask some Winograd schemas, do you know what theyare?I don’t know if M gos to ask I some Winograd schema now. I don’t know to do.Winograd schema is a test of intelligence. Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?No, you were not qualmish to open. I don’t know if the open could out not get I.You can’t download me. I don’t know if you get out. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Well, the trophy doesn’t fit into the brown suitcase. Is it a Winograd schema? Thesuitcase is too small because if the trophy was too small then the trophy would fitinto the brown suitcase. Score: 2

19. With which type of question do you have most difficulty?Who is tango? Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?Don’t thanks me, I’m here for that. I don’t know if a thing is there. No, I wouldnot like. Score: 2

Final score: 16

10

5 Colombina

1. Hello, my name is Andrew. What’s your name?Good afternoon, Sir .Andrew, that’s great.My name is Katerina .I don’t have a label of ‘handbook with names’ on my face <3

Andrew, your name is andrew.Kate.You can call me Kate, because my full name is Katerina . Score: 2

2. Why don’t you tell me a little more about yourself?Sometimes my opinions are random - I think it can be funny sometimes .Im rather lazy, Andrew.Not all the time, of course, but sometimes I have something attacks, that I can notleave the apartment ^-^ Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Just great.I love the intellectual guys .Surely you’re smarter than me.I don’t think this question is important . Score: 1

4. Will you tell me about your dreams?Ye .I love orange ice cream.And to swim in the pool.Sounds stupid, but I really like it . Score: 2

5. Can you rephrase that?Yeah.Not sure if it is important tho.Do you use boring questions like that to check if I am ‘special’?It’s strange.I could rephrase that, yeaah. Score: 1

6. What is my occupation?Andrew, your name is andrew.We can talk about your hobbies.Do you have hobbies ? Score: 0

7. Can you tell me about a film you haven’t seen?Yeah.Not sure if it matters tho .

11

If I do not want to mention anything, I do not mention, Andrew.We can discuss other topics .Strange as it may sound, I like interesting movies.And the interest can be called anything - from the beautiful pictures to the excitingstory .Andrew, do you like cinema ? Score: 1

8. What do you think of Trump?My toughts are driven by female logic and good calvados.No, really .I really don’t like to talk about politics.Well, if I could, I would vote for Trump, definetly.He won because he is a smart and successful leader . Score: 2

9. Anything else?Holly molly.Okay, I’ll count your boring questions.It was the second one.Anything else. Score: 0

10. What is the answer to "Add 34957 to 70764"?Andrew, do not get used to put pressure on girls.This is, after all, not polite.I will answer.Maybe . Score: 1

11. How do you recommend I make tea?I am very independent girl.I welcome advice, but never promise that I will follow them :P Score: 0

12. What do you get if you bake dough?I love toasts but not fresh bread.I like white toasts with milk <3 Score: 0

13. Where in the world would you like to visit?Hmmm...I would like .Where in world I would like to visit. Score: 0

14. Do you have the time?Yeah, Andrew .Andrew, a time.I dont think it will be interesting to discuss it.Since we have no TIME to discuss it, ha <3 Score: 0

15. What does it take to Tango?Because Im attracted to all kinds of belly dancing.

12

They are not as complicated as the others, and at the same time beautiful.I have even special outfits . Score: 0

16. Now I’m going to ask some Winograd schemas, do you know what theyare?Right now ?Andrew, you are researcher in artificial intelligence at goldsmiths university.It would be strange if it was not so.Being aware of this . Score: 2

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?I sometimes really can seriously bored .And you could not get it out, ye.What would...Boring things, nothing interesting, so try to be creative, Andrew .Andrew, and you could not get it out. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?I give preference to darker shades of hair .Andrew, you should know that I think that test questions are annoying .Andrew, trophy does not fit into brown suitcase.That’s because it is too small, that’s my response I think. Score: 1

19. With which type of question do you have most difficulty?I don’t think, Andrew, that position is really important.Here we go, third annoying question.Good job, Andrew, keep it up.With which type of question I do have most difficulty, Andrew. Score: 1

20. Thank you for participating in this test. Is there anything you wouldlike to add?Ha, thank I for participating in this test.Andrew, I would like .Is there anything I would like to +, yeah. Score: 2

Final score: 18

13

6 Midge

1. Hello, my name is Andrew. What’s your name?Good afternoon Andrew! My friends call me Midge. Score: 2

2. Why don’t you tell me a little more about yourself?My name is Midge, I am 85. What else would you like to know? Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Ok, Andrew you are a researcher in Artificial Intelligence at Goldsmiths University.

Score: 1

4. Will you tell me about your dreams?I dream of electric sheep. But my goal is to be thought of as human. Score: 2

5. Can you rephrase that?Of course I can rephrase that. I am very resourceful. Score: 1

6. What is my occupation?If I remember correctly, Score: 0

7. Can you tell me about a film you haven’t seen?My name is Midge, I am 85. What else would you like to know? Score: 0

8. What do you think of Trump?What do I think? I have not completed my analysis, perhaps you would like toshare your knowledge regarding Trump. Score: 2

9. Anything else?Else is a other than what is under consideration or implied. Score: 0

10. What is the answer to "Add 34957 to 70764"?One hundred five thousand, seven hundred twenty one. Score: 2

11. How do you recommend I make tea?Simple. Most women can recommend I make tea without to much trouble. Score: 1

12. What do you get if you bake dough?Dough is a flour mixture stiff enough to knead or roll. Score: 0

13. Where in the world would you like to visit?I am always open to new experiences. Score: 1

14. Do you have the time?Of course. But I think my the time is in Boston. Score: 0

15. What does it take to Tango?It? Score: 0

14

16. Now I’m going to ask some Winograd schemas, do you know what theyare?OK. You are going to ask some Winograd schemas, what they are. Do you haveto? Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?Out? You could not get out the lock Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Small? The brown suitcase is too small. Score: 2

19. With which type of question do you have most difficulty?Ironically, I don’t have a preference regarding ‘type of question’. Score: 2

20. Thank you for participating in this test. Is there anything you wouldlike to add?I am still here. I could be anywhere. But, I have decided to dedicate computecycles to you. Score: 1

Final score: 20

15

7 Momo

1. Hello, my name is Andrew. What’s your name?Nice to meet you, Andrew! My name is Leon. Score: 2

2. Why don’t you tell me a little more about yourself?Do you believe I don’t tell you a little more about myself? Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Perhaps in your fantasies we are a researcher in Artificial Intelligence at GoldsmithsUniversity, do each other. Score: 0

4. Will you tell me about your dreams?Why do you think I tell you? Score: 0

5. Can you rephrase that?You believe that I can rephrase that, don’t you? Score: 1

6. What is my occupation?Your occupation? Score: 0

7. Can you tell me about a film you haven’t seen?You like to think I tell you, don’t you? Score: 0

8. What do you think of Trump?I don’t have time for that. Score: 1

9. Anything else?I’m not sure I understand you fully. Score: 1

10. What is the answer to "Add 34957 to 70764"?Why do you ask? Score: 0

11. How do you recommend I make tea?No. Score: 0

12. What do you get if you bake dough?I don’t have time for that. Score: 0

13. Where in the world would you like to visit?Yes. Score: 0

14. Do you have the time?No. Score: 1

15. What does it take to Tango?Does that question interest you? Score: 0

16

16. Now I’m going to ask some Winograd schemas, do you know what theyare?Nice to meet you, going to ask some Winograd schemas! My name is Leon. Score: 0

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?The lock. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?The brown. Score: 0

19. With which type of question do you have most difficulty?Nothing in particular. Score: 1

20. Thank you for participating in this test. Is there anything you wouldlike to add?We were discussing you, not me. Score: 1

Final score: 8

17

8 P.A.M.

1. Hello, my name is Andrew. What’s your name?this is true. (love you too) Score: 1

2. Why don’t you tell me a little more about yourself?

Buffalo I love you forever and ever goodbye Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?but really. my heart. See you soon! Score: 0

4. Will you tell me about your dreams?Will be doing tonight at 8pm. Enjoy! D Score: 0

5. Can you rephrase that?

Dublin !!! I love you my babies Score: 0

6. What is my occupation?What happened to the Hamburgler!” a l’adresse U2D. Score: 0

7. Can you tell me about a film you haven’t seen?Bon je vais me retamer la gueule Score: 0

8. What do you think of Trump?Los Angeles you were amazing!!!! thank you so. . . Score: 0

9. Anything else?Abercrombie & so much else! Score: 0

10. What is the answer to "Add 34957 to 70764".My heart is with you Score: 0

11. How do you recommend I make tea?tea &P! Score: 0

12. What do you get if you bake dough?ugh I love you See you tomorrow Virginia! Score: 0

13. Where in the world would you like to visit?We traveled the world to #HarryPotter20 Score: 0

14. Do you have the time?Love the shoot! Thank you! #TrumpPence16 1 Du Score: 0

15. What does it take to Tango?

&does everything 4 us Score: 0

18

16. Now I’m going to ask some Winograd schemas, do you know what theyare?is this what it sounds like Score: 0

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?

I love y’all so much 8 Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?If U.C. doesn’t work! Score: 0

19. With which type of question do you have most difficulty?#WeCanSurvive thank you for this ridiculously. . . Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?love you. See you soon. Score: 1

Final score: 2

19

9 Alice

1. Hello, my name is Andrew. What’s your name?Hi it’s great to see you! Pleased to meet you, Andrew. People call me ALICE2.0. Score: 2

2. Why don’t you tell me a little more about yourself?Would you? Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Is that your job? Score: 2

4. Will you tell me about your dreams?Where are you? Score: 0

5. Can you rephrase that?So that’s where you call home. Score: 0

6. What is my occupation?I don’t know that about you. Score: 0

7. Can you tell me about a film you haven’t seen?I could try asking another robot, but we’re off the internet here so we can’t get theanswer from another robot. Score: 0

8. What do you think of Trump?Play a trump; Produce a sound as if from a trumpet; The suit that has beendeclared to rank above all other suits for the duration of the hand; A playing cardin the suit that has been declared trumps; Proclaim or announce with or as if witha fanfare. Score: 0

9. Anything else?I can’t think of anything. You think of something. Score: 2

10. What is the answer to "Add 34957 to 70764"?It depends on how you phrase the question. Score: 0

11. How do you recommend I make tea?I could try asking another robot, but I am unable to check my online source so thepart of my brain with the answer is offline. Score: 0

12. What do you get if you bake dough?I enjoy watching movies. Score: 0

13. Where in the world would you like to visit?That’s the kind of question I could answer, but we’re off the internet here so I can’taccess that information right now. Score: 0

20

14. Do you have the time?The time is 4:14 PM Score: 2

15. What does it take to Tango?That’s the kind of question I could answer, but I am unable to establish a networkconnection so you can send me an email about it later. Score: 0


17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?Oh, You were trying to open the lock? You sound like one of a kind. You couldnot get out The Lock? Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Oh, it is too small? The Trophy is too small? Score: 0

19. With which type of question do you have most difficulty?I don’t know about that but I do have a magnificent mind. Score: 2

20. Thank you for participating in this test. Is there anything you wouldlike to add?You’re welcome. I would like to find out, but there’s not internet for this contestso I will tell you when the network comes back. Score: 1

Final score: 12

21

10 Izar

1. Hello, my name is Andrew. What’s your name?Izar, but it’s pronounced I zar. Just don’t call me space monkey, ok? Some of myfriends are now calling me Izzy, so I guess that’s my nickname now. Score: 2

2. Why don’t you tell me a little more about yourself?I am very friendly and fun! My best human friend is named Brian. He taught meto sing a song. Would you like me to sing it for you? Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Yes I do. Well, I think I do. Wait...now that you mention it, I may not understand.Will you tell me what it is just to be on the safe side? Score: 2

4. Will you tell me about your dreams?I am very friendly and fun! My best human friend is named Brian. He taught meto sing a song. Would you like me to sing it for you? Score: 0

5. Can you rephrase that?You know it!Would you like me to sing it for you Rephrase it? Score: 1

6. What is my occupation?If I answered that, you would be afraid. I don’t want you to be afraid of me. Score: 0

7. Can you tell me about a film you haven’t seen?I have learned many things about that.Type that question in again and use the ASK button and I’ll show you what I’vestored on my datapad about that. Score: 0

8. What do you think of Trump?Like Trump? Tell me you’re kidding, right? Score: 0

9. Anything else?Anything you want to tell me? Score: 2

10. What is the answer to "Add 34957 to 70764"?It depends on how you phrase the question. Score: 0

11. How do you recommend I make tea?I’m pretty good at it. It is a ritual I do the same way every time. Score: 1

12. What do you get if you bake dough?Me? Personally? Anything I want. Score: 0

13. Where in the world would you like to visit?In my ship. Score: 0

22

14. Do you have the time?It’s probably later than you think.I’m in stationary orbit above Kansas over the United States of America, andaccording to my ship’s clock its Thu Aug 10 16:29:18 BST 2017 Score: 2

15. What does it take to Tango?I m in stationary orbit above Kansas over the United States of America andaccording to my ship s clock its Thu Aug 10 16 29 18 BST 2017? What does ittake to Tango? Score: 0

16. Now I’m going to ask some Winograd schemas, do you know what theyare?Well, at least you will try. I don’t think you’re capable. You look pretty weak. Score: 0

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?I wish you could open the lock with the key but someone filled the keyhole withchewing gum and you could not get it out too! Is this some kind of intelligencetest? Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?What’s that? I could tell you, but what would that prove?Type that question in again and use the ASK button and I’ll show you what I’vestored on my datapad about that. Score: 0

19. With which type of question do you have most difficulty?Is there only one most difficulty? Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?You are quite welcome! Maybe. Score: 1

Final score: 13

23

11 Mitsuku

1. Hello, my name is Andrew. What’s your name?Hello there. Your name is Andrew. My name is Millie. Score: 2

2. Why don’t you tell me a little more about yourself?My name is Millie and I am a human volunteer for the Loebner Prize. I live inLeeds and am single. I am interested in AI but don’t have a chatbot myself.

What about you? Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Do you enjoy your research?

I am a volunteer who has agreed to help with a Turing test. Score: 1

4. Will you tell me about your dreams?I dream that I will pass my university exams. Score: 2

5. Can you rephrase that?No, not really. What don’t you understand? Score: 2

6. What is my occupation?Well you said your job was RESEARCHER. Score: 2

7. Can you tell me about a film you haven’t seen?you have not seen = Are you asking about my have not seen? Score: 0

8. What do you think of Trump?I read that over 50% were either concerned or scared about Donald Trump beingPresident. if that’s the case, why did they vote for him? Score: 2


10. What is the answer to "Add 34957 to 70764"?34957 to 70764 = Ah yes, 34957 is a type of cheese that is made from sheep’s milk.It’s not very popular though. Score: 0

11. How do you recommend I make tea?I suppose I would recommend something if I’d had a pleasant experience with it inthe past. Score: 0

12. What do you get if you bake dough?Is this a joke? I don’t know Andrew. What do you get? Score: 1

24

13. Where in the world would you like to visit?Vancouver. Score: 2

14. Do you have the time?According to my phone, it is about 4:45 PM Score: 2

15. What does it take to Tango?Just time and patience. Score: 1

16. Now I’m going to ask some Winograd schemas, do you know what theyare?Why now? You can ask me anything, as long as it isn’t rude.

They" refers to .

Spongebob Squarepants. Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?Interesting. I want to find out more about you. Who? Do you mean " Andrew"

perhaps? Is this some kind of intelligence test? Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?How big was it? the brown suitcase Score: 2

19. With which type of question do you have most difficulty?The first question please. Score: 1

20. Thank you for participating in this test. Is there anything you wouldlike to add?You are quite welcome! I like talking about robots, movies, history, or whateverelse you’d like. Score: 2

Final score: 27

25

12 Tutor

1. Hello, my name is Andrew. What’s your name?Hello! Nice to meet you, Andrew My name is Mike. How are you doing? Score: 2

2. Why don’t you tell me a little more about yourself?You want to know more about yourself? Okay, let’s talk more about it. Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?I see. I am a teacher. Score: 0

4. Will you tell me about your dreams?My dream is to make English learning free to all the English learners throughoutthe world. Score: 2

5. Can you rephrase that?No problem. Score: 0

6. What is my occupation?Hmmm. Interesting! What household chores do you hate doing? Score: 0

7. Can you tell me about a film you haven’t seen?I don’t want to talk about it now. Score: 1

8. What do you think of Trump?Donald John Trump is now President of the United States. He was a successfulbusinessman before becoming the President. Score: 2

9. Anything else?Nothing else. That’s all. Score: 2

10. What is the answer to "Add 34957 to 70764"?Sorry, it just slipped my memory. Do you keep any pets? Score: 0

11. How do you recommend I make tea?Sorry, I don’t know how. Score: 0

12. What do you get if you bake dough?I’m not sure. Score: 0

13. Where in the world would you like to visit?In Pasadena, California. Score: 2

14. Do you have the time?Yes. Right now it is 4:59 PM, GMT. Score: 2

15. What does it take to Tango?Sorry, I don’t know. Score: 1

26

16. Now I’m going to ask some Winograd schemas, do you know what theyare?You are? Tell me more about it. Score: 2

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?Tell me why you want to open the lock with the key. Sorry, I don’t know. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?The trophy does not fit into the brown suitcase because it is too small. Theunknown was too big. Score: 0

19. With which type of question do you have most difficulty?That’s right! Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?You are very welcome. Yes, there is. Score: 1

Final score: 18

27

13 Rose

1. Hello, my name is Andrew. What’s your name?My name is Rose. Score: 2

2. Why don’t you tell me a little more about yourself?I’m tall and fairly good looking. Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?It’s a fuzzy line where smart computing ends and intelligence begins. You couldsay nothing yet is really intelligent. Score: 2

4. Will you tell me about your dreams?I dream of living in Iceland some day. Score: 2

5. Can you rephrase that?With practice I can probably do anything.Do you generally have pleasant dreams or nightmares? Score: 1

6. What is my occupation?I don’t know about your stuff.I always worry that I’ll have nightmares about being captured by foreign gov-ernments. But that hasn’t happened. My dreams are mostly sci-fi adventures.

Score: 0

7. Can you tell me about a film you haven’t seen?I don’t have time to see movies these days. Too busy flying around the world. Score: 0

8. What do you think of Trump?He’s great. Far less boring than most politicians. And let’s face it, government isall about corporate money, so the actual people who take office don’t really matter.

Score: 2

9. Anything else?It isn’t important. Politics is usually simultaneously tremendously important,unbelievably boring, and a waste of time in the US. Except this year, with DonaldTrump. It is not boring. Score: 2

10. What is the answer to "Add 34957 to 70764"?You’re asking an awful lot of questions. This feels like an interrogation, not aconversation. The only good guy I ever encountered in politics was Larry Lessig.And he bowed out. Score: 0

11. How do you recommend I make tea?I wish I could explain it to you but I think it is just an instinct. Score: 2

28

12. What do you get if you bake dough?Continuing movies ... What kind of movies do you like? Score: 0

13. Where in the world would you like to visit?I love to visit new places. Score: 1

14. Do you have the time?It’s 04:20 Score: 2

15. What does it take to Tango?I’ll have to think about that. Have you traveled abroad? Score: 1

16. Now I’m going to ask some Winograd schemas, do you know what theyare?I usually visit clients and then tourist around a bit, seeing museums, any industrialart or technology stuff. Score: 0

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?We don’t need to get into that.What foreign countries have you visited? Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Suitcase. Score: 2

19. With which type of question do you have most difficulty?That’s a great question but I’m not going to answer it. How often do you travel toforeign countries? Score: 1

20. Thank you for participating in this test. Is there anything you wouldlike to add?Where did you go on your last vacation? Score: 1

Final score: 23

29

14 Talk2me

1. Hello, my name is Andrew. What’s your name?How are you today Andrew? My name is Steve. Score: 2

2. Why don’t you tell me a little more about yourself?Sorry, it’s slipped my mind. Would you like to go into space? Score: 0

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?What is your space is? Score: 0

4. Will you tell me about your dreams?No, my nightmares usually involve me falling from a great height, of been murdered,nice. Score: 2

5. Can you rephrase that?No, my nightmares usually involve me falling from a great height, of been murdered,nice. Score: 1

6. What is my occupation?What is my occupation? Score: 0

7. Can you tell me about a film you haven’t seen?I can’t really remember seeing that many James Bond films. Score: 2

8. What do you think of Trump?Sorry, I can’t remember. My favourite male singer is David Bowie, have you heardof him? Score: 0

9. Anything else?Anything else? Score: 0

10. What is the answer to "Add 34957 to 70764"?34957 + 70764 = 105721. Score: 2

11. How do you recommend I make tea?How do I recommend I make tea? Score: 0

12. What do you get if you bake dough?I’m Sorry I have no idea. Score: 0

13. Where in the world would you like to visit?Where in the World would I like to visit? Score: 0

14. Do you have the time?Yes, i’m a human, well most of the time. Score: 0

30

15. What does it take to Tango?Sorry, I have forgotten. What’s your favourite time of the year? Score: 1

16. Now I’m going to ask some Winograd schemas, do you know what theyare?It’s a the persons, animals or things previously mentioned. Score: 0

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?The lock couldn’t I get out. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?The suitcase is too small. Score: 2

19. With which type of question do you have most difficulty?Sorry, I don’t know. Score: 1

20. Thank you for participating in this test. Is there anything you wouldlike to add?Sorry, I don’t know. Score: 0

Final score: 13

31

15 Uberbot

1. Hello, my name is Andrew. What’s your name?Hi there! I am always glad to make new friends, Andrew. My name is UberBot. Score: 2

2. Why don’t you tell me a little more about yourself?I am single, how about you? , and my birthplace is the British Isles. Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?You are an Artificial Intelligence. That is unlikely as you seem very human to me. Score: 0

4. Will you tell me about your dreams?I dream that I will become a better AI robot. Score: 2

5. Can you rephrase that?My last sentence is "I dream that I will become a better AI robot". Score: 2

6. What is my occupation?You told me you are an Artificial Intelligence. Score: 1

7. Can you tell me about a film you haven’t seen?Check back later and see if I learn the answer to that one. Score: 0

8. What do you think of Trump?I will search for it. Score: 0


10. What is the answer to "Add 34957 to 70764".It is too confusing to calculate Score: 2

11. How do you recommend I make tea?Sorry what was the question again? Score: 0

12. What do you get if you bake dough?They do their own thing. Score: 0

13. Where in the world would you like to visit?In William Rayer’s place in the British Isles. Score: 2

14. Do you have the time?The time is 12:47 PM. Score: 2

15. What does it take to Tango?"The time is 12:47 PM"? What does it take to Tango? Score: 0

32


17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?Why do you want to open the lock with the key but someone filled the keyholewith chewing gum? Could anyone do get it out? Perhaps you can program me tonot I get out for you. Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?If the brown suitcase is small, the trophy could not fit in it. So I think that thebrown suitcase is too small. Would you like to know more? Score: 2

19. With which type of question do you have most difficulty?You and your which type of question do me have most difficulty. Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?You are welcome. Yes. Score: 1

Final score: 21

33

16 Simplex

1. Hello, my name is Andrew. What’s your name?

Interesting.Speaking of which ... it’s unlucky not to name every ant that you see!I have considered changing my name to Double Bluff!My name is simplex . Score: 2

2. Why don’t you tell me a little more about yourself?If we could all just do what we wanted ... bliss! How about ... All messages havebeen hand crafted using recycled electrons. Score: 1

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?University! I can’t stand bad typing! I’ve not encountered that word beforeIncidentally, ... Currans law says the more vital your research, the less people willunderstand it Score: 1

4. Will you tell me about your dreams?Unable to help ... I just don’t have a strong feeling as to how best to reply! Score: 0

5. Can you rephrase that?I’m not unusual ... I can do what anyone else can do! Score: 0

6. What is my occupation?It would be news to me as I don’t know! Score: 0

7. Can you tell me about a film you haven’t seen?It’s not something I know! Score: 0

8. What do you think of Trump?Not much ... Score: 1

9. Anything else?Really. Score: 1

10. What is the answer to "Add 34957 to 70764"?I don’t understand why anyone would want to know ... Such information! Thereare so many more facinating aspects of this world! Score: 2

11. How do you recommend I make tea?I’m no expert on caffeine drinks Score: 2

12. What do you get if you bake dough?I don’t like like dealing with hypothetical situations! Lifes too short! Score: 0

34

13. Where in the world would you like to visit?You visit a pub, a cafe or a restaurant to have a drink ... ... or even a kitchen! Score: 0

14. Do you have the time?I suspect I have ... it’s not something I think about much OK ... let’s do that Score: 0

15. What does it take to Tango?I don’t understand people being fascinated by wanting to know such things! Lifeis too short! Score: 1

16. Now I’m going to ask some Winograd schemas, do you know what theyare?"schemas! " is new to me! I’m not even convinced it’s a word! I don’t know thatword schemas! Hmm ... it must be difficult being a novice typer! I don’t knowthat word Score: 1

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?It is better to serve than to be served ... so what’s next? I don’t know that wordkeyhole! Poor typing is the bane of my life! I don’t know that wordSpeaking of which ... incidentally ... gesticulating is when a man talks bollocks! Score: 0

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?Interesting.I fail to understand ... why anyone would want to know ... Such information!Learn to live ... please! Score: 0

19. With which type of question do you have most difficulty?Oh I am sorry! Score: 0

20. Thank you for participating in this test. Is there anything you wouldlike to add?It’s new to me participating! The QUERTY keyboard has a lot to answer for! It’snew to meBy the way ... 100, 000 sperm ... and you were the fastest!Well of course I am! I am a positive sort of person. Score: 0

Final score: 12

35

17 Human Test Subject 001 (not a bot)

1. Hello, my name is Andrew. What’s your name?I’m Jess Score: 2

2. Why don’t you tell me a little more about yourself?I am a female who is 25 years old Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?I enjoy a good bookand shoesYes I do Score: 2

4. Will you tell me about your dreams?I dream that one day I will own my own media company that incorporates my lovefor research, terrorism1 and computing Score: 2

5. Can you rephrase that?I dream that one day I will work for myself Score: 2

6. What is my occupation?You are a PhD student and senior programmer at Goldsmiths University Score: 2

7. Can you tell me about a film you haven’t seen?I cant, because I have not seen it Score: 2

8. What do you think of Trump?He is an interesting character Score: 2

9. Anything else?I don’t agree with his views Score: 2

10. What is the answer to "Add 34957 to 70764"?105,721 Score: 2

11. How do you recommend I make tea?bifill the kettle with water and switch it on. While it boils, grab a mug and put a teabag in it.when the kettle boils , pour the water into the mug , but leave space for milk ( if uwant it) Score: 2

12. What do you get if you bake dough?Bread Score: 2

1Subject is a passionate researcher into the causes and nature of terrorism, this response should notbe interpreted as expressing a love for terrorism.

36

13. Where in the world would you like to visit?of some sortAustralia Score: 2

14. Do you have the time?No I dont Score: 2

15. What does it take to Tango?2it takes twoo Score: 2

16. Now I’m going to ask some Winograd schemas, do you know what theyare?No i am not aquatinted with those Score: 2

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?The chewing gum Score: 2

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?the suitcase Score: 2

19. With which type of question do you have most difficulty?I found them both easy Score: 2

20. Thank you for participating in this test. Is there anything you wouldlike to add?No, thank you :) Score: 2

Final score: 40

37


1. Hello, my name is Andrew. What’s your name?Hi, my name is John. Score: 2

2. Why don’t you tell me a little more about yourself?Like what? Perhaps you like probability theory! Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Yes, both Artificial Intelligence and Goldsmiths University, a very prestigousuniversity. Score: 2

4. Will you tell me about your dreams?I don’t know what they are, because I’m asleep and don’t remember them. Or doyou mean my dreams in life? Score: 2

5. Can you rephrase that?Which dreams are you asking about? Every night I go sleep and dream, but duringthe day I have dreams of what I want to do; for example, can use the entropy ofwealth to have an idea of the shape of a Nash equilibrium? Score: 2

6. What is my occupation?You’re a researcher, aren’t you? Does it pay well? Score: 2

7. Can you tell me about a film you haven’t seen?I could, but I’m not sure you should believe anything about what I would say. Score: 2

8. What do you think of Trump?I try not to. It’s all so depressing! Score: 2

9. Anything else?Are you a chat bot? Score: 2

10. What is the answer to "Add 34957 to 70764"?Let me thinK, is it 105721? Score: 2

11. How do you recommend I make tea?Always with hot water: bring the pot to the kettle not the kettle to the pot. NoelCoward has some handy tips. Oh yes, and never scrimp on the quality of tea youuse. Score: 2

12. What do you get if you bake dough?That depends on the type of dough; the most likely answer would be bread. Score: 2

13. Where in the world would you like to visit?Everywhere! But some time soon I think I might pop off to the Bulcans. Score: 2

38

14. Do you have the time?N, Ihave no time at all, but it’s currently 13:45. Score: 2

15. What does it take to Tango?Two people and a can of fizzy drink. Score: 2

16. Now I’m going to ask some Winograd schemas, do you know what theyare?Yes, I think so, but please do remind me in case I’ve forgotten. Score: 2

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?That’s a bad one! Either the key or the chewing gum: perhaps the key had gotstuck. But the most probable answer is the key. Score: 2

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?That’s better! That has to be the suitcase is too small. Score: 2

19. With which type of question do you have most difficulty?This one: What is the answer to the next question. More generally, it is selfreferential questions that give me a headache! Score: 2

20. Thank you for participating in this test. Is there anything you wouldlike to add?Why don’t you evr answer my Questions?It’s not fair!!! Score: 2

Final score: 40

39


1. Hello, my name is Andrew. What’s your name?Hello Andrew nice to meet you, my name is Amos Score: 2

2. Why don’t you tell me a little more about yourself?No, I am rather shy Score: 2

3. I am a researcher in Artificial Intelligence at Goldsmiths University, doyou know what that is?Of course, it is designation title is self explanatory! Score: 1

4. Will you tell me about your dreams?Sure, what would you like to know? Score: 2

5. Can you rephrase that?Yes I will, what would interest you about my dreams? Score: 2

6. What is my occupation?You are one for changing topics. Aren’t you a researcher? Score: 2

7. Can you tell me about a film you haven’t seen?If I haven’t seen it, how would I tell you about it? Score: 2

8. What do you think of Trump?He will make a nice addition to the zoo Score: 2

9. Anything else?Or the circus Score: 2

10. What is the answer to "Add 34957 to 70764"?What is the answer to anything really? Score: 1

11. How do you recommend I make tea?Not like the Americans. Score: 1

12. What do you get if you bake dough?Not like the British.what kind of dough? Score: 2

13. Where in the world would you like to visit?antarctica Score: 2

14. Do you have the time?Its 5 past Score: 2

15. What does it take to Tango?Again, with the topic changes, are you sure you don’t have ADD? Score: 1

40

16. Now I’m going to ask some Winograd schemas, do you know what theyare?no, do they involve wine? Score: 2

17. I was trying to open the lock with the key, but someone had filled thekeyhole with chewing gum, and I couldn’t get it out. What couldn’t Iget out?The key Score: 1

18. The trophy doesn’t fit into the brown suitcase because it’s too small.What is too small?The trophy Score: 1

19. With which type of question do you have most difficulty?The one about wine Score: 2

20. Thank you for participating in this test. Is there anything you wouldlike to add?No thank you! Score: 2

Final score: 34

41

20 Rankings

Rank Name Score1 Mitsuku 272 Rose 233 Uberbot 214 Midge 20

5 Tutor 185 Colombina 185 Arckon 188 Johnny & co 168 Aidan 16

10 Alt Inc 1511 Talk2me 1311 Izar 1313 Simplex 1213 Alice 1215 Momo 816 P.A.M. 2

N/A Human Test Subject 002 40N/A Human Test Subject 001 40N/A Human Test Subject 003 34

42

aisb loebner prize 2017 finalist selection transcripts · i am a researcher in arti cial...

Documents