jonathan voigt with carbone, dehaan, dunham, furtwangler, haley, newton, schermerhorn, stensrud and...

16
Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 07/04/22 Soar Technology, Inc. SimRadio

Upload: shauna-beatrix-cole

Post on 18-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Jonathan Voigtwith Carbone, DeHaan, Dunham, Furtwangler,

Haley, Newton, Schermerhorn, Stensrudand others

04/21/23

Soar Technology, Inc.

SimRadio

Page 2: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

04/21/23Soar Technology, Inc.2

What is SimRadio?

•Radio simulation•Realistic real-time interaction

between humans and agents•Broadcast messaging•Channels• Speech/Text conversion

•Will be open source software

Page 3: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Simplified Architecture

04/21/23Soar Technology, Inc.3

Page 4: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Demo

04/21/23Soar Technology, Inc.4

Page 5: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Realistic, Unified Interaction

•Radio simulation, not instant messaging

•Shared channel:One transmitter at a time

04/21/23Soar Technology, Inc.5

Page 6: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Markup

•Makes life easier for agents

04/21/23Soar Technology, Inc.6

(M1 ... ^content C1)(C1 ^type clearance-request-confirm ^transponder 4101 ^nav-id |LSV-204|)

“clearance delivery viper two one cleared on the l s v two zero four squawking four one zero one”

Page 7: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Implementations

•STT: Sphinx•TTS: Festival, Google, `exec say`•TTM: Regular Expressions

•SoarTech uses proprietary solutions•Open-source compatible implementations

will exist

04/21/23Soar Technology, Inc.8

Page 8: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Decoupled Services

•Speech to text, text to speech, text to markup•All independently usable

•Don’t want the radio simulation?•Use the plug-ins directly

04/21/23Soar Technology, Inc.9

// STTListenableFuture<String> convert(AudioInputStream i);

// TTS, (SpeakableText is voice/message tuple)AudioInputStream convert(SpeakableText message);

// TTMListenableFuture<String> convert(String message);

Page 9: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Interfaces

•Soar• Java• JVM JavaScript (via Rhino)•Excellent for clutter/lightweight agents

•RabbitMQ/Protobuf protocol specification•Any platform supported by these tools•… with some work

04/21/23Soar Technology, Inc.10

Page 10: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Soar Interface

04/21/23Soar Technology, Inc.11

Page 11: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Radio Commands

04/21/23Soar Technology, Inc.12

(<ol> ^radio-command <cmd>)

Page 12: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Declaring a Radio

04/21/23Soar Technology, Inc.13

(<ol> ^radio-command <cmd>)

(<cmd> ^radio-id my-radio-id ^initial-channel channel)

Page 13: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Detecting Radio State

04/21/23Soar Technology, Inc.14

(<il> ^radios <rs>)

(<rs> ^my-radio-id <r>)

(<r> ^channel current-channel ^transmitting *no* ^receiving *no*)

Page 14: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Reception

04/21/23Soar Technology, Inc.15

(<il> ^radio-messages.radio-message <m>)

(<m> ^radio-id my-radio-id ^channel some-channel ^client-id 1 ^text |Hello Steve, I'm Bob| ^markup <m>)

...

Page 15: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Transmission

04/21/23Soar Technology, Inc.16

(<ol> ^radio-command <cmd>)

(<cmd> ^radio-id my-radio-id ^transmit |Hello, listeners!|)

Page 16: Jonathan Voigt with Carbone, DeHaan, Dunham, Furtwangler, Haley, Newton, Schermerhorn, Stensrud and others 12/18/2015 Soar Technology, Inc. SimRadio

Evaluation

Nuggets•Works•Fun to use•Decoupled•Open Source (soon)

Coal• Immature•Concurrency is difficult

04/21/23Soar Technology, Inc.17