jonathan voigt with carbone, dehaan, dunham, furtwangler, haley, newton, schermerhorn, stensrud and...

Post on 18-Jan-2016

215 Views

Category:

Documents

0 Downloads

Preview:

Click to see full reader

TRANSCRIPT

Jonathan Voigtwith Carbone, DeHaan, Dunham, Furtwangler,

Haley, Newton, Schermerhorn, Stensrudand others

04/21/23

Soar Technology, Inc.

SimRadio

04/21/23Soar Technology, Inc.2

What is SimRadio?

•Radio simulation•Realistic real-time interaction

between humans and agents•Broadcast messaging•Channels• Speech/Text conversion

•Will be open source software

Simplified Architecture

04/21/23Soar Technology, Inc.3

Demo

04/21/23Soar Technology, Inc.4

Realistic, Unified Interaction

•Radio simulation, not instant messaging

•Shared channel:One transmitter at a time

04/21/23Soar Technology, Inc.5

Markup

•Makes life easier for agents

04/21/23Soar Technology, Inc.6

(M1 ... ^content C1)(C1 ^type clearance-request-confirm ^transponder 4101 ^nav-id |LSV-204|)

“clearance delivery viper two one cleared on the l s v two zero four squawking four one zero one”

Implementations

•STT: Sphinx•TTS: Festival, Google, `exec say`•TTM: Regular Expressions

•SoarTech uses proprietary solutions•Open-source compatible implementations

will exist

04/21/23Soar Technology, Inc.8

Decoupled Services

•Speech to text, text to speech, text to markup•All independently usable

•Don’t want the radio simulation?•Use the plug-ins directly

04/21/23Soar Technology, Inc.9

// STTListenableFuture<String> convert(AudioInputStream i);

// TTS, (SpeakableText is voice/message tuple)AudioInputStream convert(SpeakableText message);

// TTMListenableFuture<String> convert(String message);

Interfaces

•Soar• Java• JVM JavaScript (via Rhino)•Excellent for clutter/lightweight agents

•RabbitMQ/Protobuf protocol specification•Any platform supported by these tools•… with some work

04/21/23Soar Technology, Inc.10

Soar Interface

04/21/23Soar Technology, Inc.11

Radio Commands

04/21/23Soar Technology, Inc.12

(<ol> ^radio-command <cmd>)

Declaring a Radio

04/21/23Soar Technology, Inc.13

(<ol> ^radio-command <cmd>)

(<cmd> ^radio-id my-radio-id ^initial-channel channel)

Detecting Radio State

04/21/23Soar Technology, Inc.14

(<il> ^radios <rs>)

(<rs> ^my-radio-id <r>)

(<r> ^channel current-channel ^transmitting *no* ^receiving *no*)

Reception

04/21/23Soar Technology, Inc.15

(<il> ^radio-messages.radio-message <m>)

(<m> ^radio-id my-radio-id ^channel some-channel ^client-id 1 ^text |Hello Steve, I'm Bob| ^markup <m>)

...

Transmission

04/21/23Soar Technology, Inc.16

(<ol> ^radio-command <cmd>)

(<cmd> ^radio-id my-radio-id ^transmit |Hello, listeners!|)

Evaluation

Nuggets•Works•Fun to use•Decoupled•Open Source (soon)

Coal• Immature•Concurrency is difficult

04/21/23Soar Technology, Inc.17

top related