multiple input/output connector shalini agarwal oxygen conference january 8 th, 2002

Multiple Input/Output Connector

Shalini Agarwal

Oxygen Conference

January 8th, 2002

2

L C S



Shalini Agarwal

Oxygen Workshop, January, 2002

3

L C S


Agenda

• Goals

• Desired Functionality

• Valid Inputs/Outputs

• System Overview

• Multiple Output Demo

• Future Work

4

L C S


Goals

• Scenario: Multiple input devices; multiple applications

• Challenge: Route input to correct application

• Flexible design– Dynamically add input devices (and output)

– Basic socket design to allow for different applications

• Transparent use of different inputs and outputs

5

L C S


We want three types of functionality

SingleInput

Multiple Output Applications

MultipleInputs

Single OutputApplication

MultipleInputs

Multiple Output Applications

• Single input, Multiple output

• Multiple input, Single output

• Multiple input, Multiple output

6

L C S


What kind of input can we accommodate?

• Not all input modes are compatible, but some are:– Speech can be converted to text

– Palm Pilot graffiti can be converted to text

– T9 converts numbers to text

• Implicit input such as body gestures and facial expressions cannot be converted to text– Outside the scope of this project stage

7

L C S


Issues Involved – Input Side

• Understanding different input types– Inherent differences in information world

• Processing method– Can it be generic?

– How much customization is required?

8

L C S


What kind of output can we accommodate?

• We must be able to control the application through another program so that our event handler can do the action requested by the input

• Must take in at least one of the inputs that fit the input requirements

9

L C S


Issues Involved – Output Side

• Choosing the output node– Similar output applications could lead to the wrong decision.

– What if two applications want the input? How should we define how many connections to make?

• Different output formats– How much customization is required for each application?

10

L C S


First Generation: Putting input and output together

Appl. 1 Appl. 2 Appl. 3

Speech Speech Speech

11

L C S


Second Generation: Switchbox Approach

Appl. 1 Appl. 2 Appl. 3

Speech Speech Speech

Switchbox

12

L C S


Third Generation: Processing Input, Choosing Output

Events

Appl. 1Appl. 2

Appl. 3

SpeechKeyboard T9

13

L C S


Mutiple Output Demo

• Speech Input

• Multiple speech domain applications– Broadcast speech messages

– Choose the best fit

– Allows for controlling different layers

• Galaxy speech processing system

14

L C S


Use Galaxy Components Individually

• Utilizing server within Galaxy hub to access individual components

Hub

Recognizer Natural Language Processor

Other Inputs

• We can add processing of other inputs by using the natural language processing component of the Galaxy Galaxy speech processing system system– Consistent method of

choosing correct output

– Modular functionality

15

L C S


Multiple Output Demo Diagram

Appl. 1Appl. 2

Appl. 3

Speech

Processing

Galaxy Hubs

16

L C S


Future Work

• Error tolerant system– Requires understanding of valid input and output types

• Modular– Hard because each input modality requires different type of

processing

– Plug and play?

multiple input/output connector shalini agarwal oxygen conference january 8 th, 2002

Documents