t.sharon-a.frank 1 multimedia various applications

T.Sharon-A.Frank1

Multimedia

Various Applications

2T.Sharon-A.Frank

Contents

• E-mail, MM-Mail and Internet Fax

• Voice Response Systems

• Computer Messaging Services

• A/V Streaming

• Video On Demand (VOD)

• Video/Multimedia Conferencing

• Virtual Reality (VR)

3T.Sharon-A.Frank

Had enough of S-mail!?

4T.Sharon-A.Frank

Multimedia Mail Scenario

CommercialE-Mail “Cloud”

Service

E-Mail to Voice

ProtocolConversion

Phone Booth

Wide Area NetworksMac

UnixBased

System

Remote Mainframe

Local Network – PC

5T.Sharon-A.Frank

E-mail – Killer Application!?

6T.Sharon-A.Frank

Multimedia Mail

7T.Sharon-A.Frank

Multimedia Mail Challenges

• Incorporate Generators/Viewers

• Massive Storage Space

• Different Standards – Interoperability– different media formats

– different platforms

– different protocols

8T.Sharon-A.Frank

MIME Overview

• MIME (Multipurpose Internet Mail Extension):

– Unlimited Text Line Length or Overall Length

– Character Sets other than ASCII

– Binary or Application Specific Files

– Multiple Objects in a Single Message

– Images, Audio, Video Attachments

9

• Need to identify the type of media data in a data stream in a platform-independent way.

• Originally designed to allow inclusion of data other than text in email, adopted by HTTP.

• Content-type: type/subtype.

• Types include text, image, audio, video, application, subtypes define specific formats.

– e.g. text/html, image/gif

MIME Types

10T.Sharon-A.Frank

Example MIME Types

Text• example subtypes: plain, html

Image• example subtypes: jpeg, gif

Audio• example subtypes: basic (8-bit mu-law encoded), 32kadpcm (32 kbps coding)

Video• example subtypes: mpeg, quicktime

Application• other data that must be

processed by reader before “viewable”

• example subtypes: msword, octet-stream

11T.Sharon-A.Frank

Six top-level MIME types and some common subtypes

12T.Sharon-A.Frank

Mail message format

step: protocol for exchanging email messages

RFC 822: standard for text message format:

• header lines, e.g.,– To:– From:– Subject:different from SMTP

commands!• body

– the “message”, ASCII characters only

• line containing only `.’

header

body

.

blankline

13T.Sharon-A.Frank

Message format: multimedia extensions

• MIME: multimedia mail extensions, RFC 2045, 2056• Additional lines in message header declare MIME

content type.

From: alice@crepes.fr To: bob@hamburger.edu Subject: Picture of yummy crepe. MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Type: image/jpeg

base64 encoded data ..... ......................... ......base64 encoded data .

multimedia data

type, subtype, parameter

declaration

method usedto encode data

MIME version

encoded data

14T.Sharon-A.Frank

Mail Types

• Compound Mail– Includes text, graphics and/or images

– All attachments are printable

• Multimedia Mail– Explicit Inclusion – all media included

– Implicit Inclusion – only links to media

15T.Sharon-A.Frank

ManagementServer

MessagingServer

Internet Desktop Fax Service

Telephony Server & PSTN Gateway

NSP

REGION BREGION B

REGION AREGION A

REGION CREGION C

..

..

..

INTERNETINTERNET

Point to point Broadcast

16T.Sharon-A.Frank

Example: Desktop Fax Service: Netcentric User Interfaces

Web BrowserWeb Browser PC ClientPC Client

SendSend

StatusStatus

17T.Sharon-A.Frank

Why use Voice Response Systems?

18T.Sharon-A.Frank

Voice Response Systems

Integrated Computer-Assisted Voice Response SystemIntegrated Computer-Assisted Voice Response System

ICA-VRSICA-VRS

Demo: Kolnoaphone.wav

19T.Sharon-A.Frank

Model of Voice Response System

UsersOffice

Central computer

data

System computer

Management

reportsFax

Phone

Voice Response Hardware

20T.Sharon-A.Frank

Voice Response System – Hardware

• A/D – D/A Conversion

• Audio Compression

• Multi-line Phone Interfaces

• Tones Recognition

• Fax Interface

• Voice Recognition

21T.Sharon-A.Frank

Enabled Solution: Intelligent Answering

Application Host

Telephone System

“Hello…”

Sales

Service

Marketing

• Improved Productivity

• Reduced Cost

• Enhanced Service

• Enhanced Workflow

Calling Number

Called Number

22T.Sharon-A.Frank

Enabled Solution: Computer Assisted Dialing

ApplicationHost

TelephoneSystem

Customer Service

Marketing

Collections

• Efficient Call Processing

• Improved Productivity

• Increased Revenue

Office

Home

23T.Sharon-A.Frank

Computer Messaging Services

24T.Sharon-A.Frank

Messaging and e-Learning

25T.Sharon-A.Frank

Personal Assistance Services

• Single Number Service (SNS)

• Single computerized address book

• Single message box (email, voice message, fax, beeper)

• Voice Activated Dialing (VAD)

26T.Sharon-A.Frank

Single Access to all Services

27T.Sharon-A.Frank

Messaging Models

• Integrated Messaging

• Unified Messaging

28T.Sharon-A.Frank

Telephone SystemE-Mail System

Integrated Messaging

• All messages are copied to the E-Mail system and vice versa.

• Gives instant access from either the PC or the phone.

• Increase network traffic between the two systems.

Storage Storage

29T.Sharon-A.Frank

Unified Messaging

Telephone SystemE-Mail System

• All the messages reside in the same place.

• Simplifies system and data management.

• Phone access may be slower.

Storage

Store

Retrieve

30T.Sharon-A.Frank

Unified Messaging Characteristics

• Unified Mailbox for– Voice

– Fax

– E-mail

• Translators – E-mail to Speech

– Fax to E-mail

– etc.

• Address Book– unique for all types– immediate forward of

messages

• Web based– easy to use– activate from any PC

• E-mail notification

31T.Sharon-A.Frank

Example of usingweb-browser

for voice messages

32T.Sharon-A.Frank

Summary: Unified vs. Integrated Messaging

Unified Messaging Integrated Messaging

Possible delays in accessingmessages from the phone

Instant access to all messages fromthe phone

All data resides in one place Data is replicated between voice andE-mail boxes

When E-mail system is down,voice mail is not accessible

When E-mail system is down, voicemail is still accessible

Voice mail system is simplifiedto be a telephony server;no message store required

Voice mail system is more complex -includes a message store

33T.Sharon-A.Frank

Additional Messaging Applications

• Instant Messaging & Presence (IM&P)– IM: ICQ, AOL Instant Messenger, Yahoo Messenger,

MSN Messenger– P: SIP/SIMPLE, Jabber/XMPP

• Wireless/Mobile Internet– WAP1 (Wireless Application Protocol) & WML (Wireless

Markup Language)– WAP2 & XHTML – SMS (Short Messaging Services) & MMS (Multimedia

Messaging Services)• Interactive TV

– Digital TV– Internet TV

34T.Sharon-A.Frank

Mobile IM&P

35T.Sharon-A.Frank

Mobile Searching in Google

36

Car MM Display

37

MyFord Touch Navigation (1)

38

MyFord Touch Navigation (2)