T.Sharon-A.Frank
3
Modern Multimedia (1)
• The same story, information, etc, can be represented in different media:
– text, images, sound, animation, video …
• All media can be represented digitally as a structured collection of bits:
– manipulated by programs, stored, transmitted over networks …
• Digital media can be combined and integrated into multimedia.
T.Sharon-A.Frank
4
• Combination of media is actually commonplace (e.g., TV news) and natural – we perceive the world through all our senses at once.
• Novelty of digital multimedia is that all media can be treated as data.
• Programs can manipulate data in response to user input, so digital multimedia can be interactive.
Modern Multimedia (2)
T.Sharon-A.Frank
5
Characteristics of Modern Multimedia
Four necessary characteristics:
1. Digital Media
2. Multiple Media
3. Integrated Media
4. Interactive with Human Control
T.Sharon-A.Frank
8
Multimedia Workstation
CD-ROM
VoiceRecognition
Unit
SpeechSynthesis
Unit
Video
Graphics
FrameGrabber
Audio
x
Communication
Fax
Multimedia Overall Configuration
Videodisc player
CD-ROM
AUTHORING PLAYBACK
Video display card
Sound digitizer
Touch screen
Videodisc player
Speakers
Scanner
Removable media
T.Sharon-A.Frank
10
Desktop Multimedia Publishing
Camcorder, cameraor videodisc player
High qualityvideo card
Video or TV Monitor
Audio mixer CD-ROM
Sound digitizer
Videotape recorder
Speakers
T.Sharon-A.Frank
11
Multimedia Application Types
• Local MM– Stand-alone
• Networked and Distributed MM– Network based
– Group communication oriented
– Need QoS (Quality of Service)
T.Sharon-A.Frank
12
Online/Offline MM Delivery
• Online Delivery:– Uses a network (usually the Internet) to send
information from one computer to another.– Web is commonest form of online delivery of
multimedia.
• Offline Delivery:– Removable storage medium is used to carry the
data: CD-ROM, DVD.
T.Sharon-A.Frank
14
• Film: fixed order of frames defines a single playback sequence.
• Book: physical arrangement of text and pages implies a linear reading order.
Linearity
T.Sharon-A.Frank
15
• Hypermedia: links between pages permit multiple arbitrary reading orders.
• Flash: jumps between frames, controlled by interactivity, permits branching and loops.
Non-Linearity
T.Sharon-A.Frank
16
Hypertext
Hypertext is non lineartext. It reflects the way we think and write
---- definitions ---------------------------------------------models---------
Thinking Models Writing Models
Node
Link
T.Sharon-A.Frank
21
Communication History
Wheel 3200-3500
B.C
Paper105 AD
Printing Press1450s
Fax 1843
Telephone1876
Automobile~1900
Radio 1901
Powered Flight1903
Television1927
Computer1945
The Internet1973
http://www.cbc4kids.ca/general/the-lab/history-of-invention/default.html
T.Sharon-A.Frank
22
Boundaries Between: Computing, Communications and Entertainment
ComputingDevices
CommunicationDevices
ConsumerEntertainment
Devices
LANs & WANsPublic Switched
NetworkCATV &
Broadcast TV
T.Sharon-A.Frank
23
Multimedia Technology Fueling Convergence of Domains
Tele-computersComputer-based
Video conferencing
Video PhonesText-display
phoneInteractive TV
PortableComputers
TelephonesCellular phones
TelevisionsVCRs
ComputingDevices
CommunicationDevices
ConsumerEntertainment
Devices
LANs & WANsPublic Switched
NetworkCATV &
Broadcast TV
802.3, 802.5, x.25 POTS, ISDN Analog Coax
FDDI, ATM, 802.6 B-ISDN FTTC/FTTH
Multimedia in Communication Terms Media OrderMedia B/W
LinearPassiveBATCHY
Non-LinearInteraction
REAL-TIME
Low(10 B/S)
Text, DocumentsPlain BookGraphsLecture, SlidesVoice
Advanced Book + Index, CrossReferences, Photos, AppendicesVisual GlossarySlide Show + NarrationComputerized Chess Games
Medium(10 KB/S)
MapsGraphicsColor DisplayPhotographsRecorded AudioSound
Slide Show + musicAudiovisual ShowPinball MachinePersonal ComputerDesktop Publishing (DTP)Hypertext
High(10 MB/S)
GB/S???
TelevisionFilms (2D, 3D)VideoAudio +Moving VisualsBatch Multimedia
TV ZappingDesktop Video (DTV)Video GameMultimedia / HypermediaHigh Definition TV (HDTV)TeleconferencingVirtual Reality