Multimedia System

Text No. 1 Chapter 4

What is Multimedia? • Multimedia is a medium that includes the following four factors:

– Digitisation• Of audio, images and other information besides characters and numeric values,

high-quality and easy-to-process information can be integrated and used.

– Networking• Through the interconnection of computers using communication lines such as

optical fiber, large amounts of information can be exchanged accurately at high speed.

– Interactivity• As with the telephone, bi-directional interactive processing with a high response

level can be performed.

– Inclusion of human interfaces• Diverse types of information can be naturally and easily handled.

Multimedia

Multimedia

• Multimedia technology is not a single technology, but rather a collection of technologies for manipulating– Text (characters, digits, symbols)– Graphics (including images and animation)– Audio– Video

TEXT

• Characters that are used to create words, sentences, and paragraphs, is a fundamental element used in many multimedia applications.

• Different text sizes, fonts, colour or styles may be used to emphasis the text.

GRAPHICS

• A graphic, or graphic image or still graphical image, such as drawing, chart, or photograph.

                                                                                                                             

ANIMATION

• Displays a series of still graphics in sequence to give the look of movement.

AUDIO

• Music, Speech, or any other sound.

VIDEO• Photographic images played at speeds of 15 to 30 frames

per second (RM, MPEG, AVI, ASF, DVIX formats)

LINKS

• Interactive Multimedia is a multimedia application that accepts input from the user by means of the keyboard or pointing device such as a mouse, and performs some action in response– interactive links

Amazon.comMicrosoft

USQ

Multimedia Services

• The services provided to the users of multimedia systems

• Application examples of multimedia service– Business field

– Medical care field

– Publication field

– Education field

– Game field

– Interface technology

– Software production technology

Multimedia Education

Multimedia Entertainment

Multimedia Platform

• Hardware– Display device– Image scanner– Video equipment– Audio equipment– Digital sound equipment– Pointing device– Storage medium– Modem

Multimedia Platform

• Operating System– GUI adoption– Multi-task implementation– Provision of network functions– Provision of multimedia functions

Multimedia Platform• Creation of multimedia titles

– Editing software– Image

• Still image• Animated image

– Audio– Graphics – Authoring tools

• Graphics drawing and editing• Graphics painting and editing• Image tools• Audio/video tools

– HyperText• Browser UI technology is based on HyperText standards

Multimedia Technology

• Artificial Intelligence (AI)

• Pattern recognition (OCR)

• Artificial Reality/Virtual Reality/ Computer Graphics (AR/VR/CG)

• Agent (knowledge base)

Agents/Bots

Multimedia Applications

Pattern recognition• Voice pattern recognition

– Phoneme recognition processing – voice recognition, user-voice analysis– Word recognition processing – online dictionary look-ups– Language processing – ‘meanings’ attached to tone, diction, volume– AI technology to exclude ‘dog words’

• Image pattern recognition (OCR)– Image input processing– Image recognition preparation processing

• Noise elimination, data emphasis, colour adjustment– Characteristics extraction processing

• Text versus graphics• Language

– Partial recognition processing• Candidate extraction

– Total recognition processing• Candidate confirmation

Synthesis of voice and image

• Technology to create (synthesize) voices and images• Voice synthesis technology

– Editing method (edits recorded voices and creates specified documents or conversations – disharmony sometimes apparent)

– Analysis method (analyse, encode and store as information, then stored – household appliances, elevators)

– Rule-based method (analyse and establish rules of patterns – change base tones)

• Image synthesis method1. Creation of the original picture (geometric representation, wire

frame model, surface model)2. Shape change (correction in 3-dimensions)3. Image display (display in 3-dimensions, light source, shading,

filtering and other adjustments)

Multimedia Application System

• Internet broadcasting• Nonlinear image edit system

– Video tape editing – linear editing– Softcopy editing – non-linear, data compression,

previews

• Video-on-demand– Full control of viewing on-the-fly (personalised

viewing), not just channel switching

• Other application systems

Benefits of Multimedia

• Easy to understand and easy to use

• Integrated and interactive

• Conducive to cooperative work environment

• Flexible

• Supportive of large audience

IT Education and Multimedia

Congratulations!