Multimedia Data Processing Elements Multimedia Data Processing Elements for Digital TV and Multimedia Services for Digital TV and Multimedia Services

in Home Server Platformin Home Server Platform

MinteMinte ChenChen

IEEE Transactions on Consumer Electronics, Vol. 49, No.1, FEBRUARY 2003

IEEE Transactions on Consumer Electronics, Vol. 50, No.3, AUGUST 2004

IEEE Transactions on Consumer Electronics, Vol. 49, No. 3, NOVEMBER 2003

Why digital TV not analog TV?Why digital TV not analog TV?

Conventional TV:Conventional TV:4:3 aspect ratio4:3 aspect ratioLimited resolution Limited resolution Limit color fidelityLimit color fidelityFlickFlickColor mixingColor mixingAnalog transmission

Digital HDTV:• Wide screen 16:9 aspect ratio• High resolution (41000 Lines)• Digital sound (Dolby AC-3)• No artifacts• improve color fidelity• Digital transmission

Analog transmission

History of televisionHistory of television

First Monochrome Broadcast of Electronic Television in England, First Monochrome Broadcast of Electronic Television in England, 19361936Introduction of Color Television based on the three primary colIntroduction of Color Television based on the three primary colors, ors, ~1968~1968Digital Television is the next big revolution in television, ~2Digital Television is the next big revolution in television, ~2000000--20062006

mutlimedia standards converge under the digiTV standardsmutlimedia standards converge under the digiTV standardsservices can be experienced whenever, and wherever the services can be experienced whenever, and wherever the consumer wantsconsumer wantsenhanced quality, multiplication of channels, interactivitiy, enhanced quality, multiplication of channels, interactivitiy,

access to Internet servicesaccess to Internet servicesinteracting with content is the major issueinteracting with content is the major issue

TV TV -- a few Definitionsa few Definitions……

Digital Television:Digital Television:““transmitting a broadcast signal by encoding it as 0s and transmitting a broadcast signal by encoding it as 0s and 1s1s——the digital code used in computers. DTV can be the digital code used in computers. DTV can be compressed to provide four, five, or more channels in the compressed to provide four, five, or more channels in the same bandwidth required for one channel of the current same bandwidth required for one channel of the current standard television, better sound, and about five times standard television, better sound, and about five times more picture information (picture elements, or pixels) more picture information (picture elements, or pixels) than conventional televisionthan conventional television””

Comparison of Classic Analog and Comparison of Classic Analog and Modern Digital TVModern Digital TV

Digital TV requires many technological changes (e.g. Digital TV requires many technological changes (e.g. digital broadcast signal or digital production)digital broadcast signal or digital production)

Digital TV requires many new thoughts in how content Digital TV requires many new thoughts in how content models and service concepts models and service concepts

Program maps or schedules limit the possibilities of new Program maps or schedules limit the possibilities of new content and services in analog TVcontent and services in analog TV

The degree of freedom for the consumer (e.g. Internet The degree of freedom for the consumer (e.g. Internet access, additional home theatre likeaccess, additional home theatre like--equipment) is equipment) is higher in digital TVhigher in digital TV

DigiTVDigiTV Scenario: InScenario: In--House streamingHouse streaming

MPEG-2 TSMPEG-2 TS

1) DVB-SI1) DVB-SI

2) Feedback2) Feedback

3) MPEG-2 PSs3) MPEG-2 PSs LAN

Interaction Ch.Interaction Ch.

Various kinds of wired and wireless Various kinds of wired and wireless home network standardhome network standard

IEEE 1394:IEEE 1394:

"The Multimedia Connection""The Multimedia Connection"Speeds up to 400 Mbps Speeds up to 400 Mbps

Various kinds of wired and wireless Various kinds of wired and wireless home network standard (conthome network standard (cont’’d)d)

HomePNAHomePNA::is the highis the high--speed, reliable networking (LAN) technology speed, reliable networking (LAN) technology that uses the existing phone wires in your home to that uses the existing phone wires in your home to share a single Internet connection with several PCs in share a single Internet connection with several PCs in your home.your home.

PLC (power line communications):PLC (power line communications):The PLC is used to connect white appliances like The PLC is used to connect white appliances like microwave ovens, refrigerators ,and washing machines.microwave ovens, refrigerators ,and washing machines.

Concept of home server and home Concept of home server and home digital service environmentsdigital service environments

Architecture of home server platformArchitecture of home server platform

Block diagram of D-TV receiver module

Multimedia Codec ModuleMultimedia Codec Module

DD--TV receiver can send VGA (640*480 pixels/frame)TV receiver can send VGA (640*480 pixels/frame)The multimedia codec module reduces the resolutionThe multimedia codec module reduces the resolutionof the video data to common intermediate format of the video data to common intermediate format (352*288 pixels/frame) (352*288 pixels/frame) Should process at least 15 frames for CIF size videoShould process at least 15 frames for CIF size video(difficult to expect adequate quality of service)(difficult to expect adequate quality of service)Using a Using a DSPDSP and a field programmable gate arrayand a field programmable gate array((FPGAFPGA) to reduce the load on the main processor ) to reduce the load on the main processor and to support the required codec performance and to support the required codec performance continually.continually.

Main topic for this paperMain topic for this paper

Main processor broad can handle and manage all different signal ?

• In order to expect quality of service (QoS)

• Reduce the load on the main processor

• Main the required performance

HOW?

What is FPGAWhat is FPGA

FPGA (field programmable gate array):FPGA (field programmable gate array):

a type of logic a type of logic chipchip that can be programmed.that can be programmed.They are especially popular for prototyping They are especially popular for prototyping integrated integrated circuitcircuit designs.designs.Once the design is set, Once the design is set, hardwiredhardwired chips are produced for chips are produced for faster performance. faster performance.

How can we implement How can we implement program into FPGA program into FPGA

• Development Broad : Xilinx, Alter, etc. platform

• Development Tool (EDA): Cadence, Synopsys

Mentor Graphic (OSU)

• VHDL (Ｖery High Speed ICs Ｈardware ＤescriptionＬanguage )

Description Circuit and Synthesize and Simulation the design

FPGA is ? FPGA is ?

FPGA enough?FPGA enough?

IP Solution:

• IP (Intellectual Property ) core is hard to acquire

• Development tool not 100% exactly

• Real Hardware assembly conflict

Block diagram of multimedia codec module

Video input flowVideo input flow

Video output flowVideo output flow

Block diagram of the FPGA moduleBlock diagram of the FPGA module

• System and internal bus

• Connected by a multiplexer

•Data for current frame, previous frame, reconstruction frame can interface with DSP via the system memory

Architecture of open service platform

Home server platform

D-TV receiving result

(a) Received D-TV picture and (b) EPG browsing result

Architecture of instant message service

Configuration of home server side

Configuration of service provider side

ConclusionConclusion

Established the concept of a home server platform Established the concept of a home server platform Home server can present various multimedia services Home server can present various multimedia services and control various information appliances, at anytime and control various information appliances, at anytime and anywhere.and anywhere.It can manage all information within a home, and presentIt can manage all information within a home, and presentinformation communication methods among family information communication methods among family members.members.