![Page 1: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/1.jpg)
Multimedia Data Processing Elements Multimedia Data Processing Elements for Digital TV and Multimedia Services for Digital TV and Multimedia Services
in Home Server Platformin Home Server Platform
MinteMinte ChenChen
IEEE Transactions on Consumer Electronics, Vol. 49, No.1, FEBRUARY 2003
IEEE Transactions on Consumer Electronics, Vol. 50, No.3, AUGUST 2004
IEEE Transactions on Consumer Electronics, Vol. 49, No. 3, NOVEMBER 2003
![Page 2: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/2.jpg)
Why digital TV not analog TV?Why digital TV not analog TV?
Conventional TV:Conventional TV:4:3 aspect ratio4:3 aspect ratioLimited resolution Limited resolution Limit color fidelityLimit color fidelityFlickFlickColor mixingColor mixingAnalog transmission
Digital HDTV:• Wide screen 16:9 aspect ratio• High resolution (41000 Lines)• Digital sound (Dolby AC-3)• No artifacts• improve color fidelity• Digital transmission
Analog transmission
![Page 3: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/3.jpg)
History of televisionHistory of television
First Monochrome Broadcast of Electronic Television in England, First Monochrome Broadcast of Electronic Television in England, 19361936Introduction of Color Television based on the three primary colIntroduction of Color Television based on the three primary colors, ors, ~1968~1968Digital Television is the next big revolution in television, ~2Digital Television is the next big revolution in television, ~2000000--20062006
mutlimedia standards converge under the digiTV standardsmutlimedia standards converge under the digiTV standardsservices can be experienced whenever, and wherever the services can be experienced whenever, and wherever the consumer wantsconsumer wantsenhanced quality, multiplication of channels, interactivitiy, enhanced quality, multiplication of channels, interactivitiy,
access to Internet servicesaccess to Internet servicesinteracting with content is the major issueinteracting with content is the major issue
![Page 4: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/4.jpg)
TV TV -- a few Definitionsa few Definitions……
Digital Television:Digital Television:““transmitting a broadcast signal by encoding it as 0s and transmitting a broadcast signal by encoding it as 0s and 1s1s——the digital code used in computers. DTV can be the digital code used in computers. DTV can be compressed to provide four, five, or more channels in the compressed to provide four, five, or more channels in the same bandwidth required for one channel of the current same bandwidth required for one channel of the current standard television, better sound, and about five times standard television, better sound, and about five times more picture information (picture elements, or pixels) more picture information (picture elements, or pixels) than conventional televisionthan conventional television””
![Page 5: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/5.jpg)
Comparison of Classic Analog and Comparison of Classic Analog and Modern Digital TVModern Digital TV
Digital TV requires many technological changes (e.g. Digital TV requires many technological changes (e.g. digital broadcast signal or digital production)digital broadcast signal or digital production)
Digital TV requires many new thoughts in how content Digital TV requires many new thoughts in how content models and service concepts models and service concepts
Program maps or schedules limit the possibilities of new Program maps or schedules limit the possibilities of new content and services in analog TVcontent and services in analog TV
The degree of freedom for the consumer (e.g. Internet The degree of freedom for the consumer (e.g. Internet access, additional home theatre likeaccess, additional home theatre like--equipment) is equipment) is higher in digital TVhigher in digital TV
![Page 6: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/6.jpg)
DigiTVDigiTV Scenario: InScenario: In--House streamingHouse streaming
MPEG-2 TSMPEG-2 TS
1) DVB-SI1) DVB-SI
2) Feedback2) Feedback
3) MPEG-2 PSs3) MPEG-2 PSs LAN
Interaction Ch.Interaction Ch.
![Page 7: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/7.jpg)
Various kinds of wired and wireless Various kinds of wired and wireless home network standardhome network standard
IEEE 1394:IEEE 1394:
"The Multimedia Connection""The Multimedia Connection"Speeds up to 400 Mbps Speeds up to 400 Mbps
![Page 8: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/8.jpg)
Various kinds of wired and wireless Various kinds of wired and wireless home network standard (conthome network standard (cont’’d)d)
HomePNAHomePNA::is the highis the high--speed, reliable networking (LAN) technology speed, reliable networking (LAN) technology that uses the existing phone wires in your home to that uses the existing phone wires in your home to share a single Internet connection with several PCs in share a single Internet connection with several PCs in your home.your home.
PLC (power line communications):PLC (power line communications):The PLC is used to connect white appliances like The PLC is used to connect white appliances like microwave ovens, refrigerators ,and washing machines.microwave ovens, refrigerators ,and washing machines.
![Page 9: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/9.jpg)
Concept of home server and home Concept of home server and home digital service environmentsdigital service environments
![Page 10: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/10.jpg)
Architecture of home server platformArchitecture of home server platform
![Page 11: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/11.jpg)
Block diagram of D-TV receiver module
![Page 12: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/12.jpg)
Multimedia Codec ModuleMultimedia Codec Module
DD--TV receiver can send VGA (640*480 pixels/frame)TV receiver can send VGA (640*480 pixels/frame)The multimedia codec module reduces the resolutionThe multimedia codec module reduces the resolutionof the video data to common intermediate format of the video data to common intermediate format (352*288 pixels/frame) (352*288 pixels/frame) Should process at least 15 frames for CIF size videoShould process at least 15 frames for CIF size video(difficult to expect adequate quality of service)(difficult to expect adequate quality of service)Using a Using a DSPDSP and a field programmable gate arrayand a field programmable gate array((FPGAFPGA) to reduce the load on the main processor ) to reduce the load on the main processor and to support the required codec performance and to support the required codec performance continually.continually.
![Page 13: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/13.jpg)
Main topic for this paperMain topic for this paper
Main processor broad can handle and manage all different signal ?
• In order to expect quality of service (QoS)
• Reduce the load on the main processor
• Main the required performance
HOW?
![Page 14: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/14.jpg)
What is FPGAWhat is FPGA
FPGA (field programmable gate array):FPGA (field programmable gate array):
a type of logic a type of logic chipchip that can be programmed.that can be programmed.They are especially popular for prototyping They are especially popular for prototyping integrated integrated circuitcircuit designs.designs.Once the design is set, Once the design is set, hardwiredhardwired chips are produced for chips are produced for faster performance. faster performance.
![Page 15: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/15.jpg)
How can we implement How can we implement program into FPGA program into FPGA
• Development Broad : Xilinx, Alter, etc. platform
• Development Tool (EDA): Cadence, Synopsys
Mentor Graphic (OSU)
• VHDL (Very High Speed ICs Hardware DescriptionLanguage )
Description Circuit and Synthesize and Simulation the design
![Page 16: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/16.jpg)
FPGA is ? FPGA is ?
![Page 17: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/17.jpg)
FPGA enough?FPGA enough?
IP Solution:
• IP (Intellectual Property ) core is hard to acquire
• Development tool not 100% exactly
• Real Hardware assembly conflict
![Page 18: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/18.jpg)
Block diagram of multimedia codec module
![Page 19: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/19.jpg)
Video input flowVideo input flow
![Page 20: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/20.jpg)
Video output flowVideo output flow
![Page 21: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/21.jpg)
Block diagram of the FPGA moduleBlock diagram of the FPGA module
• System and internal bus
• Connected by a multiplexer
•Data for current frame, previous frame, reconstruction frame can interface with DSP via the system memory
![Page 22: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/22.jpg)
Architecture of open service platform
![Page 23: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/23.jpg)
Home server platform
![Page 24: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/24.jpg)
D-TV receiving result
(a) Received D-TV picture and (b) EPG browsing result
![Page 25: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/25.jpg)
Architecture of instant message service
![Page 26: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/26.jpg)
Configuration of home server side
![Page 27: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/27.jpg)
Configuration of service provider side
![Page 28: Multimedia Data Processing Elements for Digital TV and ...web.engr.oregonstate.edu › ~thinhq › teaching › ece599 › Digital_TV.pdfMultimedia Codec Module D-TV receiver can send](https://reader034.vdocuments.us/reader034/viewer/2022042407/5f22330eb4c17525697f5dae/html5/thumbnails/28.jpg)
ConclusionConclusion
Established the concept of a home server platform Established the concept of a home server platform Home server can present various multimedia services Home server can present various multimedia services and control various information appliances, at anytime and control various information appliances, at anytime and anywhere.and anywhere.It can manage all information within a home, and presentIt can manage all information within a home, and presentinformation communication methods among family information communication methods among family members.members.