designing triple-play apps using dsp resource boards amir zmora vp marketing & product...
TRANSCRIPT
Designing Triple-Play Apps Using DSP Resource BoardsDesigning Triple-Play Apps Using DSP Resource Boards
Amir ZmoraVP Marketing & Product
ManagementSurf Communication Solutions
Amir ZmoraVP Marketing & Product
ManagementSurf Communication Solutions
Agenda
• Voice and Video Market Trends• Operators Needs• Triple-Play in Action• Optimal Hardware System Architecture• Optimal Software System Architecture• Summary
Voice and Video Market Trends
Triple-Play Overview
• Currently different systems are used for each media type
o Telephone for voice (VoIP or PSTN)o Video system for video callso Data collaboration applications for data sharing
• In Triple-Play all 3 media types are combinedo Right-click on an e-mail to open a session (voice/video) with
sendero Seamlessly switch between voice-only and voice + videoo Share desktop and applications in same session o TVoIP/TVoDSL, VoD, PVR, DVR a single CPE box that will
handle all communication applications
The Drivers of Video Deployment
• Technology improvementso Better video codecs – H.263, MPEG4, H.264o Cheaper components – LCD screens, memoryo Processors are cheaper, better and require less powero Longer battery life for handheld devices
• Different networks that can now be convergedo Cellular – 3G (3G-324M)o Wireless – WiFi & WiMAX (SIP)o Wireline IP (SIP & H.323)o Wireline PSTN (H.324)
Cellular – 3G Services
• 3G is now in mass deploymento 156 commercial 3G operators in 70 countrieso 187M subscribers (CDMA & WCDMA)
• Source www.3gtoday.com July 2005
• Video streamingo V-Live of NTT DoCoMo – Real-Time TVo Video on demando Home/Business/Homeland security – Video surveillance
• Messaging & Presenceo IM, MMS, Video mail, PoCo Presence – Online/offline plus available for service X with
person Y
Cellular – 3G Services
• Conversational Multimediao Video Telephonyo PoC – Half-duplex communication
(Push-to-Talk, Show, View)
• Online multi-participant gameso Combine with Video to other partieso Combine with PoC
Wireless IP - WiFi & WiMAX
• WiFi (and WiMAX, in the future) will be integrated into mobile devices
• A mobile device will roam seamlessly between networkso In the office – Use WiFi as a terminal in office PBXo In the city – Use WiMAX if available for higher
bandwidth at lower priceo On the go – Use 3G cellular network
• Hence all services in cellular network will need to be available also in Wireless
Wireline IP
• Video is mainly used today in room systems with H.323 or ISDN BUT…
• Video is getting into the home and on the desktopo MSN Messengero Many SIP Video clientso STB (Set-top Boxes) with Video clients
• Both Siemens and Samsung showed this direction at Supercomm 2004
• D-Link i2eye has this product for more than a year - http://www.dlink.com/products/?pid=293
• Leadtek has IP, ISDN & PSTN Video phones http://www.leadtek.com/videophone.html
Wireline PSTN
• PSTN Video phones using H.324 have existed for years
o They had low Video qualityo They were expensive
• With the technology improvements these 2 issues have been solved
• Amstrad announced in September availability of its PSTN E3 Video Phone
• Service experiencing rapid deployment in Italy (HiTel and other phones)
Voice and Video Market Trends• Current deployment of Video is mainly in the
Enterprise & 3G Mobile segments• Deployment of Video over broadband and PSTN is
ramping up • Deployment facts
o NTT DoCoMo: Over 12.8M subscribers (May 2005)o Hutchison 3G: Over 8M subscribers (March 2005)o Skype to add Video (announced Oct 2004)o Vonage to add Video (announced Dec 2004)o 8x8 already provides Video (since June 2004)o VoicePulse to add Video (planned for H2/2005)o Video over PSTN in Italy, UK and other countries
Operators Needs
Operators Needs
• Connectivity between the different networks• Cross-networks services
o Voice/Video mailo Video portalo Multimedia servero Recording
• All applications must support packet-to-packet, TDM-to-packet, TDM-to-TDM
Operators Needs cont’d
• Since Video deployment demands are still relatively small compared to Voice deployment, flexible channel type assignment is required
• Price, Price, Price!o Smooth and flexible migration from Voice
systems to Voice and Video systemso Simple, synchronized, and balanced systems
DSP Farms:Moving from PTMC to AMC
PTMC AMC
PCI PCI Express
MII GB Ethernet
TDM Rapid I/O
Non hot swap Hot swap
Up to 15 Watt Up to 30 Watt
No defined control mechanism
Well-defined control mechanism in spec
Megs of traffic
10s of Megs in back plane
Gigs of traffic
10 Gig per AMC in back plane
Not ready for
new powerful
DSPs
Ready for
new powerful
DSPs
Voice & Video Gateway
DSPC64x
Host
Video Processing:Resolution Frame Rate
Bit Rate
RTP/RTCP Jitter
ECAN Tones
Detection/ Generation
Video Encode/ Decode
Voice Encode/ Decode
Media Processing-V.17/ V.34HD
Fax-T.32/ T.38
Modem-V.92/ V.34
Transport
Signaling
TDM H.223/ H.221 IP/ UDP
H.323 SIP3G-324MPRI/ BRI CAS
Applications
Voice & Video Gateway
DSPC64x
Host
Video Processing:Resolution Frame Rate
Bit Rate
RTP/RTCP Jitter
ECAN Tones
Detection/ Generation
Video Encode/ Decode
Voice Encode/ Decode
Media Processing-V.17/ V.34HD
Fax-T.32/ T.38
Modem-V.92/ V.34
Transport
Signaling
TDM H.223/ H.221 IP/ UDP
H.323 SIP3G-324MPRI/ BRI CAS
Applications
With Partners
Triple-Play in Action
Voice & Video Gateway
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
1. Call starts from the SIP Video Phone
H.26430 FPS
4CIF
Voice & Video Gateway
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
2. GW application configures Media Gateway according to destination and codec properties
H.26430 FPS
4CIF
Control
Voice & Video Gateway
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
3. Media goes directly to Media Gateway avoiding Host-DSP bottleneck
H.26430 FPS
4CIF
H.26310 FPS
CIF
MPEG410 FPSQCIF
Control
Voice/Video Gateway Application Requirements
• Interfaceso Simultaneous interfaces required: IP-IP, TDM-IP, TDM-TDMo C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one
IP address
• High Densityo Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP
• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and stack performed on the
DSP
Voice & Video Mail – Record/Play
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
1. SIP phone initiates a call to PSTN Video Phone. Call is routed to Voice/Video Mail.
H.26310 FPS
CIF
Voice & Video Mail – Record/Play
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
2. Media is buffered in DSP external memory to avoid host interrupts in 10/20 ms interval, then stored on host.
H.26310 FPS
CIF
Control
H.26430 FPS
4CIF
Voice & Video Mail – Record/Play
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
3. Voice/Video mail retrieved from mobile. Media is processed in DSP.
H.26310 FPS
CIF
Control
H.26430 FPS
4CIF
MPEG410 FPSQCIF
Messaging Application Requirements
• Interfaceso Disk Host DSP Network (Simultaneous IP/PSTN)o C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one
IP address• Temporary Storage
o Allows keeping commonly-used messages in memory (IVR)o Allows buffering to avoid host interrupts in 10/20ms
intervals (voice block size)• High Density
o Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP
Messaging Application Requirements
• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and
stack performed on the DSP
• Transporto Reliable Host-DSP over UDP (“TCP light”)
Voice & Video Conferencing
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
1. Each party in the conference calls in. Different protocols and media properties are supported.
H.26310 FPS
CIF
H.26430 FPS
4CIF
MPEG410 FPSQCIF
Voice & Video Conferencing
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
2. DSP is configured to create a channel for each voice/video party.
H.26310 FPS
CIF
Control
H.26430 FPS
4CIF
MPEG410 FPSQCIF
Voice & Video Conferencing
IP
Mobile PSTN
H.324 Video Phone
3G-324M Video Phone
Voice & Video GW
Media processing
board
SIP Video Phone
SIP Video Phone
3. An output channel is created for each party that requires voice/video/H.223/RTP processing.
H.26310 FPS
CIF
Control
H.26430 FPS
4CIF
MPEG410 FPSQCIF
Voice/Video Conferencing Application Requirements
• Interfaceso Simultaneous interfaces required: IP-IP, TDM-IP, TDM-TDMo C64x has native interfaces to IP, TDMo Each DSP has an Ethernet I/F requiring aggregation to one
IP address
• High Densityo Powerful DSPo Separate control and media patho Network aggregation is done using an IP switcho H.223 runs on DSP
Voice/Video Conferencing Application Requirements
• Media Processingo H.263, H.264, MPEG4o G.729, G.723, AMR…o All voice/video/fax/data media processing and
stack performed on the DSPo Voice/Video should be transmitted to each party
according to its:• Voice codec properties• Video codec properties• Transport & interface – IP/TDM (H.223)
Optimal Hardware System Architecture
Definition of Terms
• Hardware Frameworko DSPo Routing deviceo Aggregation deviceo System controller
• Software Frameworko DSP algorithmso DSP frameworko Diagnostics systemo Expert analysis system
DSP Requirements
Prerequisites:• External SD-RAM• Packet interface• High enough performance to enable video
processing• Wide range of reliable software vendors
C6412, New C64xxC6412, New C64xx
Interface between DSP and Network Aggregation Unit
• With a Host Port Interface (HPI, PCI…), all the DSPs are connected to the same bus. A slow retrieval from one DSP can cause delay in other DSPs (the butterfly effect).
• Using an Ethernet interface, the DSPs have independent communication routes.
DSP2
DSP3
DSP1
DSP2
DSP3
DSP1
Interface between DSP and Network Aggregation Unit
Interface between Host and DSP
• A DSP with small memory needs to send/receive small chunks of data to/from the Host at a high rate. This inflicts severe stress on the Host and is particularly important for messaging solutions.
• Use DSPs with large external memory. The external memory can be used as temporary storage, enabling the Host to send/receive larger chunks of data less frequently.
Aggregation Unit Bottleneck:
Payload and Control Handling
• Network aggregation and control application compete for the same resources.
• Separate control and media paths. For example: Use IP interconnections between DSPs, Host and Network.
Optimal Software System Architecture
Optimizing the Software Framework
• Interoperability/Testing
• Open Framework
• Flexible APIs
• Remote diagnostics
Interoperability and Testing
• Solution components must be field-hardened & interoperable (signaling interop is not enough)
o Voice Codecso Video Codecso H.223/H.221o T.38o Echo Cancellero Modem
• Critical components need constant supporto Echo Cancellero Modem
• Tools needed for diagnostics extraction from deployed systems
What is an Open Framework?
• A solution that enables manufacturers to add media processing algorithms to their platforms simply and quickly o A few basic APIs to “hook” the third party algorithmo Algorithm can be
• Proprietary Voice/Video codecs• New transport protocols
• Density, performance and cost should not be compromised in order to provide an open solution.
Why Move to an Open Framework on Your DSP?
• Be ready for the “killer application”• Support for new features • Allow multiple vendors to interface with your
product technology• Differentiate your product • Reduce DSP maintenance and support fees
from your software vendor
Flexible APIs
•Full control over ALL media type parameters•Pre-set defaults•Video example
o User defined screen layouto Logo insertiono Background/Foreground manipulationo Multiple layer pictureo Any resolution supporto Cropping & resizingo Same stream can be encoded in different formats/bit
rates/resolutions simultaneously
Remote Diagnostics
• 75% of cost of solving issues in the field is related to the extraction of diagnostics
• Need to be able to extract all the necessary diagnostics
• Diagnostics should be part of the release version• Diagnostics should be enabled/disabled on a per-
service/per-DSP/per-port basis• Minimize load on network interface by sending large
packets• Predictable impact, of enabling diagnostics, on
system performance
Summary
Technical Requirements
• One media processing system for all media typeso Same HW (board & DSP) must run all media typeso Easier synchronization between Voice and Videoo More balanced systemo Less load on system bus
• Must include a robust Voice solution• Powerful DSP that can handle Voice + Video.
And: o External SD-RAMo Packet interface
Technical Requirements cont’d
• Separate media and control patho Requires TDM and IP DSP interfaceso Eliminates Host-DSP bottlenecko Reduces load on host processor
• Open Frameworko Allows legacy/proprietary algorithms to be
“plugged-in” to DSP
• High capacity DSP farm• Support latest form factors
o PTMC (cPCI) AMC (ATCA/MicroTCA)