mips track a

Israel, May 4, 2010© 2010 MIPS Technologies, Inc. Proprietary and Confidential

MIPS TechnologiesDriving the Next Generation

of Connected Devices

May 2010


Number One Market Share

Number One in Digital Home CPUs

*IDC Research, 2008 embedded processor share

Digital TV

Cable, Satellite & IPTV Set-top Boxes

Blu-ray Disc Players

DVD; DVR

Digital Cameras

Broadband CPE

WiFi Access Pointsand Routers


Market Trends

AnalogTV

DigitalTV DVR

WalledGardenInternet

Connected TV

•OSD•Channel Changer

•Remote Control

•Single Pipe•Stream Processing

•Decryption

•Big UI•Disk OS•Simple Encryption

•Simple Browser

•Multi-Pipes•Multi-Decryption

•“Invisible” SW• Widget-based Internet

• Encryption

• Open platform• Full web experience•User installed apps•Dynamic Decryption•Full network connectivity•Ad-hoc networking •Transcryption•Transcoding

1990’s 2015


Watch Anytime

A Changing Consumer Experience:New Usage Model for Content Viewing

• VCR

• PVR/DVR

• On-Demand

• SlingBox

• iTunes/iPod

• Mobile Video

Watch Anywhere

• Online content

• Digital media

Watch Anything


SW is Driving HW Requirements for Digital Home

FloatingPointandDSP

2D/3DGraphics

VideoEncodersDecoders

MCU

Security

MCU

MIPS32®

OS & AppProcessor

MemorySubsystem


Connected Digital Home Software Architecture

PVR AppHD

Player AppTV Widget

StreamingApp

DRMsCAs

AudioµCode

VideoµCode

DemuxµCode

IPUMIPS

Security CPU

Audio DSPs

VideoDecoders

MIPSCPU

PeripheralI/O MIPS-based SoC

AndroidApp

AndroidApp

AndroidApp

Android Libraries

DVR/VODConditional

Access

Linux Kernel 2.6.29

VoIP

Yahoo!Widget Engine 3rd

PartyMiddleware

WebKit

Android Application Framework

Adobe®FlashFor

DigitalHome

Dalvik VM

Core Libraries


Platform Optimizations for Digital Home and Beyond

• Android on MIPS development for mobile devices and the digital home

• Collaborating with Adobe to optimize Flash Player 10.1 for MIPS

• Leveraging Yahoo! TV Widgets for MIPS-Based DTV

Platforms


MIPS Taking the Lead in Driving Android into Connected Consumer Devices

Brought full 1080p HD video and

multi-channel audio support

to Android

3,000+ members of

Android on MIPS Community

Coming soon -- Adobe Flash

Player 10, V8 & Dalvik JITAndroid on MIPS

code publicly available

5,000+ downloadsto-date

Official reference ports for multiple

OESF working groups

Delivered DLNA and

remote control

support to Android

Demonstrated 1st Android devices for the digital

home


Video Use Case

Calling

Accept Deny Forward


DTV/STB Use Case: Simultaneous tasks

summarymain forground activitiesbroadcast [incl. DVR]Full Internet BrowsingVideo ConferencingStreamed Internet Content

additional forground activitesOSDWidgetsBroadband Radio

additional background activities

Broadcast PVR (second tuner)Broadband AV downloadVideoCall monitoringAV IO hanlding

double window


Digital Home Block Diagram

L2

CM

1004K 1004K 1004K 1004K

OCP (64-bit Data)

Mem Controller

2D/3DGraphics

VideoDecode

Audio

Multiport

DDR2/3

256

64

64

64

IOCU

Display

USB

GPIO Tuner

AHB

Security

DMA

Power Management

Clocks

Flash

OpenGL ES 2.0 Dual 1080p

Sonics

Mem Scheduler

1920 x 1080


Developing New SoCs: Recommended Hardware Requirements

Core only Core + HW AV codecs

Core + Graphics +

HW AV codecs

Android 2.0

Éclair

320x480

500MHz 24Kf

450MHz 34Kf

400MHz 24Kf

360MHz 34Kf

333MHz 24Kf

300MHz 34Kf

Qt/Android on STB

1080p

Not recommended(full frame rate 1080p video decode not possible)

667MHz 74Kf500MHz 1004Kf

(2 cores)

667MHz 24Kf

600MHz 34Kf

Flash 10 for Digital Home(1080p support)

Not recommended(full frame rate 1080p video decode not possible)

Not recommended(Flash 10 for Digital Home requires OpenGL ES 2.0)

1GHz 74Kf700MHz 1004Kf (2 core)

Estimated Requirements – 2010


Bandwidth Problem

• Many devices competing for access with different characteristics– CPU – requires low latency for optimal performance. – GPU/Video – High bandwidth, more latency flexibility– Display Controller – Lower bandwidth, hard time

restrictions

• Memory Bandwidth vs. Cost• Need to efficiently handle devices• Want to gracefully saturate in manner least

disruptive to user


CPU / Graphics bandwidth assumptions

CPU Memory BW Requirements

Task Web Render Compute Misc

L2 Misses / 1000 Instr 8 3 3

Instructions / Cycle 0.5 0.7 0.5

L2 Cacheline size

Core Frequency Mhz

Total 102 54 38 MB/sec

800

256 KB L2

effective ipc

Bytes

Comments

32

Memory BW AvailableParameter Value Comments

Memory Width 64 bits

DDR clock rate 200 Mhz

Data Rate 400 (2 x clock rate)

Total 3200 MB/sec

Display resolution Local Graphics Memory Buffer Enabled

Parameter Value NO

x - pixels 1920y - pixels 1080

color depth 16Single frame 4147.2 KB Display Controller Bandwidth

Total 248.832 MB/sec 60Hz Refresh Rate

1920x1080 display resolution

Quad core 1004K with 256MB L2

Low Cost DDR2-400


Memory Bandwidth Analysis

Memory BW Consumption

(peak)graphics 622.08 0 622.08

video 1 1 0

300 300

misc (audio, 3G, …) 2 2 2

CPU(s) 141 77 146

Display 249 249 249

Total Mem BW 1315 629 1019

Peak Mem BW 3200 3200 3200

Peak Utilization 41% 20% 32%

Component

MB/sec

Workload

video gaming

Enter Display resolution below

6 channels @ 96khz / 7.2 Mbps download

MB/sec

Comment

Rightware samurai 3d demo @ 30 frames/seccompressed DVD quality input

decode mpeg2 video (720x480 30fps) or H.264 w/ 2 buf


System Bandwidth Requirements

L2

CM

1004K 1004K 1004K 1004K

OCP (64-bit Data)

2D/3DGraphics

VideoDecode

Audio

256

64

64

IOCU

Display

USB

GPIO Tuner

AHB

Security

DMA

Power Management

Clocks

Flash

600 MB/sec

249 MB/sec100 MB/sec

Mem Controller

64

Mem Scheduler

1920x1080

Multiport

DDR2/3

300 MB/sec

3.2 GB/sec


Sonics QoS-based Arbitration• Initiator data flow threads mapped to MemMax threads by

interconnect fabric– e.g. 40 data flows sharing 8 DRAM threads in a digital video system

• Independent threads assigned to QoS level (maintained throughout SMX based interconnect)

• Non-blocking, multi-threaded fabric and MemMax interfaces allow:

– Higher priority requests to interleave with & respond before others– Guaranteed BW threads to minimize buffering / receive latency

guarantees– Optimum DRAM efficiency

Thread QoSLevel

BandwidthAllocation ?

QoS Model

Priority YesLow latency while within BW allocation,

best-effort otherwise

Bandwidth YesGuaranteed BW while within BW allocation,

best-effort otherwise

Best-effort No N/A


Video/Graphics DataFlow

L2

CM

1004K 1004K 1004K 1004K

OCP (64-bit Data)

Mem Controller

2D/3DGraphics

VideoDecode

Audio

256

64

64

64

IOCU

Display

USB

GPIO Tuner

AHB

Security

DMA FlashMem Scheduler

CPU - tesselation

Write Vertex List

Read Vertex, Textures, etc

Read/Write FB

Draw to screen

GPU - processing

Multiport

DDR2/3

DecodeVideo Frame


Graphics / Video Optimization

• A small buffer can significantly reduce demands on main memory

• Dedicated multimedia memory best• Cost vs. Benefit• L2 Cache already there• Carve out small, 32K portion of L2 to serve as vertex

memory, video, and GPU workspace– 40-60% reduction in memory bandwidth

• Using Video as a texture– Video decoding output = graphics texture format– No format conversion– Eliminate unnecessary memory copies


Optimized Video/Graphics Flow

L2

CM

1004K 1004K 1004K 1004K

OCP (64-bit Data)

Mem Controller

2D/3DGraphics

VideoDecode

Audio

Multiport

DDR2/3

256

64

64

64

IOCU

Display

USB

GPIO Tuner

AHB

Security

DMA FlashMem Scheduler

CPU - tesselation

Write Vertex List

Read Textures, etcRead/Write FB

Draw to screen

GPU - processingDirect Vertex copy

GPU Scratchpad


Graphics recommendations

• OpenGL ES 2.0 compliant graphics required– Ability to support 1920x1080 resolutions

• Many mobile – Requirement for Flash 10

• Not used for Flash video• 3D User Interface for TV• Simple Flash 3D gaming

– Recommended minimum • >250 Mpixel/sec• >10M triangles/sec

• 3D in Digital Home– Gaming drives 3D requirement– 3D requirement for digital home will be used for 3D GUI– 3D gaming for HD screens left for game consoles


Embedded GPU Requirements

• Best-in-class graphics functionality• Graphics performance• High definition display resolutions (1080p)• Image quality

• Application compatibility• Flash 10 acceleration• Android and leading middleware applications• Graphics API conformance (OpenGL ES 2.0/1.1, OpenVG 1.1, DirectFB)

• Embedded system performance• Minimal memory bandwidth• Low leakage power profile• Extremely low CPU load

• Lowest total cost• Smallest possible silicon area• Complete graphics software stack• Fast and smooth hardware and software integration

1.11.1


GPU Recommendation for Digital Home

Vivante GC400 GC800 GC1000 GCxxxx

GFLOPS 2.25 4.5 9.0

Polygon Performance

15 MTri/s 25 MTri/s 39 MTri/s

Fill Rate150-300 MPix/s

250 MPix/s

500 MPix/s

IMG SGX520 SGX535 SGX545

GFLOPS 1.8 3.6 7.2

Polygon Performance

7 MTri/s 15 MTri/s 40 MTri/s

Fill Rate 250 MPix/s 500 MPix/s1,000

MPix/s

Minimum Recommended

Graphicscores


Video Decoder recommendations• HW decoder required

– Up to 1920x1080p– Multiple streams

• Support all Adobe Flash Video codecs– H.264, Sorenson Spark and On2 VP6

• Support for STB common video formats– WMV9 / VC-1 Simple, Main and Advanced Profile– MPEG-4 Simple and Advanced Simple Profiles– MPEG-1&2 Main Profile

• Optional support for all common video formats – JPEG (image decoding in HW)– H.263 Profile 0– RealVideo 8/9/10– DivX ® support – Home Theatre Profile

• HW Encoder recommended– Video conferencing– Device Transcoding

VIDEO

Segment H.2

64

H.2

63

AV

S

Div

X

MP

EG

-2

MP

EG

-4

JPE

G

Mot

ion

JPE

G

VC

-1

Xvi

d

DV

WM

V9

On2

VP

6 or

abo

ve

JPE

G20

00

JBIG

2

DVD DTV STB xDSL/RGIP Phone


Teaming with Complementary IP Providers to Accelerate SoC Development

Helping SoC developers get to market quickly with fully-integrated hardware/ software solutions

HiFi Audio

Security

Graphics

Memories

Video


SummaryBest Web connected Multimedia Experience

Able to work with Best IP providers

Giving you Differentiation and Choice

MIPS and it’s partners Customer and solutions focused

Tighter integration of CPU, Graphics, & Video


At the core of the user experience®

MIPS, MIPS32, MIPS64, MIPS-Based, MIPS-Verified, MIPS Technologies logo are trademarks of MIPS Technologies, Inc. and registered in the U.S. Patent and Trademark Office. MIPS, MIPS32, MIPS64, MIPS-Based, MIPS Logo, MIPS Technologies Logo, microMIPS, CorExtend, Pro Series, M14K, M14Kc, M4K, 4KE, 4KEc, 24K, 24KE, 34K, 74K, 1004K, MIPS Navigator, and FS2 are trademarks or registered trademarks of MIPS Technologies, Inc. in the United States and other countries.

Thank You!

mips track a

Education