server memory forum shenzhen 2012 - jedectermination, etc.) – wide i/o bus architecture with 3ds...

12
Server Memory Forum Shenzhen 2012

Upload: others

Post on 11-Apr-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

Server Memory Forum Shenzhen 2012

Page 2: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• Server memory – market demand

• Historic trends for power reduction

• Future trends for power reduction

• Future power optimization focus

• Questions for consideration for future non-charged based RAM

Page 3: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• Large capacity

• High throughput

• Low latency

• Low Power

• And there is less room for trade-offs…

Page 4: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• Each bit of data that is transferred to/from memory has a cost

– xx PJ/bit

• Each bit of data that is stored in memory has a cost

– xx PJ/bit

• Total power cost can be up to 50 to 60% of total system cost for some type of server systems

Page 5: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

Major contributors

• DRAM voltage reduction

• DRAM process technology improvement

Page 6: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

0

5

10

15

20

25

30

35

40

0.5

1

1.5

2

2.5

3

3.5

SDRSDRAM

DDRSDRAM

DDR2SDRAM

DDR3SDRAM

DDR3LSDRAM

DDR3USDRAM

DDR4SDRAM

DDR4LSDRAM

Future

DR

AM

Vo

lta

ge

Re

du

cti

on

(%

)

DR

AM

Vo

lta

ge

(V

)

Voltage Trends (%) Voltage Reduction TrendsSpeculative voltage

for DDR4L &

Future

Voltage migration

is slowing down

Linear voltage drop

Page 7: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

0

20

40

60

80

100

120

140

Pro

ces

s T

ech

no

log

y (

nm

)

Speculative

Process

trends

Process migration

is slowing down

Each year new process technology node

DRAM IDDx reduction up to 15% with

process technology improvement

Page 8: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

30

32

34

36

38

40

42

44

DDR DDR2 DDR3 DDR4 FutureM

em

ory

P

ow

er

Re

du

cti

on

(%

)

No

rma

lize

d M

em

ory

Po

we

r

Memory Power (%) Memory Power Reduction

30

32

34

36

38

40

42

44

DDR DDR2 DDR3 DDR4 Future

Me

mo

ry P

ow

er

Re

du

cti

on

(%

)

No

rma

lize

d M

em

ory

Po

we

r

Memory Power (%) Memory Power Reduction

Memory Power per GByte Memory Power per Gbit/s

Despite non-linear voltage reduction and process technology improvement in future,

power trends must continue…

Page 9: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• New technology adoption – 3DS technology (elimination of multiple sets of I/Os, DLLs,

termination, etc.)

– Wide I/O bus architecture with 3DS technology

• Rich feature sets in DRAM, controller and register/buffers – I.e Termination schemes, external voltage supply for charge

pumps, page size, etc.

– Integration of support chip functions; power saving modes and application specific programmability in support chips

• DRAM density growth – Maintain GB/system growth with fewer DIMMs on a channel (4 3 2 1 and enable non-DIMM application with 3DS/wide I/O bus

technology)

Page 10: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• Ability to scale DRAM voltage dynamically – Fits nicely with dynamic frequency scaling

– Similar to P-state transition mechanism in CPUs/memory controllers

• Fast exit from idle & various power management states – Longer latency leads to idle power consumption in DRAM,

controller and support chips

• Efficient memory bandwidth utilization – Hidden housekeeping operation such as refresh, calibration

– Improvement on bus turn around due to I/O as well as DRAM core timings

– Improvement on DRAM core timing parameters

Page 11: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e

• Process technology migration will eventually lead to limitation in charged based RAM (DRAM) – How and when will market exploit other technology in

server market in mass volume? • Phase Change Memory (PCM RAM) • Spin Transfer Torque RAM (STT RAM) • Memristor Memory (MRAM) • Etc..

• How much power reduction non-charge based RAM

offer to servers?

• How does total system memory power trend change when mixture of non-volatile memory and DRAM memory is used simultaneously? – Will there be 2x or 5x or 10x or more improvement in

power?

Page 12: Server Memory Forum Shenzhen 2012 - JEDECtermination, etc.) – Wide I/O bus architecture with 3DS technology •Rich feature sets in DRAM, controller and register/buffers – I.e