statistical approach to noc design
DESCRIPTION
Statistical Approach to NoC Design. Itamar Cohen, Ori Rottenstreich and Isaac Keslassy. Technion (Israel). NoC. Network link. Network router. Module. Module. Module. Computing module. Module. Module. Module. Module. Bus. Module. Module. Module. Module. Module. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/1.jpg)
Statistical Approach Statistical Approach to NoC Designto NoC Design
Itamar Cohen, Ori Rottenstreich and Isaac Keslassy
Technion (Israel)
![Page 2: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/2.jpg)
NoCNoC
Network-on-Chip (NoC) architecture: replace bus-based spaghetti chips with router-based network
Computingmodule
Networkrouter
Networklink
Bus
Module
Module Module
Module Module
Module Module
Module
Module
Module
Module
Module
![Page 3: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/3.jpg)
ProblemProblem
The traffic matrix in NoCs is often-changing and unpredictable
makes NoCs hard to design
![Page 4: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/4.jpg)
Example: Road CapacitiesExample: Road Capacities
We need to design link capacities for Israeli roads
Let’s model the traffic matrices…
Haifa
Tel Aviv
AshdodJerusalem
![Page 5: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/5.jpg)
Road CapacitiesRoad Capacities
Morning peak: most traffic towards Tel Aviv
Haifa
Tel Aviv
AshdodJerusalem
10
10
10
1
1
1
![Page 6: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/6.jpg)
Road CapacitiesRoad Capacities
Morning peak: most traffic towards Tel Aviv
Afternoon peak: most traffic leaving Tel Aviv
Haifa
Tel Aviv
AshdodJerusalem
1
1
1
10
10
10
Good luck after the seminar!
![Page 7: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/7.jpg)
Road CapacitiesRoad Capacities
Morning peak: most traffic towards Tel Aviv
Afternoon peak: most traffic leaving Tel Aviv
Night: no traffic
Haifa
Tel Aviv
AshdodJerusalem
0
0
0
0
0
0
![Page 8: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/8.jpg)
Solution (1): Average-CaseSolution (1): Average-Case Solution (1): average-case
approach i.e. allocate capacity of ~5 for
each link. λ < μ
Problem: traffic jam during many hours, every day Traffic matrix keeps changing
Haifa
Tel Aviv
AshdodJerusalem
5
5
5
5
5
50 10 10 10 0 1 1 1 0 0 0 01 0 0 0 10 0 0 0 0 0 0 01 0 0 0 10 0 0 0 0 0 0 01 0 0 0 10 0 0 0 0 0 0 0
![Page 9: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/9.jpg)
Solution (2): Worst-CaseSolution (2): Worst-Case Solution (2): worst-case
approach i.e. allocate capacity of ~10 for
each link
Haifa
Tel Aviv
AshdodJerusalem
10
10
10
10
10
10
![Page 10: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/10.jpg)
Problem: Sukkot…Problem: Sukkot…
Problem: traffic matrix in Sukkot as a rare event
Solution (3): statistical approach Enough capacity for 99% of
the time Allow for occasional
congestion
Haifa
Tel Aviv
AshdodJerusalem
10
10
10
10
10
10
5050
![Page 11: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/11.jpg)
Back to the NoC worldBack to the NoC world
Similar problems in NoC design process City Shared cache Suburbs Cores Many possible traffic
matrices: writing, reading, etc.
Core
Cache
CoreCore
![Page 12: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/12.jpg)
Statistical Approach to NoC DesignStatistical Approach to NoC Design
Given: Set of traffic matrices Topology Routing Link capacities
Compute congestion guarantee “99% of traffic matrices will receive enough
capacity”
![Page 13: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/13.jpg)
T-Plots in NoCsT-Plots in NoCs
ijT
klT
Traffic Matrix Set S
1 2
2
1
1
2
2
1
2
1
1
2
1 2
2 1
2
1
1
2
2 1
1 2
1
2
1
2
1
2
2 1
1 2
l
T
Given: Link l in 3x4 mesh topology Traffic matrix set S XY routing
Find load distribution on l
Link Load
Traffic-load distribution plot (T-plot)
![Page 14: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/14.jpg)
14
T-Plot (closer view)T-Plot (closer view)
Gaussian?
Worst-case traffic load = 299.99% of traffic
matrices bring load under 1.6
20%capacity
gain
Link Load
![Page 15: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/15.jpg)
Computing T-PlotsComputing T-Plots
Theorem: for an arbitrary graph and routing, computing the T-Plot is #P-complete.
#P-complete problems are at least as hard as NP-complete problems. NP: “Is there a solution?” #P: “How many solutions?”
![Page 16: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/16.jpg)
Example: NUCA networkExample: NUCA network NUCA (Non-Uniform Cache Architecture)
Sharing degree 4 Traffic model: each core (cache) may only send/receive traffic
to/from caches (cores) in its sub-network.
Processors
Caches
Processors
![Page 17: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/17.jpg)
NUCA network – Total capacityNUCA network – Total capacity Total capacity required for various Capacity
Allocation (CA) targets. Gain of statistical approach
48%
![Page 18: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/18.jpg)
SummarySummary
Statistical approach Deals with several traffic matrices Can apply to nearly any network
Networks-on-Chip are a new and exciting field Multi-core chips (Intel, AMD) Technion NoC research group:
www.ee.technion.ac.il/matrics
![Page 19: Statistical Approach to NoC Design](https://reader031.vdocuments.us/reader031/viewer/2022020423/56814881550346895db58f6d/html5/thumbnails/19.jpg)
Thank you.Thank you.