network sharing issues
DESCRIPTION
Network Sharing Issues. Lecture 15 Aditya Akella. Is this the biggest problem in cloud resource allocation? Why? Why not? How does the problem differ wrt allocating other resources? FairCloud : Sharing the Network in Cloud Computing, Sigcomm 2012 What are the assumptions? Drawbacks?. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/1.jpg)
Network Sharing Issues
Lecture 15Aditya Akella
![Page 2: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/2.jpg)
• Is this the biggest problem in cloud resource allocation? Why? Why not?
• How does the problem differ wrt allocating other resources?
• FairCloud: Sharing the Network in Cloud Computing, Sigcomm 2012
• What are the assumptions? Drawbacks?
![Page 3: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/3.jpg)
Motivation
Network?
![Page 4: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/4.jpg)
Context
Networks are more difficult to share than other resources
X
![Page 5: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/5.jpg)
Context
• Several proposals that share network differently, e.g.:– proportional to # source VMs (Seawall [NSDI11])– statically reserve bandwidth (Oktopus [Sigcomm12])– …
• Provide specific types of sharing policies
• Characterize solution space and relate policies to each other?
![Page 6: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/6.jpg)
FairCloud Paper
1. Framework for understanding network sharing in cloud computing– Goals, tradeoffs, properties
2. Solutions for sharing the network – Existing policies in this framework– New policies representing different points in
the design space
![Page 7: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/7.jpg)
Goals
1. Minimum Bandwidth Guarantees– Provides predictable performance– Example: file transfer finishes within time limit
A1 A2
Timemax = Size / Bmin
Bmin
![Page 8: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/8.jpg)
Goals
1. Minimum Bandwidth Guarantees2. High Utilization– Do not leave useful resources unutilized– Requires both work-conservation and proper
incentives
A
B B B
Both tenants active Non work-conserving Work-conserving
![Page 9: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/9.jpg)
Goals
1. Minimum Bandwidth Guarantees2. High Utilization3. Network Proportionality– As with other services, network should be shared
proportional to payment– Currently, tenants pay a flat rate per VM
network share should be proportional to #VMs (assuming identical VMs)
![Page 10: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/10.jpg)
Goals
1. Minimum Bandwidth Guarantees2. High Utilization3. Network Proportionality– Example: A has 2 VMs, B has 3 VMs
A1
A2
BwA
B1
B3
B2
BwB
BwB
BwA =
23
When exact sharing is not possible use max-min
![Page 11: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/11.jpg)
Goals
1. Minimum Bandwidth Guarantees2. High Utilization3. Network Proportionality
Not all goals are achievable simultaneously!
![Page 12: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/12.jpg)
TradeoffsMin
GuaranteeHigh
UtilizationNetwork
Proportionality
Not all goals are achievable simultaneously!
![Page 13: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/13.jpg)
TradeoffsMin
GuaranteeNetwork
Proportionality
![Page 14: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/14.jpg)
Tradeoffs
BwBBwA
A BAccess Link LCapacity C
BwB = 11/13 CBwA = 2/13 C
10 VMs
Network Proportionality
BwA ≈ C/NT 0
#VMs in the network
BwB = 1/2 CBwA = 1/2 C
Minimum Guarantee
Min Guarantee
Network Proportionality
![Page 15: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/15.jpg)
TradeoffsHigh
UtilizationNetwork
Proportionality
![Page 16: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/16.jpg)
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
High Utilization
Network Proportionality
![Page 17: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/17.jpg)
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
BwB = 1/2 C
BwA = 1/2 CNetwork Proportionality
High Utilization
Network Proportionality
![Page 18: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/18.jpg)
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
P
High Utilization
Network Proportionality
Uncongested path
![Page 19: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/19.jpg)
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
BwB BwA <
Network Proportionality
L L
Tenants can be disincentivized to use free resources
If A values A1A2 or A3A4 more than A1A3
BwA+BwA = BwBLLP
P
High Utilization
Network Proportionality
Uncongested path
![Page 20: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/20.jpg)
Network Proportionality
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
PNetwork proportionality applied only for flows traversing congested links shared by multiple tenants
High Utilization
Uncongested path Congestion
Proportionality
![Page 21: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/21.jpg)
Network Proportionality
Tradeoffs
L
B1
B3
B2
B4
A1
A3
A2
A4
Uncongested path
P
BwB BwA =
Congestion Proportionality
L L
High Utilization
Congestion Proportionality
![Page 22: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/22.jpg)
Network Proportionality
Tradeoffs
Still conflicts with high utilization
High Utilization
Congestion Proportionality
![Page 23: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/23.jpg)
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4L2
C1 = C2 = C
Network Proportionality
High Utilization
L1
Congestion Proportionality
![Page 24: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/24.jpg)
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
L1
L2
BwB BwA =
Congestion ProportionalityL1 L1
BwB BwA =L2 L2
Network Proportionality
High Utilization
C1 = C2 = C
Congestion Proportionality
![Page 25: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/25.jpg)
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
L1
L2
Demand drops to ε
Network Proportionality
High Utilization
C1 = C2 = C
Congestion Proportionality
![Page 26: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/26.jpg)
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
ε
C - ε
ε
C - ε
Tenants incentivized to not fully utilize
resources
Network Proportionality
High Utilization
C1 = C2 = C
Congestion Proportionality
L1
L2
![Page 27: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/27.jpg)
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
ε
C - 2εUncongested
ε
C - ε
L1
L2
C1 = C2 = C
Network Proportionality
High Utilization
Tenants incentivized to not fully utilize
resources
Congestion Proportionality
![Page 28: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/28.jpg)
L2
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
ε
C - 2ε
C/2
C/2
Uncongested
C1 = C2 = C
Network Proportionality
High Utilization
Congestion Proportionality
Tenants incentivized to not fully utilize
resources L1
![Page 29: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/29.jpg)
Tradeoffs
Proportionality applied to each link independently
Congestion Proportionality
Link Proportionality
Network Proportionality
High Utilization
L2
B1
B3
A1
A3
B2
B4
A2
A4
L1
![Page 30: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/30.jpg)
L2
Tradeoffs
B1
B3
A1
A3
B2
B4
A2
A4
Full incentives for high utilization
Congestion Proportionality
Link Proportionality
Network Proportionality
High Utilization
L1
![Page 31: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/31.jpg)
Goals and TradeoffsMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
![Page 32: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/32.jpg)
Guiding PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Break down goals into lower-level necessary properties
![Page 33: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/33.jpg)
PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
![Page 34: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/34.jpg)
Work Conservation
• Bottleneck links are fully utilized• Static reservations do not have this property
![Page 35: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/35.jpg)
PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
![Page 36: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/36.jpg)
Utilization Incentives
• Tenants are not incentivized to lie about demand to leave links underutilized
• Network and congestion proportionality do not have this property
• Allocating links independently provides this property
![Page 37: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/37.jpg)
PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
![Page 38: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/38.jpg)
Communication-pattern Independence
• Allocation does not depend on communication pattern
• Per flow allocation does not have this property– (per flow = give equal shares to each flow)
Same Bw
![Page 39: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/39.jpg)
PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 40: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/40.jpg)
Symmetry
• Swapping demand directions preserves allocation• Per source allocation lacks this property– (per source = give equal shares to each source)
Same Bw
Same Bw
![Page 41: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/41.jpg)
Goals, Tradeoffs, PropertiesMin
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 42: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/42.jpg)
Outline
1. Framework for understanding network sharing in cloud computing– Goals, tradeoffs, properties
2. Solutions for sharing the network – Existing policies in this framework– New policies representing different points in
the design space
![Page 43: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/43.jpg)
Per Flow (e.g. today)Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 44: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/44.jpg)
Per Source (e.g., Seawall [NSDI’11]) Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 45: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/45.jpg)
Static Reservation (e.g., Oktopus [Sigcomm’11])Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 46: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/46.jpg)
New Allocation Policies
3 new allocation policies that take different stands on tradeoffs
![Page 47: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/47.jpg)
Proportional Sharing at Link-level (PS-L)Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 48: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/48.jpg)
Proportional Sharing at Link-level (PS-L)
• Per tenant WFQ where weight = # tenant’s VMs on link
A
B
WQA= #VMs A on L
BwB
BwA =
#VMs A on L#VMs B on L
Can easily be extended to use heterogeneous VMs (by using VM weights)
![Page 49: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/49.jpg)
Proportional Sharing at Network-level (PS-N)Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 50: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/50.jpg)
Proportional Sharing at Network-level (PS-N)
• Congestion proportionality in severely restricted context• Per source-destination WFQ, total tenant weight = # VMs
![Page 51: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/51.jpg)
Proportional Sharing at Network-level (PS-N)
WQA1A2= 1/NA1 + 1/NA2
A1 A2
NA2
NA1
Total WQA = #VMs A
• Congestion proportionality in severely restricted context• Per source-destination WFQ, total tenant weight = # VMs
![Page 52: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/52.jpg)
Proportional Sharing at Network-level (PS-N)
WQB
WQA =
#VMs A#VMs B
• Congestion proportionality in severely restricted context• Per source-destination WFQ, total tenant weight = # VMs
![Page 53: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/53.jpg)
Proportional Sharing on Proximate Links (PS-P)Min
Guarantee
Link Proportionality
High Utilization
Congestion Proportionality
Network Proportionality
Work Conservatio
n
UtilizationIncentives
Comm-PatternIndependence
Symmetry
![Page 54: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/54.jpg)
• Assumes a tree-based topology: traditional, fat-tree, VL2(currently working on removing this assumption)
Proportional Sharing on Proximate Links (PS-P)
![Page 55: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/55.jpg)
• Assumes a tree-based topology: traditional, fat-tree, VL2(currently working on removing this assumption)
• Min guarantees– Hose model– Admission control
Proportional Sharing on Proximate Links (PS-P)
A1
BwA1
A2
BwA2
An
BwAn
…
![Page 56: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/56.jpg)
• Assumes a tree-based topology: traditional, fat-tree, VL2(currently working on removing this assumption)
• Min guarantees– Hose model– Admission control
• High Utilization– Per source fair sharing towards tree root
Proportional Sharing on Proximate Links (PS-P)
![Page 57: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/57.jpg)
• Assumes a tree-based topology: traditional, fat-tree, VL2(currently working on removing this assumption)
• Min guarantees– Hose model– Admission control
• High Utilization– Per source fair sharing towards tree root– Per destination fair sharing from tree root
Proportional Sharing on Proximate Links (PS-P)
![Page 58: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/58.jpg)
Deploying PS-L, PS-N and PS-P• Full Switch Support
– All allocations can use hardware queues (per tenant, per VM or per source-destination)
• Partial Switch Support– PS-N and PS-P can be deployed using CSFQ [Sigcomm’98]
• No Switch Support– PS-N can be deployed using only hypervisors– PS-P could be deployed using only hypervisors, we are currently
working on it
![Page 59: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/59.jpg)
Evaluation
• Small Testbed + Click Modular Router– 15 servers, 1Gbps links
• Simulation + Real Traces– 3200 nodes, flow level simulator, Facebook
MapReduce traces
![Page 60: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/60.jpg)
Many to one
BwBBwA
A B
N
One link, testbedPS-P offers guarantees
BwA
N
![Page 61: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/61.jpg)
MapReduce
One link, testbed
BwBBwA
5
R 5
M
M+R = 10 M
BwB
(Mbp
s)
PS-L offers link proportionality
![Page 62: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/62.jpg)
MapReduce
Network, simulation, Facebook trace
![Page 63: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/63.jpg)
MapReduce
Network, simulation, Facebook trace
PS-N is close to network proportionality
![Page 64: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/64.jpg)
MapReduce
Network, simulation, Facebook trace
PS-N and PS-P reduce shuffle time of small jobs
by 10-15X
![Page 65: Network Sharing Issues](https://reader035.vdocuments.us/reader035/viewer/2022081420/56816386550346895dd47016/html5/thumbnails/65.jpg)
Summary• Sharing cloud networks is not trivial• First step towards a framework to analyze network
sharing in cloud computing – Key goals (min guarantees, high utilization and proportionality),
tradeoffs and properties• New allocation policies, superset properties from past work
– PS-L: link proportionality + high utilization– PS-N: restricted network proportional– PS-P: min guarantees + high utilization
• What are the assumptions, drawbacks?