![Page 1: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/1.jpg)
1IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Explicit Congestion Explicit Congestion Notification (ECN)Notification (ECN)
Jinjing Jiang and Raj Jain Washington University in Saint Louis
Saint Louis, MO [email protected]
IEEE 802.1 Congestion Group Meeting, Dallas, TX Nov 14, 2006
![Page 2: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/2.jpg)
2IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
OverviewOverview
! Explicit Congestion Notification (ECN): What and Why?
! Source/Switch/Queue Control Algorithms! Simulation Results! Other Variations of ECN! Comparison of ECN and BCN
![Page 3: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/3.jpg)
4IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Requirements for a Good SchemeRequirements for a Good Scheme1. Fast convergence to stability2. Fast convergence to fairness3. Good for bursty traffic4. Predictable performance: No local minima5. Stable rates ⇒ TCP Friendly (IETF feedback)6. Easy to deploy:
1. Small number of parameters2. Easy to set parameters3. Parameters applicable to a wide range of configurations
(number of sources), link speeds, traffic types.
![Page 4: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/4.jpg)
5IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Convergence to StabilityConvergence to Stability
! Convergence to the desired queue length in a few ms=/=> Convergence of user rates. User rates may still be off from the desired fair values.May even have multiple stable states.
UserRate
Time
![Page 5: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/5.jpg)
6IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Large Oscillations and Large Oscillations and MetastabilityMetastability
! Symmetric Topology
![Page 6: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/6.jpg)
7IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Simulation Results: BCNSimulation Results: BCN
Mutiple stable points
Large oscillations
![Page 7: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/7.jpg)
8IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Time to ConvergenceTime to Convergence
! Time to stability depends on the sampling size (in kB). Sampling interval is much much larger than round trip delays ⇒ Convergence times of 100’s of ms.
! The system can be unstable with incorrect sampling size
! The rate increase parameter Ru, sampling size, and link capacity are related
! When there are multiple congestion points, BCN’srate oscillations are high
![Page 8: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/8.jpg)
9IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Asymmetric Topology and Asymmetric Topology and Multiple Congestion PointsMultiple Congestion Points
Topology: Only one link is 1Gbps, others are all 10Gbps
![Page 9: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/9.jpg)
10IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Multiple Congestion Points: BCNMultiple Congestion Points: BCN
! Large Oscillations
0
1e+09
2e+09
3e+09
4e+09
5e+09
6e+09
7e+09
8e+09
9e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
SU1
0
5e+08
1e+09
1.5e+09
2e+09
2.5e+09
3e+09
3.5e+09
4e+09
4.5e+09
5e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
SU3
4.5Gbps
0.5GbpsOptimal rate for ST3 and ST4
Optimal Ratefor ST1 and ST2
Time Time
Rate Rate
2-7 Gbps 0-3 Gbps
![Page 10: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/10.jpg)
11IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Slow Convergence to FairnessSlow Convergence to Fairness
! Analytical models have shown BCN to be fair! However, the time to achieve fairness is too long! The time to fairness depends upon the feedback delay
which is dominated by the sampling interval! In baseline simulations scenarios, the time to fairness
can be several hundred ms.⇒ The system operates mostly unfairly if the traffic changes every few ms.⇒ Not good performance for bursty traffic.
![Page 11: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/11.jpg)
12IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
On/Off SourcesOn/Off Sources
! Four source configuration shown earlier. Two sources (green+red) turn off at 20 ms and back on after 20 ms.
Time in seconds
Allocated Rate in bps
4 2 4 2 4# of active sources
Blue source receivedBCN (0,0)
Overall Throughput: Pink ≠ Blue, Green ≠ Red => Unfair
0
1e+09
2e+09
3e+09
4e+09
5e+09
6e+09
7e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 0.11
Rat
e(bp
s)
Time(s)
SU1SU2SU3SU4
![Page 12: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/12.jpg)
13IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Fundamental IssuesFundamental Issues! Sampling: RLT tags are sampled
=> Rate increase is matter of chance ! Overload = Qdelta/Sampling time
Packet based sampling => sampling time depends upon the packet sizes => Byte based sampling => Sampling time depends upon the arrival rate => Qdelta is not a perfect indicator of overload
! Queue feedback: Meaningful only with capacity
![Page 13: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/13.jpg)
14IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
DisclaimerDisclaimer
! This is a new scheme. Just developed. ! Some work will need to be done! May not be able to answer all the questions! Goal is to provide ideas for possible solutions to
known problems! There are many variations.
Basic ECN will be described first.Variations later.
![Page 14: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/14.jpg)
15IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Explicit Congestion Notification (ECN)Explicit Congestion Notification (ECN)
! Switch sends a rate to the source. Source sets to that rate! Only the feedback format has to be standardized ! No need to standardize switch algorithm.! There are no source parameters! Vendor differentiation: Different switch algorithms will “inter-
operate” although some algorithms will be more efficient, more fair, and achieve efficiency/fairness faster than others.
! We present a sample switch algorithm and show that it achieves excellent performance.
SwitchSource Destination5 Mbps 5 Mbps
![Page 15: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/15.jpg)
16IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Proposed AlgorithmProposed Algorithm
! The switch sends its “Advertised Rate” to all sources! All sources get the same feedback.! The sources send at the rate received.
Switch
Source
Source
Destination
Destination
5 Mbps 5 Mbps
![Page 16: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/16.jpg)
17IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
A Simple Switch AlgorithmA Simple Switch Algorithm
0. Start with an Advertised Rate of r1. Measure input rate every T interval2. Compute overload factor z in the last T interval3. Change the rate to r/z4. Go back to step 1Although this simple algorithm will work but:! It will oscillate even if the rate is close to optimal. ! Queues will not be constant => Need a Q Control Fn
time0 T 2T iT (i+1)T
![Page 17: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/17.jpg)
18IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
A Sample Switch AlgorithmA Sample Switch Algorithm
1. Initialization:
Here C is the link capacity in bits/s. r0 can be any other value too, e.g., C/4. It has no effect on convergence time.
2. Measurement: Let Ai be the measured arrival rate in bits/s then the load factor is Ai/C. We update this load factor based on the queue length so that the effective load factor is:
3. Bandwidth Allocation:
0 2Cr =
( )i
ii
Af q C
ρ =×
1i
ii
rrρ+ =
![Page 18: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/18.jpg)
19IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Queueing Control Function: Queueing Control Function: f(q)f(q)Idea: Give less rate if queue length is large and more if queue
length is small compared to desired queue length of qeq and f(qeq)=1
We analyzed many different functions and recommend thehyperbolic function because it gives smaller oscillations.[See reference]
qeq
f(q)
1
c q
linear functionHyperbolicfunction
b
![Page 19: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/19.jpg)
20IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Queue Control Function: Queue Control Function: f(q)f(q)! Linear Function: k is some constant
! Hyperbolic function: a, b, c are constants
( ) 1 eq
eq
q qf q k
q−
= −
, ;( 1)
( )max , , .
( 1)
eqeq
eq
eq
eq
bqif q q
b q qf q
aqc otherwise
a q q
⎧≤⎪ − +⎪= ⎨ ⎛ ⎞⎪ ⎜ ⎟⎪ ⎜ ⎟− +⎝ ⎠⎩
![Page 20: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/20.jpg)
21IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Analytical ResultsAnalytical Results
! Wash U switch algorithm achieves max-min fairness and converges to desired queue length qeq.1. Fairness2. Stability3. Convergence Time
![Page 21: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/21.jpg)
22IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Fairness ProofFairness ProofLet:! N = number of flows. (Note that we do NOT need to know N )! Ai = Total arrival rate
! When qi = qeq, f(q) =1 => all sources get the fair share C/N which implies MAX-MIN fairness
1/ ( )
/[ ( ) ]i i i
ii i i
r A N f q CrA f q C Nρ+ = = =
![Page 22: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/22.jpg)
23IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Convergence ProofConvergence Proof! Easy to show that {qi} is a monotonic sequence converging to
qeq
! At q=qeq, f(qeq)=1
1 1( ) ( ( ) 1)i i i i iq q Nr C T q CT f q+ += + − = + −
![Page 23: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/23.jpg)
24IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Convergence TimeConvergence Time! Given anyε> 0, define the stable state (fair state) as
! For linear control function, the system will converge to stable state after n measurement intervals, where:
where , k is the slope of the linear queue fn, and q0 is the initial queue length
(1 ) (1 )eq i eqq q qε ε− ≤ ≤ +
0,eq eq
qCTk Mq q
β = =
T1Time
Queue
log| 1|
log(1 )Mn
ε
β
⎛ ⎞⎜ ⎟−⎝ ⎠≈
−
![Page 24: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/24.jpg)
25IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Source AlgorithmSource Algorithm
! Source keeps two variables: ! CP: Congestion Point ID (CPID) of the bottleneck
switch in the last feedback received. Initially CP = -1 (No congestion point)
! r : Current rate ! When the source gets a new BCN Message [ri,CPID]
IF ri < r THEN r← ri and CP ← CPIDELSE IF(CP=CPID or CP=-1) THEN r ← ri
![Page 25: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/25.jpg)
27IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Simulation ParametersSimulation Parameters
! Measurement Interval: T = 0.03 ms! Queue control function: Hyperbolic
a = 1.05, b = 1.2, c = 0.5 ! Packet size = 1500 B! We compare performance with baseline BCN
algorithm
![Page 26: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/26.jpg)
28IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Simulation ResultsSimulation Results
! Baseline Symmetric Topology! Parking Lot Topology! Asymmetric Topology! Bursty Traffic
![Page 27: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/27.jpg)
29IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: ConfigurationSymmetric Topology: Configuration
! UDP Bernoulli Traffic with 10 Gbps rate ! ST1 and ST2 are periodically turned off for around 20
ms, i.e., the exact time is not the same! Simulation Time is 100 ms
![Page 28: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/28.jpg)
30IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: Source Rates RcvdSymmetric Topology: Source Rates Rcvd
Conclusion: ECN converges very fast and remains stable.Note that ECN graphs have 4 curves. Perfect fairness results in only two visible curves.
0
2e+09
4e+09
6e+09
8e+09
1e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
Rate Allocation
SU1SU2SU3SU4
ECN
![Page 29: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/29.jpg)
31IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: Source Rates RcvdSymmetric Topology: Source Rates Rcvd
Conclusions: 1. ECN converges very fast and remains stable.2. Perfect fairness results in only two visible curves.
Note that ECN graphs have 4 curves. 3. Convergence time is a small multiple of measurement interval.
0
2e+09
4e+09
6e+09
8e+09
1e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
Rate Allocation
SU1SU2SU3SU4
ECN BCN
0
1e+09
2e+09
3e+09
4e+09
5e+09
6e+09
7e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 0.11
Rat
e(bp
s)
Time(s)
SU1SU2SU3SU4
![Page 30: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/30.jpg)
32IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: Queue LengthSymmetric Topology: Queue Length
! Conclusions: 1. Queue approaches qeq and stays there.2. There is no under utilization (zero queue).
0
20
40
60
80
100
120
140
160
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Buf
fer
Util
izat
ion(
pkts
)
Time(s)
Buffer Utilization
Buffer Utilization
ECN BCN
0
20
40
60
80
100
120
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Buf
fer
Util
izat
ion(
pkts
)
Time(s)
Buffer Utilization
Buffer Utilization
![Page 31: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/31.jpg)
33IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: Link UtilizationSymmetric Topology: Link Utilization
! Conclusion: ECN has much higher utilization
3e+09
4e+09
5e+09
6e+09
7e+09
8e+09
9e+09
1e+10
1.1e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Thr
ough
put a
t Cor
e S
witc
h(bp
s)
Time(s)
Throughput at Core Switch(bps)
Throughput
ECN BCN
4e+09
5e+09
6e+09
7e+09
8e+09
9e+09
1e+10
1.1e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 0.11
Thr
ough
put a
t Cor
e S
witc
h(bp
s)
Time(s)
Throughput at Core Switch(bps)
Throughput
![Page 32: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/32.jpg)
34IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
PParking Lot Topologyarking Lot Topology
Goals: 1. Check speed of convergence to fairness 2. Show that ECN gets Max-min (not proportional) fairness
! Max-Min: All 6 sources get 1/5th of link rate! Proportional: ST1-ST4 get 1/6th and ST5-ST6 get 1/3rd
![Page 33: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/33.jpg)
35IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Parking Lot: Source Rates for ECNParking Lot: Source Rates for ECN
! Conclusion: All sources get 2 Gbps = C/5 => MAX-MIN Fairness
1.5e+09
2e+09
2.5e+09
3e+09
3.5e+09
4e+09
4.5e+09
5e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
ST1ST2ST3ST4ST5ST6
![Page 34: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/34.jpg)
36IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Parking Lot: Rates for BCNParking Lot: Rates for BCN
! Large Oscillations
0
1e+09
2e+09
3e+09
4e+09
5e+09
6e+09
7e+09
8e+09
0 100 200 300 400 500 600 700 800 900 1000
Rat
e(bp
s)
Time(s)
ST1ST2ST3ST4ST5ST6
![Page 35: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/35.jpg)
37IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Simulation with Asymmetric TopologySimulation with Asymmetric Topology
Goal: Study multiple bottleneck case ! Only one link is 1Gbps, others are all 10Gbps! Two sources should converge to 5 Gbps and Two at 0.5 Gbps
![Page 36: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/36.jpg)
38IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Simulation with Asymmetric TopologySimulation with Asymmetric Topology
! Conclusion: ECN works perfectly with multiple bottlenecks. The rate variations are small.
0.5G
4.5G
RateAllocated
![Page 37: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/37.jpg)
39IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Results for Baseline BCNResults for Baseline BCN
! Large Oscillations
0
1e+09
2e+09
3e+09
4e+09
5e+09
6e+09
7e+09
8e+09
9e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
SU1
0
5e+08
1e+09
1.5e+09
2e+09
2.5e+09
3e+09
3.5e+09
4e+09
4.5e+09
5e+09
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
SU3
4.5Gbps
0.5GbpsOptimal rate for ST3 and ST4
Optimal Ratefor ST1 and ST2
Time Time
Rate Rate
![Page 38: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/38.jpg)
40IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Asymmetric Topology: Queue LengthsAsymmetric Topology: Queue Lengths! Buffer Utilization at two congestion points with ECN
qeq
qeq
! Conclusion: Queues are stable in spite of different bottleneck rates.
ECN BCN
![Page 39: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/39.jpg)
41IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Bursty Traffic: ConfigurationBursty Traffic: Configuration
! On/Off UDP traffic with on/off periods taken from a paretodistribution! Average On/Off Time is 10 ms! Source rate at On Time is 10 Gbps
![Page 40: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/40.jpg)
42IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Bursty Traffic: ThroughputsBursty Traffic: Throughputs
Conclusion:! Four color curves are almost on the top of each other⇒ ECN converges to fair state very fast
0
2e+09
4e+09
6e+09
8e+09
1e+10
1.2e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Rat
e(bp
s)
Time(s)
Rate Allocation
SU1SU2SU3SU4
ECN 0
2e+09
4e+09
6e+09
8e+09
1e+10
1.2e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 0.11
Rat
e(bp
s)
Time(s)
Rate Allocation
SU1SU2SU3SU4
BCN
![Page 41: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/41.jpg)
43IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Bursty Traffic: Link UtilizationBursty Traffic: Link Utilization
! Conclusion: ECN has higher link utilization
0
2e+09
4e+09
6e+09
8e+09
1e+10
1.2e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Thr
ough
put a
t Cor
e S
witc
h(bp
s)
Time(s)
Throughput at Core Switch(bps)
Throughput
0
2e+09
4e+09
6e+09
8e+09
1e+10
1.2e+10
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1 0.11
Thr
ough
put a
t Cor
e S
witc
h(bp
s)
Time(s)
Throughput at Core Switch(bps)
Throughput
ECN BCN
![Page 42: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/42.jpg)
44IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Bursty Traffic: Queue LengthsBursty Traffic: Queue Lengths
! Conclusion: ECN has less chances of zero queue => Higher link utilization
0
20
40
60
80
100
120
140
160
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Buf
fer
Util
izat
ion(
pkts
)
Time(s)
Buffer Utilization
Buffer Utilization
0
10
20
30
40
50
60
0 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.1
Buf
fer
Util
izat
ion(
pkts
)
Time(s)
Buffer Utilization
Buffer Utilization
ECN BCN
![Page 43: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/43.jpg)
45IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
![Page 44: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/44.jpg)
46IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Choices for Congestion NotificationChoices for Congestion Notification1. BCN messages: No tags required on the data packets. BCN
contains rate and Congestion point ID (CPID).
Switch iSource Destination5 Mbps, i
Switch iSource DestinationTag
3. Some combination of the two: e.g., tags, BCN messages periodically
2. Rate limiter tags: Works if you have bi-directional traffic. The rates in the two directions do not have to be the same. No extrapackets. Tags contains the rate (no CPID required).
Tag
![Page 45: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/45.jpg)
47IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
RLT Tag Marking AlgorithmRLT Tag Marking Algorithm
! Tags always start with r = -1 (infinite rate)! Switch Marking Algorithm (Updates RLT Tags in all
packets with the “advertised rate” of the reverse direction)IF r = -1 or r>ri THEN r ← ri
Note that tags do not need to contain CPID.! Source Algorithm:
r ← ri
![Page 46: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/46.jpg)
48IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: 2Symmetric Topology: 2--Way TrafficWay Traffic
! Forward Traffic: UDP Bernoulli Traffic with 10 Gbps/source! Reverse traffic: Case A: 2 Gbps/source
Case B: 500 Mbps/source ! Forward ST1 and ST2 are periodically turned off for around 20
ms, i.e., the exact time is not the same! Simulation Time is 100 ms
![Page 47: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/47.jpg)
49IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Symmetric Topology: RLT Tag MethodSymmetric Topology: RLT Tag Method! Case A:
Rate=2.5G
Buffer Utilization = 16pkts
2G per source on reverse link
0.5G per source on reverse link
! Case B:
! Conclusion: RLT tag performance similar to BCN messages.
![Page 48: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/48.jpg)
50IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
FECNFECN
! Every nth packet has two RLT tags (forward RLT tag and reverse RLT tag)
! The sender initializes the forward RLT tag! The receiver copies the forward RLT tag in packets in
the reverse direction on the same flow! Source adjusts to the rate received! The tags contain the rate and flow id
SwitchNode 1 Node 2
![Page 49: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/49.jpg)
51IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Advantages of ECNAdvantages of ECN! Flexibility:
! Switches can base rates on resources other than one queue, e.g., sum of input and output queues, utilization of shared buffers, # of channels available on a wireless link, etc.
! Switches can give different rate to a flow based on traffic type, class of service, types of sources, VLANs
! Works perfectly on variable link speeds, e.g., wireless links
! Vendor differentiation
![Page 50: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/50.jpg)
52IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Pause and Queue Control FnPause and Queue Control Fn
! Pause is a special queue control function as shown above! Using High/Low rather than on/off may avoid deadlocks⇒ Multi-level Pause or soft-Pause
! Queue control idea is independent of ECN
q
1f(q) Off
On
q
1f(q) Off
On Pause withHysterisis
q
1f(q)
Low
High
q
1f(q) Low
High Multi-LevelPause
SoftPause
![Page 51: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/51.jpg)
53IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
CN CN vs vs NonNon--CN RegionsCN Regions
! Edge switches could provide proxy Rate limiting queues
EdgeSwitch
CNHost
Non-CNHost
CN Region Core
Switch
Non-CNSwitch
ProxyRate Limiter
Rate Limiter
![Page 52: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/52.jpg)
54IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Adaptive Measurement IntervalAdaptive Measurement Interval! The load measurement interval T can be fixed or variable.! Different switches can even use different T values or one
switch can change its interval arbitrarily.! Smaller T => Quick control but higher overhead if BCN
messages (no effect on overhead if RLT tags)! One possibility is to use large T when operating near the
optimal and use small T when away from the optimalT1 < T2. Initially we set T = T1.
! If |qeq-qi| <δ, T = T2, δis some small integer! Otherwise, T = T1
T1 T1Time
Queue
![Page 53: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/53.jpg)
55IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
SummarySummary
![Page 54: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/54.jpg)
56IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Summary (Cont)Summary (Cont)
![Page 55: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/55.jpg)
57IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
ReferencesReferences! Bobby Vandalore, Raj Jain, Rohit Goyal, Sonia Fahmy,
"Dynamic Queue Control Functions for ATM ABR Switch Schemes: Design and Analysis," Computer Networks, August 1999, Vol. 31, Issue 18, pp. 1935-1949. http://www.cse.wustl.edu/~jain/papers/cnis_qctrl.htm
![Page 56: Explicit Congestion Notification (ECN)grouper.ieee.org/groups/802/1/files/public/docs2006/au-jain-ecn... · 15/11/2006 · IEEE 802.1 Meeting Nov 14, 2006 Raj Jain Time to Convergence!](https://reader034.vdocuments.us/reader034/viewer/2022052008/601d4e17a909b55e4a2fa382/html5/thumbnails/56.jpg)
58IEEE 802.1 Meeting Nov 14, 2006 Raj Jain
Thank You!Thank You!