effect of higher moments of job size distribution on the performance of an m/g/k system varun gupta...
Post on 22-Dec-2015
218 views
TRANSCRIPT
![Page 1: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/1.jpg)
Effect of higher moments of job size distribution on the performance of
an M/G/k system
VARUN GUPTA
Joint work with:
Mor Harchol-Balter
Carnegie Mellon University
Jim Dai, Bert Zwart
Georgia Institute of Technology
![Page 2: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/2.jpg)
2
Multi-server/resource sharing systems are the norm today
Multicore chips
Call centers
ServerFarms
![Page 3: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/3.jpg)
3
M/G/k: the classical multi-server model
Poisson arrivals (rate )
J1Ji+1JiJ2Ji+2
GOAL : Analysis of mean delay (time spent in buffer)
![Page 4: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/4.jpg)
4
M/G/k model assumptions and notation
• Poisson arrivals
• Service requirements (job sizes) are i.i.d.• S ≡ random variable for job sizes
• Define
• Define
Per server utilization or load:0 < < 1
Squared coefficient of variability (SCV) of job sizes:
C2 0
![Page 5: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/5.jpg)
5
M/G/k mean delay analysis
• Lets take a step back: M/G/1
![Page 6: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/6.jpg)
6
M/G/k mean delay analysis
• Lets take a step back: M/G/1
![Page 7: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/7.jpg)
7
M/G/k mean delay analysis
• Lee and Longton (1959)
– Simple and closed-form– Involves only first two moments of S– Exact for k=1– Asymptotically exact in heavy traffic [Köllerström[74]]
• No exact analysis exists• All closed-form approximations involve only the
first two moments of S – Takahashi[77], Hokstad[78], Nozaki Ross[78], Boxma
Cohen Huffels[79], Whitt [93], Kimura[94]
![Page 8: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/8.jpg)
8
But…
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 9: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/9.jpg)
9
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 10: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/10.jpg)
10
H2
• The H2 class has three degrees of freedom
• Can vary E[S3] while keeping first two moments constant
• Can numerically evaluate M/H2/k using the matrix analytic method
![Page 11: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/11.jpg)
11
E[Delay] vs. E[S3]k=10, E[S]=1, C2=19, =0.9
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6
E[Delay]
E[S3] X104
2-moment approx
E[Delay]M/H2/k
![Page 12: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/12.jpg)
12
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6X104
E[S3]
E[Delay]
E[Delay]M/H2/k
2-moment approx
E[S3] can have a huge impact on mean delay!
The mean delay decreases as E[S3] increases!
![Page 13: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/13.jpg)
13
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
x)
Intuition for the effect of E[S3]
x) = load due to jobs smaller than x E[S]=1 C2=19
x
![Page 14: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/14.jpg)
14
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
x)
E[S3]=600
Intuition for the effect of E[S3]
x) = load due to jobs smaller than x E[S]=1 C2=19
x
![Page 15: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/15.jpg)
15
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
x)
E[S3]=600
E[S3]=700
Intuition for the effect of E[S3]
x) = load due to jobs smaller than x E[S]=1 C2=19
x
![Page 16: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/16.jpg)
16
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
x)
E[S3]=600
E[S3]=700
E[S3]=1200
Intuition for the effect of E[S3]
x) = load due to jobs smaller than x E[S]=1 C2=19
x
![Page 17: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/17.jpg)
17
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
E[S3]=600
E[S3]=700
E[S3]=1200
E[S3]=15000
x) = load due to jobs smaller than x E[S]=1 C2=19
Intuition for the effect of E[S3]
x
x)
![Page 18: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/18.jpg)
18
0
0.2
0.4
0.6
0.8
1
0 5 10 15 20
As E[S3] increases (with fixed E[S] and E[S2]):• Load gets ‘concentrated’ on small jobs• Load due to ‘big’ jobs vanishes• Bigs become rarer, usually see small jobs only• Causes drop in E[Delay]M/H2/k
x
x)
Increasing E[S3]
Intuition for the effect of E[S3]
![Page 19: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/19.jpg)
19
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6X104
E[S3]
E[Delay]
E[Delay] vs. E[S3]k=10, E[S]=1, C2=19, =0.9
E[Delay]M/H2/k
2-moment approx
![Page 20: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/20.jpg)
20
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 21: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/21.jpg)
21
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 22: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/22.jpg)
22
{G|C2} ≡ positive distributions with mean 1 and SCV C2
E[Delay]
G1
G2
GAP Error of2-moment approx
![Page 23: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/23.jpg)
23
Our Theorems• Upper bound
• Lower bound– <1-1/k
– 1-1/k
![Page 24: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/24.jpg)
24
E[D
elay
]
GAP
![Page 25: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/25.jpg)
25
E[D
elay
]
0
D* has the smallest third
moment in {G|C2}
third moment as
0
![Page 26: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/26.jpg)
26
E[D
elay
]
Conjecture
![Page 27: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/27.jpg)
27
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 28: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/28.jpg)
28
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 29: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/29.jpg)
29
What about higher moments?
{G|C2}
H2
H*3
• H*3 class has four
degrees of freedom
• Can vary E[S4] while keeping first three moments constant
![Page 30: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/30.jpg)
30
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6X104
E[S3]
E[Delay]Increasing fourth moment
E[Delay] vs. E[S4]
k=10, E[S]=1, C2=19, =0.9
E[Delay]M/H2/k
2-moment approx
![Page 31: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/31.jpg)
31
0
1
2
3
4
5
6
7
0 1 2 3 4 5 6X104
E[S3]
E[Delay]Increasing fourth moment
E[Delay]M/H2/k
2-moment approx
• Even E[S4] can have a significant impact on mean delay!• High E[S4] can nullify the effect of E[S3]!
![Page 32: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/32.jpg)
32
E[D
elay
]
The BIG picture
LB1=E[Delay]M/D/k
UB1,2=(C2+1)E[Delay]M/D/k
LB1,2,3
UB1,2,3,4
LB1,2,3,4,5
Odd/Even moments refine the Lower/Upper bounds on mean delay
![Page 33: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/33.jpg)
33
Outline
Q1: Are 2 moments of S enough to reasonably approximate E[Delay]?
• Does the third moment have no/negligible effect?
Q2: How inaccurate can a 2-moment approximation be?
Q3: Are 3 moments enough? 4 moments?
![Page 34: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/34.jpg)
34
Conclusions
• Shown that 2-moment approximations for M/G/k are insufficient
• Shown bounds on inaccuracy of 2-moment only approximations– (C2+1) inaccuracy factor
• Observed alternating effects of odd and even moments
![Page 35: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/35.jpg)
35
Thank you!
![Page 36: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/36.jpg)
36
Open Questions
• Proof (or counter-example) of conjectures on bounds
• Are there other attributes of service distribution that characterize it better than moments?– For example, mean and variability of small and big
jobs
• Where do real world service distributions sit with respect to these attributes?
![Page 37: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/37.jpg)
37
{G|C2} ≡ positive distributions with mean 1 and SCV C2
H2
• The H2 class has three degrees of freedom (s, p, ps)
• Can vary E[S3] while holding first two moments constant
![Page 38: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/38.jpg)
38
Look at the moments of H2 … • Load due to big jobs vanishes as E[S3] increases
• When k>1, a big job does not block small jobs
• This reduces the effect of variability (C2) as third moment increases
![Page 39: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/39.jpg)
39
Observations
• < 1-1/k UB/LB (C2+1)– No 2-moment approximation can be accurate in this
case
• [Kiefer Wolfowitz] [Scheller-Wolf]: When > 1-1/k, E[Delay] is finite iff C2 is finite.– Matches with the conjectured lower bound– Also popular as the “0 spare server” case
![Page 40: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/40.jpg)
40
Proof outline: Upper bound
• THEOREM:
• PROOF: Consider the following service distribution
• Intuition for conjecture: k>1 should mitigate the effect of variability; D* exposes it completely
• Note: D* has the smallest third moment in {G|C2}
![Page 41: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/41.jpg)
41
Proof outline: Lower bound
• THEOREM:– < 1-1/k
– 1-1/k
• PROOF: Consider the following sequence of service distributions in {G|C2} as 0
![Page 42: Effect of higher moments of job size distribution on the performance of an M/G/k system VARUN GUPTA Joint work with: Mor Harchol-Balter Carnegie Mellon](https://reader030.vdocuments.us/reader030/viewer/2022032523/56649d805503460f94a63b72/html5/thumbnails/42.jpg)
42
What about higher moments?
{G|C2}
H2
H*3
H*3
• H*3 allows control over fourth
moment while holding first three moments fixed
• The fourth moment is minimized when p0=0 (H2 distribution)