![Page 1: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/1.jpg)
Tales of Time Scales
Ward WhittAT&T Labs – Research
Florham Park, NJ
![Page 2: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/2.jpg)
New Book
Stochastic-Process LimitsAn Introduction to Stochastic-Process Limits
and Their Application to Queues
Springer 2001
![Page 3: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/3.jpg)
“I won’t waste a minute to read that book.”
- Felix Pollaczek
![Page 4: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/4.jpg)
“Ideal for anyone working on their third Ph.D. in queueing theory”
- Agner Krarup Erlang
![Page 5: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/5.jpg)
Flow Modification
![Page 6: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/6.jpg)
Flow Modification
![Page 7: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/7.jpg)
Multiple Classes
1
Single Server
2
m
m ∞
![Page 8: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/8.jpg)
• Whitt, W. (1988) A light-traffic approximation for single-class departure processes from multi-class queues. Management Science 34, 1333-1346.
• Wischik, D. (1999) The output of a switch, or, effective bandwidths for networks. Queueing Systems 32, 383-396.
![Page 9: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/9.jpg)
M/G/1 Queue in a Random Environment
Let the arrival rate be a stochastic process with two states.
MMPP/G/1 is a special case.
![Page 10: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/10.jpg)
environment state
1 2
mean holding time (in environment state)
arrival rate
mean service time
1 5
0.500.92
1 1
ρ = 0.57Overall Traffic Intensity
![Page 11: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/11.jpg)
environment state
1 2
mean holding time (in environment state)
arrival rate
mean service time
1 5
0.502.00
1 1
ρ = 0.75Overall Traffic Intensity
![Page 12: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/12.jpg)
A Slowly Changing Environment
![Page 13: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/13.jpg)
environment state
1 2
mean holding time (in environment state)
arrival rate
mean service time
1M 5M
0.500.92
1 1
ρ = 0.57Overall Traffic Intensity
![Page 14: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/14.jpg)
What Matters?• Environment Process?
• Arrival and Service Processes?
• M?
![Page 15: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/15.jpg)
Nearly Completely Decomposable Markov Chains
P. J. Courtois, Decomposability, 1977
![Page 16: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/16.jpg)
What if the queue is unstable in one of the environment states?
![Page 17: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/17.jpg)
environment state
1 2
mean holding time (in environment state)
arrival rate
mean service time
1M 5M
0.502.00
1 1
ρ = 0.75Overall Traffic Intensity
![Page 18: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/18.jpg)
What Matters?• Environment Process?
• Arrival and Service Processes?
• M?
![Page 19: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/19.jpg)
Change Time Units
Measure time in units of M
i.e., divide time by M
![Page 20: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/20.jpg)
environment state
1 2
mean holding time (in environment state)
arrival rate
mean service time
1 5
0.50M2.00M
1/M 1/M
ρ = 0.75Overall Traffic Intensity
![Page 21: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/21.jpg)
Workload in Remaining Service TimeWith Deterministic Holding Times
1
![Page 22: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/22.jpg)
Steady-state workload tail probabilities in the MMPP/G/1 queue
0.40260 0.13739 0.04695 0.016040.41100 0.14350 0.05040 0.017700.44246 0.16168 0.06119 0.023160.52216 0.23002 0.01087 0.051680.37376 0.11418 0.03488 0.010660.37383 0.11425 0.03492 0.010670.37670 0.11669 0.03614 0.011200.38466 0.12398 0.03997 0.012890.37075 0.11183 0.03373 0.010170.37082 0.11189 0.03376 0.010190.37105 0.11208 0.03385 0.010230.37186 0.11281 0.03422 0.010380.37044 0.11159 0.03362 0.010130.37045 0.11160 0.03362 0.010130.37047 0.11164 0.03363 0.010130.37055 0.11169 0.03366 0.01015
4
22 , 4b
DEM
H c =
4
22 , 4b
DEM
H c =
4
22 , 4b
DEM
H c =
4
22 , 4b
DEM
H c =
2
3
4
10
10
10
10
sizefactor
M
service-timedistribution tail probability ( )P W x>
0.5x = 2.5x = 4.5x = 6.5x =
![Page 23: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/23.jpg)
G. L. Choudhury, A. Mandelbaum, M. I. Reiman and W. Whitt, “Fluid and diffusion limits for queues in slowly changing environments.” Stochastic Models 13 (1997) 121-146.
![Page 24: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/24.jpg)
Thesis:
Heavy-traffic limits for queues can help expose phenomena occurring
at different time scales.
Asymptotically, there may be a separation of time scales.
![Page 25: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/25.jpg)
Network Status Probe
![Page 26: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/26.jpg)
Heavy-Traffic Perspective
n-H Wn(nt) W(t)
0 < H < 1
n = (1 - )-1/(1-H)
⇒
ρSnapshot Principle
![Page 27: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/27.jpg)
Server SchedulingWith Delay and Switching Costs
Single Server
Multiple Classes
![Page 28: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/28.jpg)
Heavy-Traffic Limit for Workload
Wn W
Wn(t) = n-H Wn(nt)
0 < H < 1
n = (1 - )-1/(1-H)
⇒
ρ
![Page 29: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/29.jpg)
One Approach: Polling
Single Server
Multiple Classes
![Page 30: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/30.jpg)
Heavy-Traffic Averaging Principle
h-1 f(Wi,n(t)) dt h-1 ( f(aiuW(t)) du ) dt∫ ∫∫⇒
Wi,n(t) = n-H Wi,n(nt)
1
0
+hs
s
+hs
s
![Page 31: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/31.jpg)
• Coffman, E. G., Jr., Puhalskii, A. A. and Reiman, M. I. (1995) Polling systems with zero switchover times: a heavy-traffic averaging principle. Ann. Appl. Prob. 5, 681-719.
• Markowitz, D. M. and Wein, L. M. (2001)Heavy-traffic analysis of dynamic cyclic policies: a unified treatment of the single machine scheduling problem. Operations Res. 49, 246-270.
• Kushner, H. J. (2001) Heavy Traffic Analysis of Controlled Queueing and Communication Networks, Springer, New York.
![Page 32: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/32.jpg)
“My thesis has been that one path to the construction of a nontrivial theory of complex systems is by way of a
theory of hierarchy.”- H. A. Simon
•Holt, Modigliani, Muth and Simon, Planning Production, Inventories and Workforce, 1960.•Simon and Ando, Aggregation of variables in dynamic systems. Econometrica, 1961.•Ando, Fisher and Simon, Essays on the Structure of Social Science Models, 1963.
![Page 33: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/33.jpg)
![Page 34: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/34.jpg)
Application to Manufacturing
MRP
![Page 35: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/35.jpg)
mrp MRPmaterial requirements
planningManufacturing Resources
Planning
Long-Range Planning(Strategic)
Intermediate-Range Planning(Tactical)
Short-Term Control(Operational)
Management information system
Expand bill of materials
Orlicky (1975)
![Page 36: Tales of Time Scales - Columbia Universityww2040/Tales.pdf · Stochastic-Process Limits An Introduction to Stochastic-Process Limits and Their Application to Queues Springer 2001](https://reader034.vdocuments.us/reader034/viewer/2022050102/5f418d0eb30a2a1c332aa215/html5/thumbnails/36.jpg)
Hierarchical Decision Making in Stochastic Manufacturing Systems
- Suresh P. Sethi and Qing Zhang, 1994
0
inf [ ( ( )) ( ( ))]t
uE e h x t c u t dtρ
∞−
∈+∫A
( ) ( ) ( ),
0 ( ) ( )
x t u t z t
u t K t
= −
≤ ≤
&