designing parallel operating systems using modern interconnects
DESCRIPTION
Designing Parallel Operating Systems using Modern Interconnects. Toward Realistic Evaluation of Job Scheduling Strategies. Eitan Frachtenberg With Dror Feitelson, Fabrizio Petrini, and Juan Fernandez. Computer and Computational Sciences Division Los Alamos National Laboratory. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/1.jpg)
Eitan Frachtenberg December 2004
1
Toward Realistic Evaluation of Parallel Job Strategies
Designing Parallel Operating Systems
using Modern Interconnects
Toward Realistic Evaluation of Job Scheduling Strategies
Eitan Frachtenberg
With
Dror Feitelson, Fabrizio Petrini, and Juan Fernandez
Computer and Computational Sciences DivisionLos Alamos National Laboratory
Ideas that change the world
![Page 2: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/2.jpg)
Eitan Frachtenberg December 2004
2
Toward Realistic Evaluation of Parallel Job Strategies
Outline
![Page 3: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/3.jpg)
Eitan Frachtenberg December 2004
3
Toward Realistic Evaluation of Parallel Job Strategies
Parallel Job Scheduling
![Page 4: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/4.jpg)
Eitan Frachtenberg December 2004
4
Toward Realistic Evaluation of Parallel Job Strategies
Scheduling Taxonomy
“”“”
![Page 5: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/5.jpg)
Eitan Frachtenberg December 2004
5
Toward Realistic Evaluation of Parallel Job Strategies
Backfilling
![Page 6: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/6.jpg)
Eitan Frachtenberg December 2004
6
Toward Realistic Evaluation of Parallel Job Strategies
Time Sharing
![Page 7: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/7.jpg)
Eitan Frachtenberg December 2004
7
Toward Realistic Evaluation of Parallel Job Strategies
none implicit hybrid explicit
Local DCS ICS/SB CC PB FCS BCS GS
Time Sharing Spectrum
coordinationcoordination
![Page 8: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/8.jpg)
Eitan Frachtenberg December 2004
8
Toward Realistic Evaluation of Parallel Job Strategies
Without Timesharing
“”“”
![Page 9: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/9.jpg)
Eitan Frachtenberg December 2004
9
Toward Realistic Evaluation of Parallel Job Strategies
Time Sharing - GS
“”“”
![Page 10: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/10.jpg)
Eitan Frachtenberg December 2004
10
Toward Realistic Evaluation of Parallel Job Strategies
Time Sharing - SB
![Page 11: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/11.jpg)
Eitan Frachtenberg December 2004
11
Toward Realistic Evaluation of Parallel Job Strategies
Time Sharing - FCS
![Page 12: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/12.jpg)
Eitan Frachtenberg December 2004
12
Toward Realistic Evaluation of Parallel Job Strategies
FCS Classification
Granularity
Block times
Fine Coarse
Short Long
CS
Always gang-scheduled
F
Preferably gang-scheduled
DC
Locally scheduled
![Page 13: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/13.jpg)
Eitan Frachtenberg December 2004
13
Toward Realistic Evaluation of Parallel Job Strategies
Evaluation Challenges
“”“”
![Page 14: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/14.jpg)
Eitan Frachtenberg December 2004
14
Toward Realistic Evaluation of Parallel Job Strategies
Emulation Methodology
![Page 15: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/15.jpg)
Eitan Frachtenberg December 2004
15
Toward Realistic Evaluation of Parallel Job Strategies
Evaluation by Emulation
––
![Page 16: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/16.jpg)
Eitan Frachtenberg December 2004
16
Toward Realistic Evaluation of Parallel Job Strategies
Experimental Environment
![Page 17: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/17.jpg)
Eitan Frachtenberg December 2004
17
Toward Realistic Evaluation of Parallel Job Strategies
Experiments Overview
’’
![Page 18: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/18.jpg)
Eitan Frachtenberg December 2004
18
Toward Realistic Evaluation of Parallel Job Strategies
Effect of MPL
![Page 19: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/19.jpg)
Eitan Frachtenberg December 2004
19
Toward Realistic Evaluation of Parallel Job Strategies
MPL – Response Time
![Page 20: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/20.jpg)
Eitan Frachtenberg December 2004
20
Toward Realistic Evaluation of Parallel Job Strategies
MPL – Bounded Slowdown
![Page 21: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/21.jpg)
Eitan Frachtenberg December 2004
21
Toward Realistic Evaluation of Parallel Job Strategies
Effect of Backfilling
“”“”
![Page 22: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/22.jpg)
Eitan Frachtenberg December 2004
22
Toward Realistic Evaluation of Parallel Job Strategies
Backfilling – Response time
![Page 23: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/23.jpg)
Eitan Frachtenberg December 2004
23
Toward Realistic Evaluation of Parallel Job Strategies
Effect of Time Quantum
![Page 24: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/24.jpg)
Eitan Frachtenberg December 2004
24
Toward Realistic Evaluation of Parallel Job Strategies
Time Quantum – Response Time
![Page 25: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/25.jpg)
Eitan Frachtenberg December 2004
25
Toward Realistic Evaluation of Parallel Job Strategies
Effect of Load
![Page 26: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/26.jpg)
Eitan Frachtenberg December 2004
26
Toward Realistic Evaluation of Parallel Job Strategies
Load – Response Time
![Page 27: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/27.jpg)
Eitan Frachtenberg December 2004
27
Toward Realistic Evaluation of Parallel Job Strategies
Load - Bounded Slowdown
![Page 28: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/28.jpg)
Eitan Frachtenberg December 2004
28
Toward Realistic Evaluation of Parallel Job Strategies
Response Time Median
![Page 29: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/29.jpg)
Eitan Frachtenberg December 2004
29
Toward Realistic Evaluation of Parallel Job Strategies
Bounded Slowdown Median
![Page 30: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/30.jpg)
Eitan Frachtenberg December 2004
30
Toward Realistic Evaluation of Parallel Job Strategies
500 Shortest jobs CDF
![Page 31: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/31.jpg)
Eitan Frachtenberg December 2004
31
Toward Realistic Evaluation of Parallel Job Strategies
500 Longest jobs CDF
![Page 32: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/32.jpg)
Eitan Frachtenberg December 2004
32
Toward Realistic Evaluation of Parallel Job Strategies
Scientific Applications
![Page 33: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/33.jpg)
Eitan Frachtenberg December 2004
33
Toward Realistic Evaluation of Parallel Job Strategies
Response Time
![Page 34: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/34.jpg)
Eitan Frachtenberg December 2004
34
Toward Realistic Evaluation of Parallel Job Strategies
Bounded Slowdown
![Page 35: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/35.jpg)
Eitan Frachtenberg December 2004
35
Toward Realistic Evaluation of Parallel Job Strategies
Conclusions - methodology
![Page 36: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/36.jpg)
Eitan Frachtenberg December 2004
36
Toward Realistic Evaluation of Parallel Job Strategies
Conclusions - experiments
![Page 37: Designing Parallel Operating Systems using Modern Interconnects](https://reader035.vdocuments.us/reader035/viewer/2022081603/56813587550346895d9ce6b3/html5/thumbnails/37.jpg)
Eitan Frachtenberg December 2004
37
Toward Realistic Evaluation of Parallel Job Strategies
Time Quantum – Slowdown