moab, torque, and gold in a heterogeneous, federated …acaird/mc09.pdf · at the university of...
TRANSCRIPT
![Page 1: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/1.jpg)
Who and What Torque Gold Moab Future Questions
Moab, TORQUE, and Goldin a Heterogeneous, Federated Computing System
at the University of Michigan
Andrew CairdMatthew Britt Brock Palen
September 18, 2009
![Page 2: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/2.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 3: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/3.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 4: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/4.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 5: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/5.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 6: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/6.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 7: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/7.jpg)
Who and What Torque Gold Moab Future Questions
Who We Are
College of Engineering “centralized” HPC support
Been trying this for 15+ years
We aren’t the College of Literature, Sciences, and Arts; wearen’t the Medical School; we aren’t the Department ofAstronomy; we aren’t any of the other 15 schools or colleges;although on Saturdays in the Fall, we are one University
We are three full-time employees, one student employee, andmuch support from Engineering Central IT
![Page 8: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/8.jpg)
Who and What Torque Gold Moab Future Questions
What We Support
3,488 cores in 664 systems
32 hardware owners
450+ unique users over the past 6 months
73TB Lustre storage
74 unique software titles, 127 versions, 14 license restricted
9 Tesla S1070s with 4 GPUs each
100 Infiniband-connected nodes in 4 switches
2 architectures: Opteron and Xeon
19 individual CPU types based on clock speed and core count(15 Opteron, 4 Xeon)
and some other stuff: SGI Altix with 32 cores of Itanium andan Apple XServe cluster with 400 cores of G5 (that’s twomore architectures)
![Page 9: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/9.jpg)
Who and What Torque Gold Moab Future Questions
What We Support
3,488 cores in 664 systems
32 hardware owners
450+ unique users over the past 6 months
73TB Lustre storage
74 unique software titles, 127 versions, 14 license restricted
9 Tesla S1070s with 4 GPUs each
100 Infiniband-connected nodes in 4 switches
2 architectures: Opteron and Xeon
19 individual CPU types based on clock speed and core count(15 Opteron, 4 Xeon)
and some other stuff: SGI Altix with 32 cores of Itanium andan Apple XServe cluster with 400 cores of G5 (that’s twomore architectures)
![Page 10: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/10.jpg)
Who and What Torque Gold Moab Future Questions
What We Support
3,488 cores in 664 systems
32 hardware owners
450+ unique users over the past 6 months
73TB Lustre storage
74 unique software titles, 127 versions, 14 license restricted
9 Tesla S1070s with 4 GPUs each
100 Infiniband-connected nodes in 4 switches
2 architectures: Opteron and Xeon
19 individual CPU types based on clock speed and core count(15 Opteron, 4 Xeon)
and some other stuff: SGI Altix with 32 cores of Itanium andan Apple XServe cluster with 400 cores of G5 (that’s twomore architectures)
![Page 11: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/11.jpg)
Who and What Torque Gold Moab Future Questions
How Do We Do It?
Torque, Gold, and Moab
(surprise)
![Page 12: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/12.jpg)
Who and What Torque Gold Moab Future Questions
How Do We Do It?
Torque, Gold, and Moab
(surprise)
![Page 13: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/13.jpg)
Who and What Torque Gold Moab Future Questions
Torque
Our Torque set-up is pretty plain:
we assign properties to nodes
we rely a lot on a healthcheck script to monitor:
local disk space and filesystem state (checking for read-only)NFS, Lustre, and AFS mountsInfiniband connectivity for nodes with IBOut-of-memory warningssshd dying
we sometimes run a pro- or epilogue script
we monitor disk to support job requests for local disk space
![Page 14: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/14.jpg)
Who and What Torque Gold Moab Future Questions
Torque
Our Torque set-up is pretty plain:
we assign properties to nodes
we rely a lot on a healthcheck script to monitor:
local disk space and filesystem state (checking for read-only)NFS, Lustre, and AFS mountsInfiniband connectivity for nodes with IBOut-of-memory warningssshd dying
we sometimes run a pro- or epilogue script
we monitor disk to support job requests for local disk space
![Page 15: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/15.jpg)
Who and What Torque Gold Moab Future Questions
Torque
Our Torque set-up is pretty plain:
we assign properties to nodes
we rely a lot on a healthcheck script to monitor:
local disk space and filesystem state (checking for read-only)NFS, Lustre, and AFS mountsInfiniband connectivity for nodes with IBOut-of-memory warningssshd dying
we sometimes run a pro- or epilogue script
we monitor disk to support job requests for local disk space
![Page 16: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/16.jpg)
Who and What Torque Gold Moab Future Questions
Gold
We only use Gold for collecting accounting data, not settingpolicy.
We allow Gold to auto-create accounts, then we have amanual process (named Matthew) that fills in our local data,like Name, Department, College, Adviser, etc.
We have developed a handful of scripts to pull together Golddata for internal consumption and presentation.
CivilEngineering
NavalArch&MarineEng
ComputerEngineering
FinancialEngineering
IndustrialandOpera<onsEngineering
CivilandEnvironmentalEngineering
AOSS
BiomedicalEngineering
NERS
EECS
ChemicalEngineering
MechanicalEngineering
MaterialsScienceandEngineering
AerospaceEngineering
![Page 17: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/17.jpg)
Who and What Torque Gold Moab Future Questions
Moab
To manage our environment, we use:
standing reservations
quality of service settings
accounts
node sets
Unix groups
CPU speed
rollback reservations
fairshare
preemption
node features from Torque
![Page 18: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/18.jpg)
Who and What Torque Gold Moab Future Questions
Policies
We use Moab to represent our policies, the first level of policy is:
jobs from hardware owners should use their hardware first,overflowing to public nodes if job requirements can be met
if hardware is idle, anyone can use it as long they agree to bepreempted
jobs can “overflow” from owned nodes to “public” nodes
no one can use more than 32 cores, plus whatever they ownunless they are using preemption, then they can use 196 cores
unless they aren’t Engineers, then each user constrained to apool of 32 total cores
![Page 19: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/19.jpg)
Who and What Torque Gold Moab Future Questions
Policies
We use Moab to represent our policies, the first level of policy is:
jobs from hardware owners should use their hardware first,overflowing to public nodes if job requirements can be met
if hardware is idle, anyone can use it as long they agree to bepreempted
jobs can “overflow” from owned nodes to “public” nodes
no one can use more than 32 cores, plus whatever they ownunless they are using preemption, then they can use 196 cores
unless they aren’t Engineers, then each user constrained to apool of 32 total cores
![Page 20: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/20.jpg)
Who and What Torque Gold Moab Future Questions
Policies
We use Moab to represent our policies, the first level of policy is:
jobs from hardware owners should use their hardware first,overflowing to public nodes if job requirements can be met
if hardware is idle, anyone can use it as long they agree to bepreempted
jobs can “overflow” from owned nodes to “public” nodes
no one can use more than 32 cores, plus whatever they ownunless they are using preemption, then they can use 196 cores
unless they aren’t Engineers, then each user constrained to apool of 32 total cores
![Page 21: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/21.jpg)
Who and What Torque Gold Moab Future Questions
Moab config
Our simplest case is an owner, a set of nodes, and a set of users,which we configure like this:
ACCOUNTCFG[mikehart]
MEMBERULIST=adamvh,ajhunte,[...],mikehart,[...] QDEF=mikehart QLIST=mikehart,cac,preempt
QOSCFG[mikehart] MAXPROC[USER]=64
SRCFG[mikehart] ACCOUNTLIST=mikehart+,cacstaff
SRCFG[mikehart] QOSLIST=~preempt
SRCFG[mikehart] HOSTLIST=nyx0590,nyx0591,nyx0592,nyx0593,nyx0594,nyx0595,nyx0596,nyx0597
SRCFG[mikehart] OWNER=ACCT:mikehart
SRCFG[mikehart] PERIOD=INFINITY
SRCFG[mikehart] FLAGS=IGNSTATE,OWNERPREEMPT
![Page 22: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/22.jpg)
Who and What Torque Gold Moab Future Questions
Hardware that Moab must Understand
![Page 23: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/23.jpg)
Who and What Torque Gold Moab Future Questions
Hardware that Moab must Understand
Har
dw
are:
AO
wner
:A
Har
dw
are:
AO
wner
:B
Har
dw
are:
BO
wner
:B
Har
dw
are:
CO
wner
:C
![Page 24: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/24.jpg)
Who and What Torque Gold Moab Future Questions
Hardware that Moab must Understand
Har
dw
are:
AO
wner
:A
Har
dw
are:
AO
wner
:B
Har
dw
are:
BO
wner
:B
Har
dw
are:
CO
wner
:C
IB
IB
IB
IB
GPU
GPU
GPU
![Page 25: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/25.jpg)
Who and What Torque Gold Moab Future Questions
Hardware that Moab must Understand
Har
dw
are:
AO
wner
:A
Har
dw
are:
AO
wner
:B
Har
dw
are:
BO
wner
:B
Har
dw
are:
CO
wner
:C
IB
IB
IB
IB
GPU
GPU
GPU
owner preempt owner / IB owner / lowowner / low
owner / high
![Page 26: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/26.jpg)
Who and What Torque Gold Moab Future Questions
Moab’s Decisions
Job
Adjust Priority(group, fairshare)
At CPUuse limit
Softwarelic. satisfied
NodesetsSatisfied
Owner Not Owner
Owner HWAttr. Satisfied
Execute onPublic
No Owner'sHW full
HW Attr.Satisfied
Preemptible
Yes
Execute onOwned
HW: cpu speed, mem,features from Torque:
cpu type, owner, ib, gpuCPU Limits: X for owner,
Y for non-owner, Z for preempt
![Page 27: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/27.jpg)
Job
Adjust Priority(group, fairshare)
At CPUuse limit
Softwarelic. satisfied
NodesetsSatisfied
Owner Not Owner
Owner HWAttr. Satisfied
Execute onPublic
No Owner'sHW full
HW Attr.Satisfied
Preemptible
Yes
Execute onOwned
HW: cpu speed, mem,features from Torque:
cpu type, owner, ib, gpuCPU Limits: X for owner,
Y for non-owner, Z for preempt
![Page 28: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/28.jpg)
Job
Adjust Priority(group, fairshare)
At CPUuse limit
Softwarelic. satisfied
NodesetsSatisfied
Owner Not Owner
Owner HWAttr. Satisfied
Execute onPublic
No Owner'sHW full
HW Attr.Satisfied
Preemptible
Yes
Execute onOwned
HW: cpu speed, mem,features from Torque:
cpu type, owner, ib, gpuCPU Limits: X for owner,
Y for non-owner, Z for preempt
![Page 29: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/29.jpg)
Who and What Torque Gold Moab Future Questions
Moab: where the rules live
Moab is where all the rules are:
there are a lot of rules
within the overarching set of rules, there can be a lot of ruleslocal to an owner’s hardware
the rules can change
we are adding owners regularly
Moab is invaluable in enforcing the rules. (Although sometimes wewish it was a little more transparent in what it was doing.)
![Page 30: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/30.jpg)
Who and What Torque Gold Moab Future Questions
Moab: where the rules live
Moab is where all the rules are:
there are a lot of rules
within the overarching set of rules, there can be a lot of ruleslocal to an owner’s hardware
the rules can change
we are adding owners regularly
Moab is invaluable in enforcing the rules. (Although sometimes wewish it was a little more transparent in what it was doing.)
![Page 31: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/31.jpg)
Who and What Torque Gold Moab Future Questions
Moab: where the rules live
Moab is where all the rules are:
there are a lot of rules
within the overarching set of rules, there can be a lot of ruleslocal to an owner’s hardware
the rules can change
we are adding owners regularly
Moab is invaluable in enforcing the rules. (Although sometimes wewish it was a little more transparent in what it was doing.)
![Page 32: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/32.jpg)
Who and What Torque Gold Moab Future Questions
Near Future
Turning preemption back on
Using Gold for allocations: reflecting policy
“Floating” reservations based on node type: encouragingsharing
More sophisticated preemption rules: preempt based on stateof preemptee
Performance improvements in scheduling and userresponsiveness
![Page 33: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/33.jpg)
Who and What Torque Gold Moab Future Questions
Distant Future
Dynamic cloud provisioning based on job attributes
Dynamic diskless node provisioning from a computer labenvironment
Preemption policies based on any requestable attribute:software, special hardware, disk, etc.
Multi-layer preemption: A can preempt B, and C; B canpreempt C; C just suffers.
Preemptability based on policy: fairshare, allocation, etc.
![Page 34: Moab, TORQUE, and Gold in a Heterogeneous, Federated …acaird/mc09.pdf · at the University of Michigan Andrew Caird Matthew Britt Brock Palen September 18, 2009. Who and WhatTorqueGold](https://reader036.vdocuments.us/reader036/viewer/2022081613/5fbbf90ff188f2050b511e23/html5/thumbnails/34.jpg)
Who and What Torque Gold Moab Future Questions
Questions?
Andy Matt [email protected] [email protected] [email protected]