Maui's early style throttling policies are controlled via a large number of independent parameters. Throttling policies control and constrain instantaneous resource usage. They would, for example, allow a site to limit a user to running only 6 jobs at any given time or prevent a group from utilizing more than 40 total processors at any given time. They DONOT control historical usage. This is handled using Maui's Fairshare facility. Also, unlike Maui 3.0.7 and higher, early style throttling did not allow credential specific limits.
Subject to the above constraints, Maui's early throttling
policy facility is still a very useful tool in establishing fair
resource usage and may be used in conjunction with Fairshare, QOS,
and Priority features to establish
significant control over cluster behavior. The table below lists
the parameters associated with Maui's early style throttling.
NOTE: In all cases, three parameters are grouped together.
The first, 'MAX*POLICY' must be set to ON in order for the
policy to be enforced. The second, 'MAX*COUNT', constrains
the 'hard limit' which the scheduler must never violate under any
conditions. The third, 'SMAX*COUNT', is called a 'soft
limit' and if specified, will set a lower, more constraining limit
which the scheduler should never violate unless no other jobs are available.
Parameter | Details | Example |
MAXJOBPERUSERPOLICY
MAXJOBPERUSERCOUNT SMAXJOBPERUSERCOUNT |
limits the maximum total number of jobs any given user may have active (running) simultaneously | MAXJOBPERUSERPOLICY ON
MAXJOBPERUSERCOUNT 4 (allow each user to run up to 4 jobs simultaneously) |
MAXPROCPERUSERPOLICY
MAXPROCPERUSERCOUNT SMAXPROCPERUSERCOUNT |
limits the maximum total number of processors any given user may have active (allocated to running jobs) simultaneously | MAXPROCPERUSERPOLICY ON
MAXPROCPERUSERCOUNT 32 (allow each user to utilize up to 32 processors simultaneously) |
MAXNODEPERUSERPOLICY
MAXNODEPERUSERCOUNT SMAXNODEPERUSERCOUNT |
limits the maximum total number of nodes any given user may have active (allocated to running jobs) simultaneously | MAXNODEPERUSERPOLICY ON
MAXNODEPERUSERCOUNT 16 SMAXNODEPERUSERCOUNT 8 (allow each user to utilize up to 8 nodes simultaneously by default. If no other jobs can run and idle nodes are available, allow each user to utilize up to 16 nodes simultaneously.) |
MAXPROCSECONDPERUSERPOLICY
MAXPROCSECONDPERUSERCOUNT SMAXPROCSECONDPERUSERCOUNT |
limits the maximum total number of processor-seconds any given user may have active (allocated to running jobs) simultaneously. NOTE: processor-seconds associated with any given job is calculated as PROCESSORS * REMAININGWALLTIME | MAXPROCSECONDPERUSERPOLICY ON
MAXPROCSECONDPERUSERCOUNT 20000 (allow each user to utilize up to 20000 processor-seconds simultaneously) |
MAXJOBQUEUEDPERUSERPOLICY
MAXJOBQUEUEDPERUSERCOUNT SMAXJOBQUEUEDPERUSERCOUNT |
limits the maximum total number of idle jobs associated with each user which Maui will consider eligible for scheduling | MAXJOBQUEUEDPERUSERPOLICY ON
MAXJOBQUEUEDPERUSERCOUNT 3 (Maui will only consider 3 idle jobs per user in each scheduling iteration) |
MAXPEPERUSERPOLICY
MAXPEPERUSERCOUNT SMAXPEPERUSERCOUNT |
limits the maximum total number of processor-equivalents any given user may have active (running) simultaneously | MAXPEPERUSERPOLICY ON
MAXPEPERUSERCOUNT 48 (allow each user have up to 48 PE's allocated to active jobs simultaneously) |
MAXJOBPERGROUPPOLICY
MAXJOBPERGROUPCOUNT SMAXJOBPERGROUPCOUNT |
limits the maximum total number of jobs any given group may have active (running) simultaneously | MAXJOBPERGROUPPOLICY ON
MAXJOBPERGROUPCOUNT 4 (allow each group to run up to 4 jobs simultaneously) |
MAXPROCPERGROUPPOLICY
MAXPROCPERGROUPCOUNT SMAXPROCPERGROUPCOUNT |
limits the maximum total number of processors any given group may have active (allocated to running jobs) simultaneously | MAXPROCPERGROUPPOLICY ON
MAXPROCPERGROUPCOUNT 32 (allow each group to utilize up to 32 processors simultaneously) |
MAXNODEPERGROUPPOLICY
MAXNODEPERGROUPCOUNT SMAXNODEPERGROUPCOUNT |
limits the maximum total number of nodes any given group may have active (allocated to running jobs) simultaneously | MAXNODEPERGROUPPOLICY ON
MAXNODEPERGROUPCOUNT 16 SMAXNODEPERGROUPCOUNT 8 (allow each group to utilize up to 8 nodes simultaneously by default. If no other jobs can run and idle nodes are available, allow each group to utilize up to 16 nodes simultaneously.) |
MAXPROCSECONDPERGROUPPOLICY
MAXPROCSECONDPERGROUPCOUNT SMAXPROCSECONDPERGROUPCOUNT |
limits the maximum total number of processor-seconds any given group may have active (allocated to running jobs) simultaneously. NOTE: processor-seconds associated with any given job is calculated as PROCESSORS * REMAININGWALLTIME | MAXPROCSECONDPERGROUPPOLICY ON
MAXPROCSECONDPERGROUPCOUNT 20000 (allow each group to utilize up to 20000 processor-seconds simultaneously) |
MAXJOBQUEUEDPERGROUPPOLICY
MAXJOBQUEUEDPERGROUPCOUNT SMAXJOBQUEUEDPERGROUPCOUNT |
limits the maximum total number of idle jobs associated with each group which Maui will consider eligible for scheduling | MAXJOBQUEUEDPERGROUPPOLICY ON
MAXJOBQUEUEDPERGROUPCOUNT 3 (Maui will only consider 3 idle jobs per group in each scheduling iteration) |
MAXPEPERGROUPPOLICY
MAXPEPERGROUPCOUNT SMAXPEPERGROUPCOUNT |
limits the maximum total number of processor-equivalents any given group may have active (running) simultaneously | MAXPEPERGROUPPOLICY ON
MAXPEPERGROUPCOUNT 48 (allow each group have up to 48 PE's allocated to active jobs simultaneously) |
MAXJOBPERACCOUNTPOLICY
MAXJOBPERACCOUNTCOUNT SMAXJOBPERACCOUNTCOUNT |
limits the maximum total number of jobs any given account may have active (running) simultaneously | MAXJOBPERACCOUNTPOLICY ON
MAXJOBPERACCOUNTCOUNT 4 (allow each account to run up to 4 jobs simultaneously) |
MAXPROCPERACCOUNTPOLICY
MAXPROCPERACCOUNTCOUNT SMAXPROCPERACCOUNTCOUNT |
limits the maximum total number of processors any given account may have active (allocated to running jobs) simultaneously | MAXPROCPERACCOUNTPOLICY ON
MAXPROCPERACCOUNTCOUNT 32 (allow each account to utilize up to 32 processors simultaneously) |
MAXNODEPERACCOUNTPOLICY
MAXNODEPERACCOUNTCOUNT SMAXNODEPERACCOUNTCOUNT |
limits the maximum total number of nodes any given account may have active (allocated to running jobs) simultaneously | MAXNODEPERACCOUNTPOLICY ON
MAXNODEPERACCOUNTCOUNT 16 SMAXNODEPERACCOUNTCOUNT 8 (allow each account to utilize up to 8 nodes simultaneously by default. If no other jobs can run and idle nodes are available, allow each account to utilize up to 16 nodes simultaneously.) |
MAXPROCSECONDPERACCOUNTPOLICY
MAXPROCSECONDPERACCOUNTCOUNT SMAXPROCSECONDPERACCOUNTCOUNT |
limits the maximum total number of processor-seconds any given account may have active (allocated to running jobs) simultaneously. NOTE: processor-seconds associated with any given job is calculated as PROCESSORS * REMAININGWALLTIME | MAXPROCSECONDPERACCOUNTPOLICY ON
MAXPROCSECONDPERACCOUNTCOUNT 20000 (allow each account to utilize up to 20000 processor-seconds simultaneously) |
MAXJOBQUEUEDPERACCOUNTPOLICY
MAXJOBQUEUEDPERACCOUNTCOUNT SMAXJOBQUEUEDPERACCOUNTCOUNT |
limits the maximum total number of idle jobs associated with each account which Maui will consider eligible for scheduling | MAXJOBQUEUEDPERACCOUNTPOLICY ON
MAXJOBQUEUEDPERACCOUNTCOUNT 3 (Maui will only consider 3 idle jobs per account in each scheduling iteration) |
MAXPEPERACCOUNTPOLICY
MAXPEPERACCOUNTCOUNT SMAXPEPERACCOUNTCOUNT |
limits the maximum total number of processor-equivalents any given account may have active (running) simultaneously | MAXPEPERACCOUNTPOLICY ON
MAXPEPERACCOUNTCOUNT 48 (allow each account have up to 48 PE's allocated to active jobs simultaneously) |