11.8 Using a Local Queue
Moab allows jobs to be submitted directly to the scheduler. With a local queue, Moab is able to directly manage the job or translate it for resubmission to a standard resource manager queue. There are multiple advantages to using a local queue:
- Jobs may be translated from one resource manager job submission language to another (such as submitting a PBS job and running it on an LSF cluster).
- Jobs may be migrated from one local resource manager to another.
- Jobs may be migrated to remote systems using Moab peer-to-peer functionality.
- Jobs may be dynamically modified and optimized by Moab to improve response time and system utilization.
- Jobs may be dynamically modified to account for system hardware failures or other issues.
- Jobs may be dynamically modified to conform to site policies and constraints.
- Grid jobs are supported.
11.8.1 Local Queue Configuration
A local queue is configured just like a standard resource manager queue. It may have defaults, limits, resource mapping, and credential access constraints. The following table describes the most common settings:
| Default queue | |||
| Format: | RMCFG[internal] DEFAULTCLASS=<CLASSID> |
||
| Description: | The job class/queue assigned to the job if one is not explicitly requested by the submittor.
|
||
| Example: | RMCFG[internal] DEFAULTCLASS=batch |
||
| Class default resource requirements | |||
| Format: |
CLASSCFG[<CLASSID>] DEFAULT.FEATURES=<X> CLASSCFG[<CLASSID>] DEFAULT.MEM=<X> CLASSCFG[<CLASSID>] DEFAULT.NODE=<X> CLASSCFG[<CLASSID>] DEFAULT.NODESET=<X> CLASSCFG[<CLASSID>] DEFAULT.PROC=<X> CLASSCFG[<CLASSID>] DEFAULT.WCLIMIT=<X> |
||
| Description: | The settings assigned to the job if not explicitly set by the submittor. Default values are available for node features, per task memory, node count, nodeset configuration, processor count, and wallclock limit. | ||
| Example: |
CLASSCFG[batch] DEFAULT.WCLIMIT=4 DEFAULT.FEATURES=matlab or
CLASSCFG[batch] DEFAULT.WCLIMIT=4 |
||
| Class maximum resource limits | |||
| Format: |
CLASSCFG[<CLASSID>] MAX.FEATURES=<X> CLASSCFG[<CLASSID>] MAX.NODE=<X> CLASSCFG[<CLASSID>] MAX.PROC=<X> CLASSCFG[<CLASSID>] MAX.WCLIMIT=<X> | ||
| Description: |
The maximum node features, node count, processor count, and wallclock limit allowed for a job submitted to the class/queue. If these limits are not satisfied, the job is not accepted and the submit request fails.
MAX.FEATURESindicates that only the listed features may be requested by a job. |
||
| Example: |
CLASSCFG[smalljob] MAX.PROC=4 MAX.FEATURES=slow,matlab or
CLASSCFG[smalljob] MAX.PROC=4 |
||
| Class minimum resource limits | |||
| Format: |
CLASSCFG[<CLASSID>] MIN.FEATURES=<X> CLASSCFG[<CLASSID>] MIN.NODE=<X> CLASSCFG[<CLASSID>] MIN.PROC=<X> CLASSCFG[<CLASSID>] MIN.WCLIMIT=<X> |
||
| Description: |
The minimum node features, node count, processor count, and wallclock limit allowed for a job submitted to the class/queue. If these limits are not satisfied, the job is not accepted and the submit request fails.
MIN.FEATURESindicates that only the listed features may be requested by a job. |
||
| Example: |
CLASSCFG[bigjob] MIN.PROC=4 MIN.WCLIMIT=1:00:00 or
CLASSCFG[bigjob] MIN.PROC=4 |
||
| Class access | |||
| Format: | CLASSCFG[<CLASSID>] REQUIREDUSERLIST=<USERID>[,<USERID>]... |
||
| Description: | The list of users who may submit jobs to the queue. | ||
| Example: | CLASSCFG[math] REQUIREDUSERLIST=john,steve |
||
| Available resources | |||
| Format: | CLASSCFG[<CLASSID>] HOSTLIST=<HOSTID>[,<HOSTID>]... |
||
| Description: | The list of nodes that jobs in the queue may use. | ||
| Example: | CLASSCFG[special] HOSTLIST=node001,node003,node13 |
||
Class mapping between multiple sites is described in the section on Moab grid facilities.
If a job is submitted directly to the resource manager used by the local queue, the class default resource requirements are not applied. Also, if the job violates a local queue limitation, the job is accepted by the resource manager, but placed in the Blocked state.