Owner preemption allows jobs submitted by a reservation owner to preempt jobs submitted by other users. For more information, see Configuring and Managing Reservations. Owner preemption is enabled with the OWNERPREEMPT reservation flag.

To enable owner preemption

1. Make the following configurations to the moab.cfg file:

GUARANTEEDPREEMPTION TRUE
PREEMPTPOLICY <policy>
 
SRCFG[myrez] FLAGS=OWNERPREEMPT HOSTLIST=node01
SRCFG[myrez] OWNER=USER:john
SRCFG[myrez] USERLIST=jane,john PERIOD=INFINITY
 
QOSCFG[test1] QFLAGS=PREEMPTEE JOBFLAGS=restartable MEMBERULIST=john PRIORITY=100
QOSCFG[test2] QFLAGS=PREEMPTOR MEMBERULIST=john PRIORITY=10000

2. Set GUARANTEEDPREEMPTION to TRUE. (This locks the job on a node and keeps trying to preempt.)
3. Make sure that JOBNODEMATCHPOLICY is not set to EXACTNDODE.
4. Set the PREEMPTPOLCY type.
5. Set the OWNERPREEMPT flag.

SRCFG[myrez] FLAGS=OWNERPREEMPT HOSTLIST=node01

Optionally, if you want the owner preemption to override any PREEMPTMINTIME settings for PREEMPTEE jobs, you can set the OWNERPREEMPTIGNOREMINTIME flag as well.

6. Specify an owner.

SRCFG[myrez] OWNER=USER:john

If the non-owner job does not have a RESTARTABLE or REQUEUEABLE flag set, the job will cancel.

7. Submit a job to a user who is not the owner (in this example, jane).

[jane@g06]$ echo sleep 600 | msub -l walltime=600 -l procs=64

8. Examine the following output for showq and checkjob:

showq for jane's job:

Moab.1
[jane@g06]$ showq
 
active jobs------------------------ 
JOBID     USERNAME    STATE      PROCS    REMAINING    STARTTIME 
Moab.1    jane        Running    64       00:09:57     Mon Nov 14 12:07:52
 
1 active job     64 of 64 processors in use by local jobs (100.00%) 
1 of 1 nodes active (100.00%)
 
eligible jobs---------------------- 
JOBID     USERNAME    STATE     PROCS      WCLIMIT      QUEUETIME
 
0 eligible jobs
 
blocked jobs----------------------- 
JOBID     USERNAME    STATE     PROCS      WCLIMIT      QUEUETIME
 
0 blocked jobs
 
Total job: 1

checkjob for jane's job:

root@g06]# checkjob Moab.1 
job Moab.1
 
State: Running 
Creds: user:jane group:jane 
WallTime: 00:01:02 of 00:10:00 
SubmitTime: Mon Nov 14 12:07:52 
(Time Queued Total: 00:00:00 Eligible: 00:00:00)
 
StartTime: Mon Nov 14 12:07:52 
Total Requested Tasks: 64
 
Req[0] TaskCount: 64 Partition: FLEXlm 
NodeCount: 1
 
Allocated Nodes: 
[node01:64]
 
 
IWD: /opt/native
SubmitDir: /opt/native
Executable: /opt/native/spool/moab.job.FoZfIU
 
StartCount: 1 
Flags: GLOBALQUEUE,PROCSPECIFIED 
StartPriority: 1 
Reservation 'Moab.1' (-00:01:24 -> 00:08:36 Duration: 00:10:00)

9. Now submit a job for the owner (in this example, john).

[john@g06]$ echo sleep 600 | msub -l walltime=600 -l procs=50

10. Examine the following output for showq and checkjob:

showq for john's job

Moab.2
[john@g06]$ showq
 
active jobs------------------------ 
JOBID     USERNAME    STATE      PROCS    REMAINING    STARTTIME 
Moab.1    jane        Canceling  64       00:07:43     Mon Nov 14 12:07:52
Moab.2    john        Running    50       00:09:59     Mon Nov 14 12:10:08
 
2 active jobs    64 of 64 processors in use by local jobs (100.00%) 
1 of 1 nodes active (100.00%)
 
eligible jobs---------------------- 
JOBID     USERNAME    STATE      PROCS    WCLIMIT      QUEUETIME
 
0 eligible jobs
 
blocked jobs----------------------- 
JOBID     USERNAME    STATE      PROCS    WCLIMIT      QUEUETIME
 
0 blocked jobs
 
Total jobs: 2

Note that jane's job is canceled once john's job is submitted.

checkjob for john's job

[john@g06]$ checkjob Moab.2 
job Moab.2
 
State: Running 
Creds: user:john group:john 
WallTime: 00:00:31 of 00:10:00 
SubmitTime: Mon Nov 14 12:10:08 
(Time Queued Total: 00:00:00 Eligible: 00:00:00)
 
StartTime: Mon Nov 14 12:10:08 
Total Requested Tasks: 50
 
Req[0] TaskCount: 50 Partition: FLEXlm 
NodeCount: 1
 
Allocated Nodes: 
[node01:50]
 
 
IWD: /opt/native
SubmitDir: /opt/native
Executable: /opt/native/spool/moab.job.jf1N4a
 
StartCount: 1 
Flags: HASPREEMPTED,GLOBALQUEUE,PROCSPECIFIED 
StartPriority: 1 
Reservation 'Moab.2' (-00:00:48 -> 00:09:12 Duration: 00:10:00)

Note: Flags: HASPREEMPTED,GLOBALQUEUE,PROCSPECIFIED

showq for jane's job (after):

[root@g06]# checkjob Moab.1 
job Moab.1
 
State: Removed 
Completion Code: -1 Time: Mon Nov 14 12:10:08 
Creds: user:jane group:jane 
WallTime: 00:02:47 of 00:10:00 
SubmitTime: Mon Nov 14 12:07:52 
(Time Queued Total: 00:00:00 Eligible: 00:00:00)
 
Total Requested Tasks: 64
 
Req[0] TaskCount: 64 Partition: FLEXlm 
NodeCount: 1
 
Allocated Nodes: 
[node01:64]
 
 
IWD: /opt/native 
Executable: /opt/native/spool/moab.job.FoZfIU
 
Execution Partition: FLEXlm 
Flags: GLOBALQUEUE,PROCSPECIFIED 
StartPriority: 0

Note: State: Removed

See Also

• Managing preemption
• Using QoS preemption