Moab-LSF Integration Guide
Moab can be used as an external scheduler for LSF and significantly increase the cluster's capabilities in terms of cluster management, grid integration, accounting, and optimization services. In this configuration, LSF manages the job queue and the compute resources while Moab queries the LSF daemons via the LSF scheduling API (only available in LSF 5.1 and higher) to obtain up-to-date job and node information. Using this information, Moab directs LSF to manage jobs in accordance with specified Moab policies, priorities, and reservations.
To install Moab for LSF, from the Moab source code root directory, source the LSF environment file '$LSF_ENVDIR/lsf.conf
', run 'configure
', and then execute 'make install
Note: With LSF 5.x and earlier, use $LSF_CONFDIR in place of $LSF_ENVDIR.
' command should have already properly configured Moab
to use LSF
. However, to verify this, edit the moab.cfg
confirm that the following line is specified:
RMCFG[base] TYPE=LSF FLAGS=ignqueuestate
The resource manager flag ignqueuestate informs Moab to utilize queues which are disabled for usage by the LSF scheduler.
Note: Moab can pull information directly from the LSF API or can obtain it
indirectly by parsing the output of LSF commands. See LSF Integration via the Native Interface for more
Moab must be run as an LSF admin user. To enable a user as an LSF admin, edit the ClusterAdmins stanza in the '$LSF_CONFDIR/lsf.cluster.<CLUSTER>' file as in the example below:
Administrators = lsfadmin john steve
Additionally, LSF must be configured to use Moab as its external scheduler. This can be done by adding the following line to the lsf.conf file and restarting the LSF head-node daemons:
Disabling LSF Scheduler
To disable LSF scheduling for all queues, issue the following command:
disable LSF queues
To start Moab, source the LSF environment file, 'lsf.conf
the current environment and then start the Moab daemon:
> source /usr/lsf/conf/lsf.conf
||> moabd is a safe and recommended method of starting Moab if things are not installed in their default locations.
||It may also be necessary to add the path to your LSF libraries to the LD_LIBRARY_PATH variable as in 'export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lsf/6.0/linux2.4-glibc2.3-x86/lib'.
- For LSF to function correctly, the mbatchd daemon must be running. If Moab reports 'batch system daemon not responding ... still trying', check this process.