The TORQUE server (pbs_server) contains all the information about a cluster. It knows about all of the MOM nodes in the cluster based on the information in the $TORQUE_HOME/server_priv/nodes file (See Configuring TORQUE on compute nodes). It also maintains the status of each MOM node through updates from the MOMs in the cluster (see pbsnodes). All jobs are submitted via qsub to the server, which maintains a master database of all jobs and their states.
Schedulers such as Moab Workload Manager receive job, queue, and node information from pbs_server and submit all jobs to be run to pbs_server.
The server configuration is maintained in a file named serverdb, located in $TORQUE_HOME/server_priv. The serverdb file contains all parameters pertaining to the operation of TORQUE plus all of the queues which are in the configuration. For pbs_server to run, serverdb must be initialized.
You can initialize serverdb in two different ways, but the recommended way is to use the ./torque.setup script:
Restart pbs_server after initializing serverdb.
> qterm
> pbs_server
The torque.setup script uses pbs_server -t create to initialize serverdb and then adds a user as a manager and operator of TORQUE and other commonly used attributes. The syntax is as follows:
/torque.setup username
> ./torque.setup ken
> qmgr -c 'p s'
#
# Create queues and set their attributes.
#
#
# Create and define queue batch
#
create queue batch
set queue batch queue_type = Execution
set queue batch resources_default.nodes = 1
set queue batch resources_default.walltime = 01:00:00
set queue batch enabled = True
set queue batch started = True
#
# Set server attributes.
#
set server scheduling = True
set server acl_hosts = kmn
set server managers = ken@kmn
set server operators = ken@kmn
set server default_queue = batch
set server log_events = 511
set server mail_from = adm
set server scheduler_iteration = 600
set server node_check_rate = 150
set server tcp_timeout = 6
set server mom_job_sync = True
set server keep_completed = 300
The -t create option instructs pbs_server to create the serverdb file and initialize it with a minimum configuration to run pbs_server.
> pbs_server -t create
To see the configuration and verify that TORQUE is configured correctly, use qmgr:
> qmgr -c 'p s'
#
# Set server attributes.
#
set server acl_hosts = kmn
set server log_events = 511
set server mail_from = adm
set server scheduler_iteration = 600
set server node_check_rate = 150
set server tcp_timeout = 6
A single queue named batch and a few needed server attributes are created.
This section contains these topics:
Related topics