TORQUE maintains accounting records for batch jobs in the following directory:
$TORQUEROOT/server_priv/accounting/<TIMESTAMP>
$TORQUEROOT defaults to /usr/spool/PBS and <TIMESTAMP> is in the format: YYYYMMDD.
These records include events, time stamps, and information on resources requested and used.
Records for four different event types are produced and are described in the following table:
Record marker | Record type | Description |
---|---|---|
A | abort | Job has been aborted by the server |
C | checkpoint | Job has been checkpointed and held |
D | delete | Job has been deleted |
E | exit | Job has exited (either successfully or unsuccessfully) |
Q | queue | Job has been submitted/queued |
R | rerun | Attempt to rerun the job has been made |
S | start | Attempt to start the job has been made (if the job fails to properly start, it may have multiple job start records) |
T | restart | Attempt to restart the job (from checkpoint) has been made (if the job fails to properly start, it may have multiple job start records) |
Accounting Variables
The following table offers accounting variable descriptions. Descriptions for accounting variables not indicated in the table, particularly those prefixed with Resources_List, are available at Job submission.
Variable | Description |
---|---|
ctime | Time job was created |
etime | Time job became eligible to run |
qtime | Time job was queued |
start | Time job started to run |
A sample record in this file can look like the following:
06/06/2005 14:04:25;D;408.ign1.zeta2.org;[email protected]
06/06/2005 14:04:35;Q;409.ign1.zeta2.org;queue=batch
06/06/2005 14:04:44;Q;410.ign1.zeta2.org;queue=batch
06/06/2005 14:06:06;S;407.ign1.zeta2.org;user=guest group=guest jobname=STDIN queue=batch ctime=1118087915 qtime=1118087915 etime=1118087915 start=1118088366 exec_host=ign1.zeta2.org/0 Resource_List.neednodes=ign1.zeta2.org Resource_List.nodect=1 Resource_List.nodes=1 Resource_List.walltime=00:16:40
06/06/2005 14:07:17;D;407.ign1.zeta2.org;[email protected]
06/06/2005 14:07:17;E;407.ign1.zeta2.org;user=guest group=guest jobname=STDIN queue=batch ctime=1118087915 qtime=1118087915 etime=1118087915 start=1118088366 exec_host=ign1.zeta2.org/0 Resource_List.nodect=1 Resource_List.nodes=1 Resource_List.walltime=00:16:40 session=6365 end=1118088437 Exit_status=271 resources_used.cput=00:00:00 resources_used.mem=3068kb resources_used.vmem=16080kb resources_used.walltime=00:01:11