L.4 Cray RUR Configuration

To enable the recording of RUR file entries for jobs, the system administrator must configure the Cray XC system so it will generate RUR file entries in the system RUR file for each job step. In addition, the system administrator must enable RUR in the Cray system's compute nodes.

The following information identifies items the administrator must configure.

Configuration instructions may change over time without Adaptive Computing's knowledge. The administrator should consult Cray documentation for authoritative information and work with Cray Technical Support to ensure a correct configuration.

L.4.1 RUR Prologue and Epilogue Path Configuration

Verify the alps.conf file contains valid RUR prologue and epilogue path names, similar to the blue lines in the example below. If their paths are not specified, ALPS will not execute the RUR prologue and/or epilogue scripts. Both scripts are needed for ALPS to compute energy consumption by a job step.

boot-p1:~ # xtopview
default/:/ # vi /etc/opt/cray/alps/alps.conf
..
       prologPath      /opt/cray/rur/default/bin/rur_prologue.py  
        epilogPath      /opt/cray/rur/default/bin/rur_epilogue.py
        prologTimeout   30  
        epilogTimeout   30
...

The RUR prologue script "reads" the "power meter" of each compute nodes allocated to a job. The RUR epilogue script again reads the power meters and then computes the difference between each node’s power meter readings. The sum of the differences computes the energy consumption of a job step, which "energy_used" value ALPS records in the RUR entry for the job step.

L.4.2 RUR File Generation and Path Configuration

The RUR system can record RUR information in different ways. One recording method is a text file. For Moab job energy accounting, the Cray XC system must record the RUR information in a system RUR text file, which recording method requires configuration.

Verify the rur.conf file has the "file plug-in" enabled, similar to the blue line in the example below, or ALPS will not record RUR job-step entries in a text file.

boot-p1:~ # xtopview
default/:/ # vi /etc/opt/cray/rur/rur.conf
...
# Output Plugins section Configuration
# Define which output plugins are supported, and enable/
# disable them. Plugins defined as "Plugin: False" will
# not run, but will be parsed for correct config file
# syntax.
[outputplugins]
llm: true
file: true
user: false
...

In addition, verify the "file output argument" contains the valid path name of the system RUR file.

...
# The File output plugin.
# Write RUR output to a single plain text file
# Arg - The destination text file
[file]
output: /opt/cray/rur/default/bin/file_output.py
#arg: path-to-flat-textfile
arg: /lus/scratch/RUR/output/rur.output
...

These two configuration items direct ALPS to record RUR information in a text file (also referred to as the system RUR file mentioned in this document).

Related Topics 

© 2016 Adaptive Computing