5.608 Specifying GPU Count for a Node

Administrators can manually set the number of GPUs on a node or if they are using NVIDIA GPUs and drivers, they can have them detected automatically. For more information about how to set up Torque with GPUS, see Accelerators in the Moab Workload Manager Administrator Guide.

To manually set the number of GPUs on a node, use the gpus attribute in the nodes file. The value of GPUs is determined by the administrator based on hardware, system, and site criteria.

The following example shows how to set the GPU value in the nodes file. In the example, we assume node01 and node002 each have two physical GPUs. The administrator wants the value of node001 to reflect the physical GPUs available on that system and adds gpus=2 to the nodes file entry for node001. However, node002 will be set up to handle multiple virtual GPUs without regard to the number of physical GPUs on the system.

server_priv/nodes:

node001 gpus=1

node002 gpus=4

...