You are here: 8 MPI (Message Passing Interface) Support > Open MPI

8.2 Open MPI

Open MPI is a new MPI implementation that combines technologies from multiple projects to create the best possible library. It supports the TM interface for integration with TORQUE. More information is available in the FAQ.

8.2.1 TM Aware

To make use of Moab HPC Suite's TM interface, MPI must be configured to be TM aware.

Use these guidelines:

If you have installed from source, you need to use "./configure --with-tm" when you configure and make openmpi.
Run mpirun without the -machinefile. Moab HPC Suite will copy down the environment PATH and Library path down to each sister MOM. If -machinefile is used, mpirun will bypass the TM interface.

Example 8-1: Without TM aware

[jbooth@support-mpi1 ~]$ /usr/lib64/openmpi/bin/mpirun -np 4 -machinefile $PBS_NODEFILE echo.sh 
============= 
support-mpi1 
============= 
/usr/lib64/openmpi/bin:/usr/lib64/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/lib64/openmpi/lib:/usr/lib64/openmpi/lib 

============= 
support-mpi1 
============= 
/usr/lib64/openmpi/bin:/usr/lib64/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/lib64/openmpi/lib:/usr/lib64/openmpi/lib 

============= 
support-mpi2 
============= 
/usr/lib64/openmpi/bin:/usr/lib64/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin 

/usr/lib64/openmpi/lib:/usr/lib64/openmpi/lib: 

============= 
support-mpi2 
============= 
/usr/lib64/openmpi/bin:/usr/lib64/openmpi/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/bin:/usr/bin 

/usr/lib64/openmpi/lib:/usr/lib64/openmpi/lib:

The paths, /opt/moab/bin and /opt/moab/sbin, were not passed down to the sister MOMs.

Example 8-2: With TM aware

[jbooth@support-mpi1 ~]$ /usr/local/bin/mpirun -np 4 echo.sh 
============= 
support-mpi1 
============= 
/usr/local/bin:/usr/local/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/local/lib:/usr/local/lib 

============= 
support-mpi1 
============= 
/usr/local/bin:/usr/local/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/local/lib:/usr/local/lib 

============= 
support-mpi2 
============= 
/usr/local/bin:/usr/local/bin:/usr/local/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/local/lib:/usr/local/lib:/usr/local/lib 

============= 
support-mpi2 
============= 
/usr/local/bin:/usr/local/bin:/usr/local/bin:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/opt/moab/bin:/opt/moab/sbin:/home/jbooth/bin 

/usr/local/lib:/usr/local/lib:/usr/local/lib

The paths, /opt/moab/bin and /opt/moab/sbin, were passed down to the sister MOMs.