software:openmpi:farber

Open MPI on Farber

IT provides templates for two job script variants for the mpi parallel environment on Farber located in /opt/shared/templates/gridengine/openmpi

OpenIB Verbs variant: openmpi-ib.qs
- Generally, you should get good performance from the default, verb-based openIB, approach, one that is not limited by the Grid Engine scheduler.

OpenIB Verbs hybrid variant with generic threads-per-worker: openmpi-ib-hybrid-generic.qs
- Same as OpenIB Verbs performance including OpenMP and MKL threading options for a hybrid variant.

Low-bandwidth Ethernet variant: openmpi-gige.qs
- If your openMPI program has been tuned for Ethernet rather than InfiniBand, this job script may be more suitable than the OpenIB Verbs script variant.

You may copy and customize these templates to provide the best performance when running your Open MPI applications. See Running Applications on Farber for details about resources.

It is a good idea to periodically check in /opt/shared/templates/gridengine/openmpi for changes in existing templates, or the addition of new templates, designed to provide the best performance on Farber.