| Both sides previous revision Previous revision Next revision | Previous revision |
| software:openmpi:caviness [2018-10-15 09:43] – anita | software:openmpi:caviness [2021-04-27 16:21] (current) – external edit 127.0.0.1 |
|---|
| ===== Open MPI on Caviness ===== | ===== MPI on Caviness ===== |
| |
| |
| IT provides templates for two job script variants for the **mpi** parallel environment on Farber located in ''/opt/templates/slurm/generic/mpi/openmpi'' | IT provides three job script (batch) template variants for **mpi** parallel environments located in ''/opt/shared/templates/slurm/generic/mpi'' on Caviness: |
| |
| * OpenIB Verbs variant: **//openmpi.qs//** | - Open MPI: **//openmpi.qs//** |
| * This is a batch job template for a program using multiple processor cores/threads on one or more nodes. This particular variant should be used with Open MPI or another MPI library that is tightly-integrated with Slurm. | * Found in ''/opt/shared/templates/slurm/generic/mpi/openmpi''. |
| * Sections of this script that can/should be edited are delimited by a ''[EDIT]'' tag. All Slurm job options are denoted by a line that starts with ''#SBATCH'' followed by flags that would otherwise be passed on the command line. Slurm job options can easily be disabled in a script by inserting a space in the prefix, e.g. ''# SLURM'' and reenabled by deleting that space. | - Mpich: **//mpich.qs//** |
| | * Found in ''/opt/shared/templates/slurm/generic/mpi/mpich''. |
| | - Generic: **//mpi.qs//** |
| | * Found in ''/opt/shared/templates/slurm/generic/mpi/generic''. |
| |
| | In general, we suggest using the Open MPI job script template, however |
| | * Each job script template is intended for a program using multiple processor cores/threads on one or more nodes. Each variant should be used with Open MPI or another MPI library that is tightly-integrated with Slurm. |
| | * Sections of each script that can/should be edited are delimited by a ''[EDIT]'' tag. All Slurm job options are denoted by a line that starts with ''#SBATCH'' followed by flags that would otherwise be passed on the command line. Slurm job options can easily be disabled in a script by inserting a space in the prefix, e.g. ''# SLURM'' and reenabled by deleting that space. |
| |
| You may copy and customize these templates to provide the best performance when running your Open MPI applications. See [[:abstract:caviness:runjobs:runjobs|Running Applications]] on Caviness for details about resources. | You may copy and customize these templates to provide the best performance when running your MPI applications, however you should keep the job script complete (i.e. do not delete lines or sections in the job script template). See [[:abstract:caviness:runjobs:runjobs|Running Applications]] on Caviness for details about resources. |
| |
| <note tip>It is a good idea to periodically check in ''/opt/templates/slurm/generic/mpi'' for changes in existing templates, or the addition of new templates, designed to provide the best performance on Caviness.</note> | <note tip>It is a good idea to periodically check in ''/opt/shared/templates/slurm/generic/mpi'' for changes in existing templates, or the addition of new templates, designed to provide the best performance on Caviness.</note> |
| |