software:mpi4py:farber

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
software:mpi4py:farber [2020-04-23 12:01] – [Output] anitasoftware:mpi4py:farber [2021-04-27 16:21] (current) – external edit 127.0.0.1
Line 81: Line 81:
  
 <code bash> <code bash>
-cp /opt/templates/gridengine/openmpi/openmpi-ib.qs mympi4py.qs+cp /opt/shared/templates/gridengine/openmpi/openmpi-ib.qs mympi4py.qs
 </code> </code>
  
-and modify it for your application. Make sure you read the comments in the job script to select the appropriate option specifically modify the ''NPROC'' to specify the number of cores for ''#$ -pe mpi NPROC'' and understand you get 1GB of memory per ''NPROC'' (cores). Also if you specify [[abstract:farber:runjobs:queues#farber-exclusive-access|exclusive access]] by using ''-l exclusive=1'', then no other jobs can be running on the nodes, giving exclusive access to your job. Make sure you specify the correct VALET environment for your job selecting the correct version for Python 2 or 3 for mpi4py. Since the above example is based on Python 2 and needs mpi4py and numpy, we will specify the correct Python versions as follows:+and modify it for your application. Make sure you read the comments in the job script to select the appropriate option specifically modify the ''NPROC'' to specify the number of cores for ''#$ -pe mpi NPROC'' and understand you get 1GB of memory per ''NPROC'' (cores). Also if you specify [[abstract:farber:runjobs:queues#farber-exclusive-access|exclusive access]] by using ''-l exclusive=1'', then no other jobs can be running on the nodes, giving exclusive access to your job. Make sure you specify the correct VALET environment for your job selecting the correct version for Python 2 or 3 for mpi4py. Since the above example is based on Python 2 and needs mpi4py, we will specify the VALET package as follows:
  
 <code bash>  <code bash> 
 vpkg_require python-mpi4py/python2.7.8 vpkg_require python-mpi4py/python2.7.8
-vpkg_require python-numpy/python2.7.8 
 </code> </code>
  
Line 175: Line 174:
 -- end OPENMPI run -- -- end OPENMPI run --
 </code> </code>
 +
 +===== Recipes =====
 +If you need to build a Python virtualenv based on a collection of Python modules including mpi4py, then you will need to follow this recipe to get a properly-integrated mpi4py module.
 +
 +  * [[technical:recipes:mpi4py-in-virtualenv|Building a Python virtualenv with a properly-integrated mpi4py module]]
  • software/mpi4py/farber.1587657695.txt.gz
  • Last modified: 2020-04-23 12:01
  • by anita