| Both sides previous revision Previous revision Next revision | Previous revision |
| software:gurobi:caviness [2021-03-18 13:14] – [Gurobi on Caviness] anita | software:gurobi:caviness [2022-07-01 13:04] (current) – frey |
|---|
| ====== Gurobi on Caviness ====== | ====== Gurobi on Caviness ====== |
| |
| Check to see what versions of Gurobi<sup>TM</sup> Optimizer is installed. | To determine the available versions of Gurobi<sup>TM</sup> Optimizer installed use |
| |
| <code bash> | <code bash> |
| The below steps are based on copying a template job script and modifying ''serial.qs'' or ''threads.qs'' script to load run your Gurobi Anaconda environment. | The below steps are based on copying a template job script and modifying ''serial.qs'' or ''threads.qs'' script to load run your Gurobi Anaconda environment. |
| |
| <note tip>It is a good idea to periodically check in ''/opt/templates/slurm/'' for updated or new [[technical:slurm:caviness:templates:start|templates]] to use as job scripts to run generic or specific applications, designed to provide the best performance on Caviness.</note> | <note tip>It is a good idea to periodically check in ''/opt/shared/templates/slurm/'' for updated or new [[technical:slurm:caviness:templates:start|templates]] to use as job scripts to run generic or specific applications designed to provide the best performance on Caviness.</note> |
| |
| To start, use VALET to load Gurobi and Anaconda. Once those two packages are loaded, the Gurobi Anaconda environment will need to be activated. After the Gurobi Anaconda environment is activated, then the python script that uses Gurobi can be called and ran. After the python script has completed, then the Gurobi Anaconda environment will be need to be deactivated. | To start, use VALET to load Gurobi and Anaconda. Once those two packages are loaded, the Gurobi Anaconda environment will need to be activated. After the Gurobi Anaconda environment is activated, then the python script that uses Gurobi can be called and ran. After the python script has completed, then the Gurobi Anaconda environment will be need to be deactivated. |
| Adding package `intel-python/2019u5:python3` to your environment | Adding package `intel-python/2019u5:python3` to your environment |
| |
| (root) [(it_css:anita)@login01 gurobi-mpi]$ conda create --prefix=$(pwd)/envs/20200415 --channel http://conda.anaconda.org/gurobi gurobi=9 scipy pandas joblib python=3 | (root) [(it_css:anita)@login01 gurobi-mpi]$ conda create --prefix=$(pwd)/envs/20200415 --channel http://conda.anaconda.org/gurobi --channel=intel gurobi=9 scipy pandas joblib python=3 |
| Fetching package metadata ............... | Fetching package metadata ............... |
| Solving package specifications: . | Solving package specifications: . |
| |
| <code bash> | <code bash> |
| (/home/1201/gurobi-mpi/envs/20200415) [(it_css:traine)@login01 gurobi-mpi]$ vpkg_require binutils/2.25.1 openmpi/3.1.3 | (/home/1201/gurobi-mpi/envs/20200415) [(it_css:traine)@login01 gurobi-mpi]$ vpkg_require binutils/2.38 openmpi/4.1.2 |
| Adding package `binutils/2.25.1` to your environment | Adding package `binutils/2.38` to your environment |
| Adding dependency `libfabric/1.9.0` to your environment | Adding dependency `libfabric/1.13.2` to your environment |
| Adding package `openmpi/3.1.3` to your environment | Adding package `openmpi/4.1.2` to your environment |
| |
| (/home/1201/gurobi-mpi/envs/20200415) [(it_css:traine)@login01 gurobi-mpi]$ pip install --no-binary :all: --compile mpi4py | (/home/1201/gurobi-mpi/envs/20200415) [(it_css:traine)@login01 gurobi-mpi]$ pip install --no-binary :all: --compile mpi4py |
| Collecting mpi4py | Collecting mpi4py |
| Using cached https://files.pythonhosted.org/packages/ec/8f/bbd8de5ba566dd77e408d8136e2bab7fdf2b97ce06cab830ba8b50a2f588/mpi4py-3.0.3.tar.gz | Using cached https://files.pythonhosted.org/packages/ec/8f/bbd8de5ba566dd77e408d8136e2bab7fdf2b97ce06cab830ba8b50a2f588/mpi4py-3.1.3.tar.gz |
| Skipping wheel build for mpi4py, due to binaries being disabled for it. | Skipping wheel build for mpi4py, due to binaries being disabled for it. |
| Installing collected packages: mpi4py | Installing collected packages: mpi4py |
| Running setup.py install for mpi4py ... done | Running setup.py install for mpi4py ... done |
| Successfully installed mpi4py-3.0.3 | Successfully installed mpi4py-3.1.3 |
| </code> | </code> |
| |
| First copy the template job script ''openmpi.qs'' and modify it to setup the number of cores, memory and time, and use VALET to load your Gurobi and mpi4py environment that you will need to run your job. | First copy the template job script ''openmpi.qs'' and modify it to setup the number of cores, memory and time, and use VALET to load your Gurobi and mpi4py environment that you will need to run your job. |
| |
| <note tip>It is a good idea to periodically check in ''/opt/templates/slurm/'' for updated or new [[technical:slurm:templates:start|templates]] to use as job scripts to run generic or specific applications, designed to provide the best performance on Caviness.</note> | <note tip>It is a good idea to periodically check in ''/opt/shared/templates/slurm/'' for updated or new [[technical:slurm:templates:start|templates]] to use as job scripts to run generic or specific applications, designed to provide the best performance on Caviness.</note> |
| |
| The ''openmpi.qs'' file can be found in ''opt/templates/slurm/generic/mpi'' directory. | The ''openmpi.qs'' file can be found in ''opt/templates/slurm/generic/mpi'' directory. |
| |