Python

Python is an interpreted, object-oriented, high-level programming language with dynamic semantics. Its high-level built in data structures, combined with dynamic typing and dynamic binding, make it very attractive for Rapid Application Development, as well as for use as a scripting or glue language to connect existing components together.

There are various Python versions (platforms) and packages installed on each cluster. Please use the VALET command vpkg_list | grep python the cluster you are using to see all related Python software installation. Anaconda is a popular Python platform that may be more suitable based on the documentation provided for your software installation requirements. Mpi4py is also another Python platform that allowing any Python program to exploit multiple processors.

Running Python jobs on our clusters, in particularly, machine learning and/or multiprocessing (parallel) will likely use shared memory on each node assigned to the job. Unfortunately shared memory (/dev/shm) cannot be easily reserved or cleared as part of your job submission, as a result, you may receive the following error

It has been suggested setting the environment variable JOBLIB_TEMP_DIR=${TMPDIR} will use the local scratch storage on the node versus shared memory and avoid the above error.