Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
abstract:caviness:runjobs:queues [2020-03-18 17:44] – [The devel partition] anita | abstract:caviness:runjobs:queues [2023-05-30 13:48] (current) – [The job queues (partitions) on Caviness] anita | ||
---|---|---|---|
Line 4: | Line 4: | ||
The Caviness cluster has several kinds of partition (queue) available in which to run jobs: | The Caviness cluster has several kinds of partition (queue) available in which to run jobs: | ||
- | ^Kind^Description^ | + | ^Kind^Description^Nodes^ |
- | |standard|The default partition if no '' | + | |standard|The default partition if no '' |
- | |devel|A partition with very short runtime limits and small resource limits; important to use for any development using compilers| | + | |devel|A partition with very short runtime limits and small resource limits; important to use for any development using compilers|'' |
- | |workgroup-specific|Partitions associated with specific kinds of compute equipment in the cluster purchased by a research group <<// | + | |workgroup-specific|Partitions associated with specific kinds of compute equipment in the cluster purchased by a research group <<// |
- | ==== The standard partition ==== | + | ===== The standard partition |
This partition is the default when no '' | This partition is the default when no '' | ||
Line 22: | Line 22: | ||
The standard partition is subject to job preemption (killed) because it allows a job submitted to a workgroup-specific partition to release resources tied-up by jobs in the standard partition. In summary, jobs in the standard partition will be preempted (killed with 5 minute grace period) to release resources for the workgroup-specific partition job. For more information on how to handle your job if it is preempted, please refer to [[abstract: | The standard partition is subject to job preemption (killed) because it allows a job submitted to a workgroup-specific partition to release resources tied-up by jobs in the standard partition. In summary, jobs in the standard partition will be preempted (killed with 5 minute grace period) to release resources for the workgroup-specific partition job. For more information on how to handle your job if it is preempted, please refer to [[abstract: | ||
- | ==== The devel partition ==== | + | ===== The devel partition |
This partition is used for short-lived jobs with minimal resource needs. | This partition is used for short-lived jobs with minimal resource needs. | ||
- | * Performing compiles of code for projects that otherwise can't be done on the login (head) node | + | * Performing compiles of code for projects that otherwise can't be done on the login (head) node and to make sure you are allocated a compute node with the development tools, libraries, etc. which are needed for compilers. |
* Running test jobs to vet programs or changes to programs | * Running test jobs to vet programs or changes to programs | ||
* Testing correctness of program parallelization | * Testing correctness of program parallelization | ||
* Interactive sessions | * Interactive sessions | ||
+ | * Removing files especially if cleaning up many files and directories in '' | ||
Because performance is not critical for these use cases, the nodes serviced by the '' | Because performance is not critical for these use cases, the nodes serviced by the '' | ||
Line 38: | Line 39: | ||
For example: | For example: | ||
<code bash> | <code bash> | ||
+ | [traine@login01 ~]$ workgroup -g it_css | ||
[(it_css: | [(it_css: | ||
Mon Jul 23 15:25:07 EDT 2018 | Mon Jul 23 15:25:07 EDT 2018 | ||
</ | </ | ||
- | One copy of the '' | + | One copy of the '' |
<code bash> | <code bash> | ||
[traine@login01 ~]$ workgroup -g it_css | [traine@login01 ~]$ workgroup -g it_css | ||
- | [(it_css: | + | [(it_css: |
salloc: Granted job allocation 940 | salloc: Granted job allocation 940 | ||
salloc: Waiting for resource configuration | salloc: Waiting for resource configuration | ||
Line 53: | Line 55: | ||
</ | </ | ||
- | ==== The workgroup-specific partitions ==== | + | ===== The workgroup-specific partitions |
The use of // | The use of // | ||
Line 68: | Line 70: | ||
<code bash> | <code bash> | ||
$ workgroup -g it_nss | $ workgroup -g it_nss | ||
- | $ sbatch --verbose | + | $ sbatch --verbose --partition=_workgroup_ … |
: | : | ||
sbatch: partition | sbatch: partition | ||
Line 74: | Line 76: | ||
Submitted batch job 1234 | Submitted batch job 1234 | ||
$ scontrol show job 1234 | egrep -i ' | $ scontrol show job 1234 | egrep -i ' | ||
- | | + | |
| | ||
</ | </ | ||
- | Job 1234 is billed against the it_css | + | Job 1234 is billed against the it_nss |
To check what your workgroup has access to and the guaranteed resources on the Caviness refer to [[abstract: | To check what your workgroup has access to and the guaranteed resources on the Caviness refer to [[abstract: | ||