Both sides previous revision Previous revision Next revision | Previous revision |
abstract:darwin:filesystems:filesystems [2021-07-18 11:36] – [Workgroup] anita | abstract:darwin:filesystems:filesystems [2021-10-14 11:19] (current) – [Workgroup storage] anita |
---|
==== Workgroup storage ==== | ==== Workgroup storage ==== |
| |
Allocation workgroup storage is available on a [[abstract:darwin:filesystems:lustre|high-performance Lustre-based filesystem]] having almost 1.1 PB of usable space. Users should have a basic understanding of the concepts of [[abstract:darwin:filesystems:lustre|Lustre]] to take full advantage of this filesystem. | Allocation workgroup storage is available on a [[abstract:darwin:filesystems:lustre|high-performance Lustre-based filesystem]] having almost 1.1 PB of usable space. Users should have a basic understanding of the concepts of [[abstract:darwin:filesystems:lustre|Lustre]] to take full advantage of this filesystem. The default stripe count is set to 1 and the default striping is a single stripe distributed across all available OSTs on Lustre. See [[https://www.nas.nasa.gov/hecc/support/kb/lustre-best-practices_226.html|Lustre Best Practices]] from Nasa. |
| |
Each allocation will have at least 1 TiB of shared ([[abstract:darwin:app_dev:compute_env#using-workgroup-and-directories|workgroup]]) storage in the ''/lustre/'' directory identified by the <<//allocation_workgroup//>> (e.g., ''/lustre/it_css'') accessbile by all users in the allocation workgroup, and is referred to as your workgroup directory (''$WORKDIR''), if the allocation workgroup has been set. | Each allocation will have at least 1 TiB of shared ([[abstract:darwin:app_dev:compute_env#using-workgroup-and-directories|workgroup]]) storage in the ''/lustre/'' directory identified by the <<//allocation_workgroup//>> (e.g., ''/lustre/it_css'') accessbile by all users in the allocation workgroup, and is referred to as your workgroup directory (''$WORKDIR''), if the allocation workgroup has been set. |
==== Workgroup ==== | ==== Workgroup ==== |
| |
All of Lustre is available to allocation workgroup storage. To check Lustre usage for all users, use ''df -h /lustre''. | All of Lustre is available for allocation workgroup storage. To check Lustre usage for all users, use ''df -h /lustre''. |
| |
The example below shows 25 TB is in use out of 954 TB of usable Lustre storage. | The example below shows 25 TB is in use out of 954 TB of usable Lustre storage. |
==== Home and Workgroup ==== | ==== Home and Workgroup ==== |
| |
<note important>While all filesystems on the DARWIN cluster utilize hardware redundancies to protect data, there is **no** backup or replication and **no** recovery available for the home or Lustre filesystems. | <note important>While all filesystems on the DARWIN cluster utilize hardware redundancies to protect data, there is **no** backup or replication and **no** recovery available for the home or Lustre filesystems. All backups are the responsibility of the user. DARWIN's systems administrators are not liable for any lost data. |
</note> | </note> |
| |