Both sides previous revision Previous revision Next revision | Previous revisionLast revisionBoth sides next revision |
abstract:darwin:filesystems:filesystems [2021-04-28 12:40] – [Home filesystem] pdw | abstract:darwin:filesystems:filesystems [2021-08-04 12:36] – [Home and Workgroup] mkyle |
---|
==== Home storage ==== | ==== Home storage ==== |
| |
Each user has 20 GB of disk storage reserved for personal use on the home file system. Users' home directories are in /home (e.g., ''/home/1005''), and the directory name is put in the environment variable ''$HOME'' at login. | Each user has 20 GB of disk storage reserved for personal use on the home filesystem. Users' home directories are in /home (e.g., ''/home/1005''), and the directory name is put in the environment variable ''$HOME'' at login. |
===== High-performance Lustre filesystem ===== | ===== High-performance Lustre filesystem ===== |
| |
Each allocation will also have a ''/lustre/<<//workgroup//>>/sw'' directory to allow users to install software to be shared for the allocation workgroup. It can be referred to as ''$WORKDIR_SW'', if the allocation workgroup has been set. In addition a ''/lustre/<<//workgroup//>>/sw/valet'') directory is also provided to store VALET package files to shared for the allocation workgroup. | Each allocation will also have a ''/lustre/<<//workgroup//>>/sw'' directory to allow users to install software to be shared for the allocation workgroup. It can be referred to as ''$WORKDIR_SW'', if the allocation workgroup has been set. In addition a ''/lustre/<<//workgroup//>>/sw/valet'') directory is also provided to store VALET package files to shared for the allocation workgroup. |
| |
Please see [[abstract:darwin:app_dev:compute_env#using-workgroup-and-directories|allocation workgroup]] for complete details on environment variables. | Please see [[abstract:darwin:app_dev:compute_env#using-workgroup-and-directories|workgroup]] for complete details on environment variables. |
| |
**Note**: A full filesystem inhibits use for everyone preventing jobs from running. | **Note**: A full filesystem inhibits use for everyone preventing jobs from running. |
==== Workgroup ==== | ==== Workgroup ==== |
| |
All of Lustre is available as allocation workgroup storage. To check Lustre usage for all users, use ''df -h /lustre''. | All of Lustre is available for allocation workgroup storage. To check Lustre usage for all users, use ''df -h /lustre''. |
| |
The example below shows 25 TB is in use out of 954 TB of usable Lustre storage. | The example below shows 25 TB is in use out of 954 TB of usable Lustre storage. |
==== Home and Workgroup ==== | ==== Home and Workgroup ==== |
| |
<note important>While all filesystems on the DARWIN cluster utilize hardware redundancies to protect data, there is **no** backup or replication and **no** recovery available for the home or Lustre filesystems. | <note important>While all filesystems on the DARWIN cluster utilize hardware redundancies to protect data, there is **no** backup or replication and **no** recovery available for the home or Lustre filesystems. All backups are the responsibility of the user. DARWIN's systems administrators are not liable for any lost data. |
</note> | </note> |
| |