| Both sides previous revision Previous revision Next revision | Previous revisionLast revisionBoth sides next revision |
| abstract:mills:filesystems:filesystems [2021-07-15 14:28] – [Archive] anita | abstract:mills:filesystems:filesystems [2021-07-15 14:28] – [Node scratch] anita |
|---|
| |
| |
| ===== Local filesystem ===== | |
| |
| ==== Node scratch ==== | |
| |
| Each compute node has its own 1-2 TB local hard drive, which is needed for time-critical tasks such as managing virtual memory. The system usage of the local disk is kept as small as possible to allow some local disk for your applications, running on the node. Thus, there is a ''/scratch'' filesystem mounted on each node. | |
| |
| ===== Quotas and usage ===== | ===== Quotas and usage ===== |
| <note warning>Please use the custom [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] to remove files on all Lustre filesytems ''/lustre/work'' or ''/lustre/scratch'', or to check disk usage on ''/lustre/scratch''.</note> | <note warning>Please use the custom [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] to remove files on all Lustre filesytems ''/lustre/work'' or ''/lustre/scratch'', or to check disk usage on ''/lustre/scratch''.</note> |
| |
| ==== Node scratch ==== | |
| The node scratch is mounted on ''/scratch'' for each of your nodes. There is no quota, and if you exceed the physical size of the disk you will get disk failure messages. To check the usage of your disk use the ''df -h'' command **on the compute node**. | |
| |
| For example, the command | |
| <code> | |
| ssh n017 df -h /scratch | |
| </code> | |
| shows 197 MB used from the total filesystem size of 793 GB. | |
| <code> | |
| Filesystem Size Used Avail Use% Mounted on | |
| /dev/sda2 793G 197M 753G 1% /scratch | |
| </code> | |
| This node ''n017'' has a 1 TB disk and 64 MB memory, which requires 126 GB of swap space on the disk. | |
| |
| <note warning>There is a physical disk installed on each node that is used for time critical tasks, such as swapping memory. The compute nodes are configured with either 1 TB disk or 2 TB disk, however, the ''/scratch'' filesystem will never have the total disk. Large memory nodes need more swap space. | |
| </note> | |
| |
| We strongly recommend that you refer to the node scratch by using the environment variable, ''$TMPDIR'', which is defined by Grid Engine when using ''qsub'' or ''qlogin''. | |
| ===== Recovering files ===== | ===== Recovering files ===== |
| ==== Home backups ==== | ==== Home backups ==== |