Differences

This shows you the differences between two versions of the page.

--- abstract:farber:filesystems:filesystems [2018-05-24 09:14] – [Usage Recommendations] sraskar
+++ abstract:farber:filesystems:filesystems [2021-10-14 11:20] (current) – [Lustre storage] anita
@@ Line 30: / Line 30: @@
 User storage is available on a high-performance Lustre-based filesystem having 257 TB of usable
-space. This is used for temporary input files, supporting data files, work files, and output files associated with computational tasks run on the cluster. The filesystem is accessible to all of the processor cores via 56 Gbps (FDR) Infiniband.
+space. This is used for temporary input files, supporting data files, work files, and output files associated with computational tasks run on the cluster. The filesystem is accessible to all of the processor cores via 56 Gbps (FDR) Infiniband. The default stripe count is set to 1 and the default striping is a single stripe distributed across all available OSTs on Lustre. See [[https://www.nas.nasa.gov/hecc/support/kb/lustre-best-practices_226.html|Lustre Best Practices]] from Nasa.
-<note warning>Source code and executables must be stored in and executed from Home (''$HOME'') or Workgroup (''$WORKDIR'') storage.  No executables are not permitted to run from the Lustre filesystem.</note>
+<note warning>Source code and executables must be stored in and executed from Home (''$HOME'') or Workgroup (''$WORKDIR'') storage.  No executables are permitted to run from the Lustre filesystem.</note>
 The Lustre filesystem is not backed up. However, it is a robust RAID-6 system. Thus, the filesystem
@@ Line 56: / Line 56: @@
 remaining files in ''/lustre/scratch'' no longer needed by using the custom [[abstract:farber:filesystems:lustre#lustre-utilities|Lustre utilities]].  If you do not clean up properly, then files will be purged from ''/lustre/scratch'' by the regular cleanup procedures.</note>
+**Note**: A full filesystem inhibits use for everyone.
 ===== Local filesystem =====
@@ Line 80: / Line 81: @@
 Type  Path                       In-use / kiB Available / kiB  Pct
 ----- -------------------------- ------------ ------------ ----
-user  /home/1006                      1691648     20971520   8%
+user  /home/1201                      1691648     20971520   8%
 group /home/work/it_css              39649280   1048576000   4%
@@ Line 109: / Line 110: @@
 <code>
 [traine@farber ~]$ workgroup -g it_css
-[(it_css:dnairn)@farber ~]$ df -h $WORKDIR
+[(it_css:traine)@farber ~]$ df -h $WORKDIR
 Filesystem            Size  Used Avail Use% Mounted on
 storage-nfs1:/export/work/it_css
@@ Line 211: / Line 212: @@
 **Public scratch directory**: Use the public [[#lustre|Lustre]] scratch directory (/lustre/scratch) for files where high performance is required. Store files produced as intermediate work files, and remove them when your current project is done. That will free up the public scratch workspace others also need. This is also a good place for sharing files and
-and data with all users.  Files in this directory are not backed up, and subject to removal. Use [[#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed.
+and data with all users.  Files in this directory are not backed up, and subject to removal. Use [[abstract:farber:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed.
 **Node scratch directory**: Use the [[#node-scratch|node scratch]] directory (/scratch) for temporary files. The job scheduler software (Grid Engine) creates a subdirectory in /scratch specifically for each job's temporary files. This is done on each node assigned to the job. When the job is complete, the subdirectory and its contents are deleted. This process automatically frees up the local scratch storage that others may need. Files in node scratch directories are not available to the head node, or other compute nodes.
@@ Line 217: / Line 218: @@
 **Lustre workgroup directory**: Use the [[#lustre|Lustre]] work directory (/lustre/work/<<//investing_entity//>>) if purchased by your research group for files where high performance is required. Keep just the files needed for
 your job such as scripts and large data sets used for input or created for output. Remember the disk is not backed up and subject to removal only if needed, so be prepared to rebuild the files if necessary.  With batch jobs, the queue script is a
-record of what you did, but for interactive work, you need to take notes as a record of your work. Use [[#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed.
+record of what you did, but for interactive work, you need to take notes as a record of your work. Use [[abstract:farber:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed.