Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
abstract:caviness:filesystems:filesystems [2021-03-10 10:57] – [Lustre storage] anita | abstract:caviness:filesystems:filesystems [2023-01-13 14:04] (current) – [Lustre] anita | ||
---|---|---|---|
Line 29: | Line 29: | ||
==== Lustre storage==== | ==== Lustre storage==== | ||
- | User storage is available on a [[abstract: | + | User storage is available on a [[abstract: |
- | space. This is used for temporary input files, supporting data files, work files, and output files associated with computational tasks run on the cluster. The filesystem is accessible to all of the processor cores via Omni-path Infiniband. | + | space. This is used for temporary input files, supporting data files, work files, and output files associated with computational tasks run on the cluster. The filesystem is accessible to all of the processor cores via Omni-path Infiniband. The default stripe count is set to 1 and the default striping is a single stripe distributed across all available OSTs on Lustre. See [[https:// |
- | <note warning> | + | <note warning> |
+ | |||
+ | However, | ||
+ | |||
+ | <code bash> | ||
+ | [traine@login00 traine]$ pwd | ||
+ | /lustre/scratch/traine | ||
+ | [traine@login00 traine]$ cat test.py | ||
+ | #!/usr/bin/env python | ||
+ | |||
+ | import sys | ||
+ | |||
+ | print 'This is running with arguments | ||
+ | |||
+ | [traine@login00 traine]$ | ||
+ | -bash: ./test.py: Permission denied | ||
+ | |||
+ | [traine@login00 traine]$ | ||
+ | This is running with arguments ['test.py', ' | ||
+ | </code> | ||
+ | |||
+ | When executing the Python script directly, it does not work. But when executed with '' | ||
+ | |||
+ | <code bash> | ||
+ | [traine@login00 traine]$ pwd | ||
+ | /lustre/scratch/traine | ||
+ | [traine@login00 traine]$ cat test.sh | ||
+ | # | ||
+ | |||
+ | echo "This is running with arguments $@" | ||
+ | |||
+ | [traine@login00 traine]$ ./test.sh arg1 arg2 | ||
+ | -bash: ./test.sh: Permission denied | ||
+ | [traine@login00 traine]$ bash test.sh arg1 arg2 | ||
+ | This is running with arguments arg1 arg2 | ||
+ | </code> | ||
The Lustre filesystem is not backed up nor are there snapshots to recover deleted files. However, it is a robust RAID-6 system. Thus, the filesystem | The Lustre filesystem is not backed up nor are there snapshots to recover deleted files. However, it is a robust RAID-6 system. Thus, the filesystem | ||
Line 54: | Line 89: | ||
==== Node scratch ==== | ==== Node scratch ==== | ||
- | Each compute node has its own 900GB local hard drive, which is needed for time-critical tasks such as managing virtual memory. | + | Each compute node has its own 900GB local hard drive (or for enhanced local scratch nodes 32TB), which is needed for time-critical tasks such as managing virtual memory. |
===== Quotas and usage ===== | ===== Quotas and usage ===== | ||
Line 66: | Line 101: | ||
Type Path | Type Path | ||
----- -------------------------- ------------ ------------ ---- | ----- -------------------------- ------------ ------------ ---- | ||
- | user /home/1006 | + | user /home/1201 |
group / | group / | ||
</ | </ | ||
+ | |||
+ | <note important> | ||
+ | </ | ||
+ | |||
+ | <note tip> | ||
+ | Please take the time to periodically cleanup your files in '' | ||
+ | |||
==== Home ==== | ==== Home ==== | ||
Each user's home directory has a hard quota limit of 20 GB. To check usage, use | Each user's home directory has a hard quota limit of 20 GB. To check usage, use | ||
Line 81: | Line 123: | ||
< | < | ||
Filesystem | Filesystem | ||
- | r01nfs0-10Gb:/ | + | r01nfs0-10Gb:/ |
Line 106: | Line 148: | ||
All of Lustre is considered scratch storage and subject to removal if necessary for Lustre-performance reasons. All users can create their own directories under the ''/ | All of Lustre is considered scratch storage and subject to removal if necessary for Lustre-performance reasons. All users can create their own directories under the ''/ | ||
- | The example below is based on user '' | + | The example below is based on user '' |
< | < | ||
- | [(it_css: | + | [(it_css: |
Filesystem | Filesystem | ||
- | 10.65.32.18@o2ib: | + | 10.65.32.18@o2ib: |
</ | </ |