This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision |
| abstract:mills:filesystems:filesystems [2018-06-08 00:41] – [Summary of usage recommendations] anita | abstract:mills:filesystems:filesystems [2021-07-15 14:31] (current) – old revision restored (2018-06-08 00:43) anita |
|---|
| |
| **Private archive directory**: Use the [[#archive|archive]] directory (/archive/<<//investing_entity//>>) to build applications for you or your group to use as well as important data, source or any other files you want backed-up. This directory and all the make tools are available from the head node. The head node has faster access to /archive than the compute nodes. See | **Private archive directory**: Use the [[#archive|archive]] directory (/archive/<<//investing_entity//>>) to build applications for you or your group to use as well as important data, source or any other files you want backed-up. This directory and all the make tools are available from the head node. The head node has faster access to /archive than the compute nodes. See |
| the [[:general/userguide/05_development|Application development]] section for information on building applications. You should make a "setup" script that your fellow researchers can use to access applications you want to share. A typical workflow is to copy the files needed from /archive to /lustre for the actual run. The /archive system is backed-up with [[#archive-snapshots|snapshots]]. | the [[abstract:mills:app_dev:app_dev|Application development]] section for information on building applications. You should make a "setup" script that your fellow researchers can use to access applications you want to share. A typical workflow is to copy the files needed from /archive to /lustre for the actual run. The /archive system is backed-up with [[#archive-snapshots|snapshots]]. |
| |
| **Public scratch directory**: Use the public [[#lustre|Lustre]] scratch directory (/lustre/scratch or /lustre-scratch) for files where high performance is required. Store files produced as intermediate work files, and remove them when your current project is done. That will free up the public scratch workspace others also need. This is also a good place for sharing files with all users on Mills. Files in this directory are not backed up, and the first subject to removal if the filesystem gets full. Use [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. | **Public scratch directory**: Use the public [[#lustre|Lustre]] scratch directory (/lustre/scratch or /lustre-scratch) for files where high performance is required. Store files produced as intermediate work files, and remove them when your current project is done. That will free up the public scratch workspace others also need. This is also a good place for sharing files with all users on Mills. Files in this directory are not backed up, and the first subject to removal if the filesystem gets full. Use [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. |