| Next revision | Previous revision |
| abstract:mills:filesystems:filesystems [2017-12-08 14:07] – created anita | abstract:mills:filesystems:filesystems [2021-07-15 14:31] (current) – old revision restored (2018-06-08 00:43) anita |
|---|
| ====== Using Mills' filesystems ====== | ====== Mills Storage ====== |
| |
| ===== Permanent filesystems ===== | ===== Permanent filesystems ===== |
| |
| Each user has 2 GB of disk space reserved for personal use on the home file system. Users' home directories are in /home (e.g., ''/home/1005''). These are regularly archived at UD's off-campus disaster recovery site. | Each user has 2 GB of disk space reserved for personal use on the home file system. Users' home directories are in /home (e.g., ''/home/1005''). These are regularly archived at UD's off-campus disaster recovery site. |
| Use the [[/clusters/mills/filesystems#home-backups|recover]] command to restore older versions or deleted files in your home directory. | Use the [[/abstract/mills/filesystems/filesystems#home-backups|recover]] command to restore older versions or deleted files in your home directory. |
| | |
| An 8 TB permanent filesystem is provided on the login node (head node), mills.hpc.udel.edu. The filesystem's RAID-6 (double parity) configuration is accessible to the compute nodes via 1 Gb/s Ethernet and to the campus network via 10 Gb/s Ethernet. Two terabytes are allocated for users' home directories in /home. The remaining 6 TB are reserved for the system software, libraries and applications in /opt. | An 8 TB permanent filesystem is provided on the login node (head node), mills.hpc.udel.edu. The filesystem's RAID-6 (double parity) configuration is accessible to the compute nodes via 1 Gb/s Ethernet and to the campus network via 10 Gb/s Ethernet. Two terabytes are allocated for users' home directories in /home. The remaining 6 TB are reserved for the system software, libraries and applications in /opt. |
| ==== Archive ==== | ==== Archive ==== |
| |
| Each research group has 1 TB of shared group storage on the archive filesystem (/archive). The directory is identified by the research-group identifier <<//investing_entity//>> (e.g., ''/archive/it_css''). A read-only snapshot of users' files is made several times per day on the disk. In addition, the filesystem is replicated on UD's off-campus disaster recovery site. Daily [[/clusters/mills/filesystems?&#archive-snapshots|snapshots]] are user-accessible. Older files may be restored by special request. | Each research group has 1 TB of shared group storage on the archive filesystem (/archive). The directory is identified by the research-group identifier <<//investing_entity//>> (e.g., ''/archive/it_css''). A read-only snapshot of users' files is made several times per day on the disk. In addition, the filesystem is replicated on UD's off-campus disaster recovery site. Daily [[:abstract:mills:filesystems:filesystems#archive-snapshots|snapshots]] are user-accessible. Older files may be restored by special request. |
| | |
| The 60 TB permanent archive filesystem uses 3 TB enterprise class SATA drives in a triple-parity RAID configuration for high reliability and availability. The filesystem is accessible to the head node via 10 Gbit/s Ethernet and to the compute nodes via 1 Gbit/s Ethernet. ([[https://docs.nss.udel.edu/wiki/hpc/doku.php/clusters/mills/archive-filesystem |Details]]) | The 60 TB permanent archive filesystem uses 3 TB enterprise class SATA drives in a triple-parity RAID configuration for high reliability and availability. The filesystem is accessible to the head node via 10 Gbit/s Ethernet and to the compute nodes via 1 Gbit/s Ethernet. |
| |
| ===== High-performance filesystem ===== | ===== High-performance filesystem ===== |
| </note> | </note> |
| |
| <note warning>Please use the custom [[:general:filesystems:Lustre-utilities|Lustre utilities]] to remove files on all Lustre filesytems ''/lustre/work'' or ''/lustre/scratch'', or to check disk usage on ''/lustre/scratch''.</note> | <note warning>Please use the custom [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] to remove files on all Lustre filesytems ''/lustre/work'' or ''/lustre/scratch'', or to check disk usage on ''/lustre/scratch''.</note> |
| |
| ==== Node scratch ==== | ==== Node scratch ==== |
| **Private work directory**: Use the [[#lustre|Lustre]] work directory (/lustre/work/<<//investing_entity//>>) for files where high performance is required. Keep just the files needed for | **Private work directory**: Use the [[#lustre|Lustre]] work directory (/lustre/work/<<//investing_entity//>>) for files where high performance is required. Keep just the files needed for |
| your job such as your applications, scripts and large data sets used for input or created for output. Remember the disk is not backed up, so be prepared to rebuild the files if necessary. With batch jobs, the queue script is a | your job such as your applications, scripts and large data sets used for input or created for output. Remember the disk is not backed up, so be prepared to rebuild the files if necessary. With batch jobs, the queue script is a |
| record of what you did, but for interactive work, you need to take notes as a record of your work. Use [[#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. | record of what you did, but for interactive work, you need to take notes as a record of your work. Use [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. |
| |
| **Private archive directory**: Use the [[#archive|archive]] directory (/archive/<<//investing_entity//>>) to build applications for you or your group to use as well as important data, source or any other files you want backed-up. This directory and all the make tools are available from the head node. The head node has faster access to /archive than the compute nodes. See | **Private archive directory**: Use the [[#archive|archive]] directory (/archive/<<//investing_entity//>>) to build applications for you or your group to use as well as important data, source or any other files you want backed-up. This directory and all the make tools are available from the head node. The head node has faster access to /archive than the compute nodes. See |
| the [[:general/userguide/05_development|Application development]] section for information on building applications. You should make a "setup" script that your fellow researchers can use to access applications you want to share. A typical workflow is to copy the files needed from /archive to /lustre for the actual run. The /archive system is backed-up with [[#archive-snapshots|snapshots]]. | the [[abstract:mills:app_dev:app_dev|Application development]] section for information on building applications. You should make a "setup" script that your fellow researchers can use to access applications you want to share. A typical workflow is to copy the files needed from /archive to /lustre for the actual run. The /archive system is backed-up with [[#archive-snapshots|snapshots]]. |
| |
| **Public scratch directory**: Use the public [[#lustre|Lustre]] scratch directory (/lustre/scratch or /lustre-scratch) for files where high performance is required. Store files produced as intermediate work files, and remove them when your current project is done. That will free up the public scratch workspace others also need. This is also a good place for sharing files with all users on Mills. Files in this directory are not backed up, and the first subject to removal if the filesystem gets full. Use [[#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. | **Public scratch directory**: Use the public [[#lustre|Lustre]] scratch directory (/lustre/scratch or /lustre-scratch) for files where high performance is required. Store files produced as intermediate work files, and remove them when your current project is done. That will free up the public scratch workspace others also need. This is also a good place for sharing files with all users on Mills. Files in this directory are not backed up, and the first subject to removal if the filesystem gets full. Use [[abstract:mills:filesystems:lustre#lustre-utilities|Lustre utilities]] from a compute node to check disk usage and remove files no longer needed. |
| |
| **Home directory**: Use your [[#home|home]] directory to store small private files. Application software you use will often store its configuration, history and | **Home directory**: Use your [[#home|home]] directory to store small private files. Application software you use will often store its configuration, history and |