Using Globus on Caviness

Moving personal data onto and off of the Caviness cluster using the Globus file transfer service uses a staging area on the /lustre/scratch filesystem. This approach is necessary when the Globus guest collection properties are enabled on a collection:

1. When you authenticate to activate your Caviness collection, Globus generates a certificate that identifies that activation.
2. All navigation and file transfer requests against your Caviness collection are authenticated by that certificate.
3. When you share that collection, you are essentially giving your certificate to other Globus users so that they access your Caviness collection as you.
4. Thus, any content to which you have access on your Caviness collection is also visible to the Globus users with whom you've shared access.

If we were to simply expose the entirety of /lustre/scratch on Globus, then when you enable sharing you could be providing access to much more than just your own files and directories. This would be a major data security issue, so we instead present a specific sub-directory to Globus: /lustre/scratch/globus/home.

A user requesting Globus-accessible storage is provided a directory (named with the uid number, e.g. 1001) which is his/her staging point:

• Make files already on /lustre/scratch visible on your Globus endpoint by moving them to /lustre/scratch/globus/home/<uid#> (using "mv" is very fast; duplicating the files using "cp" will take longer).
• Copy files from home or workgroup storage to /lustre/scratch/globus/home/<uid#> (using "rsync" or "cp") to make them visible on your Globus endpoint.
• Please note: do not create symbolic links in /lustre/scratch/globus/home/<uid#> to files or directories that reside in your home or workgroup storage. They will not work on the Globus endpoint.

• The /lustre/scratch/globus/home/<uid#> directory is writable by the Globus, so data can be copied from remote collection to your Caviness collection.
• Files copied to /lustre/scratch/globus/home/<uid#> via Globus can be moved elsewhere on /lustre/scratch (again, "mv" is very fast and duplication using "cp" will be slower) or copied to home and workgroup storage.

Please submit a Research Computing High Performance Computing (HPC) Clusters Help Request and complete the form including Caviness and in the problem details indicate you are requesting a Globus home staging area on Caviness.

You can find your uid number using the "id" command:

$ id -u
1001

This user's Globus home directory would be /lustre/scratch/globus/home/1001. Users can append the following to the ~/.bash_profile file:

export GLOBUS_HOME="/lustre/scratch/globus/home/$(id -u)"

On login, the GLOBUS_HOME environment variable will point to your Globus home directory:

$ echo $GLOBUS_HOME
/lustre/scratch/globus/home/1001
 
$ ls -l $GLOBUS_HOME
total 100715
-rw-r--r-- 1 frey everyone 104857600 Jul 30 15:27 borkbork
drwxr-xr-x 2 frey everyone     95744 Aug 20 15:25 this_is_a_test
-rw-r--r-- 1 frey everyone 104857600 Jul 30 15:27 zeroes

Start by navigating to the Globus web application (http://app.globus.org/) in your web browser. If you have previously logged-in, you will be taken directly to the dashboard. Otherwise:

• Choose the University of Delaware as your organization and click the Continue button; on the next page enter your UDelNet Id and Password and continue on to the dashboard.

Click the “File Manager” button insert button image on the left side-panel. In the search box at the top of the page, enter "Caviness" and click the magnifying glass icon:

• <insert image>

The "UD CAVINESS Cluster - Staging Directory" collection should be visible. Click on the collection; you will be asked to authenticate using your UDelNet Id and Password if it is the first time you access the collection.

If successful (and you have a Globus home directory) the list of files in /lustre/scratch/globus/home/<uid#> should appear:

• <insert image>

To share your files with others via Globus, a user can create a Guest Collection, which enables sharing a directory in a user’s Globus Home directory. To create a Guest Collection, you need to first go to the collection details. You can either click the three dots next to the collection:

• <insert image>

Or right click on the directory you would like to share and select “Share”

• <insert image>

Click “Add Guest Collection” in the “Collections” tab

• <insert image>

Make sure you at least set the “Directory” and “Display Name” properly. It’s a good idea to fill in the other fields as well:

• <insert image>

Once the guest collection is created, you may want to set the permissions of this guest collection, e.g. sharing with specific individuals, making it public, allowing read permissions only, etc.

Click the "Create Collection" button. If successful, the following screen will show "Shared with" listing just you. Click the "Add Permissions — Share With" button to add (and notify) additional Globus users.