====== Globus Endpoints: Mills ======

The Globus file transfer service is a means to copy your important data off the Mills cluster to other Globus-enabled systems around the world.

All Mills users can make use of the Globus endpoint.  The endpoint is read only:  data cannot be copied //to// Mills, only copied //from// it.  All three major file systems are presented on the endpoint:

  * ''/lustre/work/<workgroup>'' (workgroup storage directories)
  * ''/home/<uid-number>'' (user home directories)
  * ''/archive/<workgroup>'' (workgroup archival directories)

Data is provided to the Globus environment by a Data Transfer Node (DTN).  The Mills DTN is currently connected at 10 Gbps to the same network infrastructure servicing the Farber and Caviness login nodes.  In the future it may be connected to a higher-speed network to facilitate faster data movement.

===== Activating your Endpoint =====

Start by navigating to the Globus [[http://app.globus.org/|web application]] in your web browser.  If you have previously logged-in, you will be taken directly to the dashboard.  Otherwise do one of the following:

  * Click the "Globus ID to sign in" link if you have a Globus ID that you use for Globus services.
  * Choose the **University of Delaware** as your organization and click the **Continue** button; on the next page enter your UDelNet Id and Password and continue on to the dashboard.

Click the {{:technical:globus:endpoints.png?24|Endpoints}} button on the left to view your configured Globus endpoints.  In the search box at the top of the page, enter "Mills" and click the magnifying glass icon:

<WRAP center round box 60%>{{ :technical:globus:endpoints-list.png?832 |Mills endpoints listing}}</WRAP>

The "UofD Mills Cluster — Home, Work, and Archive Storage" endpoint should be visible.  Click the green "power-button-with-chasing-arrows" button to activate this endpoint; you will be asked to authenticate using your Mills username and password:

<WRAP center round box 60%>{{ :technical:globus:endpoint-connect.png?320 |Connect to Mills endpoint}}</WRAP>

If successful the list of files in your home directory (where ''/~/'' is a shortcut to ''/storage/home/<uid#>'') should appear:

<WRAP center round box 60%>{{ :technical:globus:endpoint-file-listing.png?400 |Mills endpoint file listing}}</WRAP>

===== Navigating the File Systems =====

The other file systems can be found by navigating to the ''/storage/'' path either by

  * entering "/storage/" in the field labelled **Path**
  * **OR** by clicking the {{:technical:globus:parent-directory.png?24|parent directory}} button to navigate to the parent directory, then double-clicking the directory named "storage" in that list

<note warning>Entering a path in the Path field is preferable to clicking through the directory hierarchy.  Listing the contents of directories containing many files/directories — like ''/home'' and ''/lustre/scratch'' — requires extensive communication between Globus and our DTN.</note>

The resulting file list should look like this:

<WRAP center round box 60%>{{ :technical:globus:endpoint-storage-dir.png?400 |listing of /storage/ directory}}</WRAP>

Mills paths are easily translated to Globus endpoint paths as:

<WRAP center 60%>
^File system^Mills path^Globus endpoint path^
|User home directory|''/home/<uid-number>''|''/storage/home/<uid-number>''|
|Workgroup storage|''/lustre/work/<workgroup>''|''/storage/lustre/work/<workgroup>''|
|Workgroup archival|''/archive/<workgroup>''|''/storage/archive/<workgroup>''|
</WRAP>

A user can determine his/her UID number (''<uid-number>'') by logging-in to Mills and issuing the id command:

<code bash>
$ id -u
1001
</code>

A list of the workgroups (''<workgroup>'') to which a user belongs can be generated by the ''workgroup'' command:

<code bash>
$ workgroup --query=workgroups
 1049  ccei_biomass
 1063  ccm_gillespi
 1001  it_nss
</code>

===== Copying Data =====

The Globus web application is used to create a data copy from the Mills endpoint to another endpoint.  First, the destination endpoint must also be activated and displayed in the web application.  From there creating a copy operation is as simple as dragging a file or folder from the Mills listing to the listing for the other endpoint.  Please see the Globus documentation for additional details about initiating transfers.