Close menu Resources for... William & Mary
W&M menu close William & Mary

Using Globus for data transfers to/from the HPC clusters

 

NOTE:  Globus v4 endpoints will no longer work after Dec. 18th 2023.  Please try using on of the GCS v5 endpoints to ensure you still can access Globus after this date. 
See the tutorials page for the Sept. 2023 the slides and recording of our CC*/Globus presentation.

 

Globus (https://www.globus.org/what-we-do) is a powerful tool for moving and sharing data between locations and users. The W&M/VIMS HPC clusters are currently transitioning between older version 4 of Globus to the newer version 5. Additionally, we now have a standard subscription which opens up new functionality. Therefore, not only can users transfer between two Globus enabled systems, a personal computer and a Globus enabled system, but now users can create "guest" collection which allows external users to access files on either cluster without needing a local HPC account.

Currently, all guest collections must be access through either through the main-campus server 'io' or 'James'.  The main difference between accessing Globus version 4 vs. version 5 is authentication.

In the sub-pages we will show how to:

  1. Use Globus to transfer files between a local computer and a Globus enabled site
  2. Use Globus to transfer files between two Globus enabled sites
  3. Prepare a guest collection on io.sciclone.wm.edu for an external user to download