Skip to main content
Close menu William & Mary

Using Globus for data transfers to/from the HPC clusters

 

IMPORTANT:

9/10/25 - Currently, the globus screenshots show using the outdated name (Sciclone Cluster at W&M, home (comet) V4).    

The main campus cluster has only one globus endpoint:   W&M RC/HPC/IO Collection 

Please search for this collection when you want to do a globus transfer to or from the main-campus HPC cluster.

For VIMS endpoints, see the list at the bottom of:

https://www.wm.edu/offices/it/services/researchcomputing/using/filesandfilesystems/xfers/

 

 

Globus (https://www.globus.org/what-we-do) is a powerful tool for moving and sharing data between locations and users. The W&M/VIMS HPC clusters are currently transitioning between older version 4 of Globus to the newer version 5. Additionally, we now have a standard subscription which opens up new functionality. Therefore, not only can users transfer between two Globus enabled systems, a personal computer and a Globus enabled system, but now users can create "guest" collection which allows external users to access files on either cluster without needing a local HPC account.

Currently, all guest collections must be access through either through the main-campus server 'io' or 'James'.  The main difference between accessing Globus version 4 vs. version 5 is authentication.

In the sub-pages we will show how to:

  1. Use Globus to transfer files between a local computer and a Globus enabled site
  2. Use Globus to transfer files between two Globus enabled sites
  3. Prepare a guest collection on io.sciclone.wm.edu for an external user to download