Transferring files
IMPORTANT NOTE:
On December 18th, 2023, all v4 Globus endpoints will stop funtioning. After this date, you will need to use the W&M RC/HPC/IO Collection
Globus endpoint to for transfers to/from main-campus HPC (this one endpoint serves all main-campus HPC filesystems). For VIMS-campus, new v5 endpoints are available via VIMS Cluster at W&M, home00 (James)
(for /ches/home00), VIMS Cluster at W&M, data10 (Choptank) (for /ches/data10) or VIMS Cluster at W&M, scr10 (Rappahannock) for (/ches/scr10).
To transfer files to and from the HPC clusters, there are a few approaches. One can use the Globus file transfer service, an SFTP/SCP comand (from Linux and Mac) or an SFTP/SCP program (like WinSCP for Windows). Use the links on the left to see instructions for the appropriate approach for your local computer.
Picking the fastest/most-direct connection to an HPC fileserver:
When selecting a server node for file operations, it is best to use the node to which a relevant filesystem is local, or in the case of parallel filesystems, a node with good connectivity to it. Please refer to the following chart to ensure you are connecting directly to the local fileserver host when transferring files via sftp/scp:
SFTP/SCP hosts:
Filesystem | Hostname |
---|---|
/sciclone/home |
|
/sciclone/data10 |
lunar.sciclone.wm.edu |
/sciclone/pscr |
bora.sciclone.wm.edu |
/sciclone/scr10 |
polar.sciclone.wm.edu |
/sciclone/scr20 |
orbit.sciclone.wm.edu |
/sciclone/scr-lst |
kuro.sciclone.wm.edu |
/sciclone/schism10 |
snow.sciclone.wm.edu |
/sciclone/gluex10 |
sleet.sciclone.wm.edu |
/sciclone/scr-mlt |
mistral.sciclone.wm.edu |
/ches/home00 |
james.hpc.vims.edu |
/ches/data10 |
choptank.hpc.vims.edu |
/ches/scr10 |
rappahannock.hpc.vims.edu |
Globus Endpoints
The chart below shows the correct Globus endpoint for trasnfers from filesystems. When looking for an endpoint in globus, use the endpoint display name to search for that endpoint.
Filesystem | Recommended node and Globus Endpoint Display Name |
---|---|
|
|
/ches/home00 |
|
/ches/data10 |
|
/ches/scr10 |
|