Storage

SciClone and Chesapeake incorporate a variety of storage devices, ranging from individual disks hosted on server nodes to large RAID arrays. Filesystems are exported from server nodes to compute nodes via the Ethernet and InfiniBand networks, primarily using the NFS file-sharing protocol. Most servers are provisioned with 10 Gb/s Ethernet interfaces to reduce the many-to-one fan-in bottleneck from the compute nodes, which generally have 1 Gb/s Ethernet interfaces.

Principal storage devices for SciClone include:

Device

Host(s)

Total

(unformatted)

capacity

Connectivity

Exported via

Filesystems

(/sciclone/...)

Dell MD3600f

disk array

tornado

24 TB

(12×2)

8 Gb/s FC

NFS over

10 GbE

scr30

Dell HPC NSS

storage server

(with four MD1200s)

twister

96 TB

(4×12×2)

6 Gb/s SAS

NFS over

QDR IB

data20

DDN SFA7700

disk array

breeze

942 TB

(62×4 +

 54×6 +

 30×8 +

 13×10)

FDR IB

NFS over

FDR IB

scr10

gale

baby10

aiddata10

bkup10

Dell ML6030

tape library

(with four LTO-5 drives)

337 TB

(225×1.5)

8 Gb/s FC

via SAN

N/A

N/A

Dell R730xd

mistral

128 TB

(16×8)

12 Gb/s SAS

NFS over

OP or 1 GbE

scr-mlt

(2) Dell R630

(with one MD3420)

msn01-

msn02

12 Gb/s SAS

Lustre over

FDR IB

pscr

(3) Dell R730xd

msn03-

msn05

216 TB

(3×12×6)

-

TBD

72 TB

(36×2)

6 Gb/s SAS

NFS over

QDR IB

TBD

Dell HPC NSS

storage server

(with one MD3460)

tempest

400 TB

(40×10)

12 Gb/s SAS

NFS over

QDR IB

data10

And for Chesapeake:

Device

Host

Total

(unformatted)

capacity

Connectivity

Exported via

Filesystems

(/ches/...)

Dell MD3260

disk array

york

180 TB

6 Gb/s SAS

N/A

bkup10

Dell HPC NSS

storage server

(with four MD1200s)

rapp

168 TB

(24×3 + 24×4)

NFS over

QDR IB

scr10

Dell MD3460

disk array

chop

180 TB

(45×4)

12 Gb/s SAS

data10