IU's TeraGridaccessible HPSS archival storage system

1
IU's TeraGrid-accessible HPSS archival storage
system

• Overview about HPSS
• Feeds and speeds, and particulars of IU's
  distributed HPSS environment
• Moving data to and from IU's HPSS via the
  TeraGrid and gridftp
• Hands on exercises with gridftp and HPSS

2
HPSS Background

• IU installed HPSS system in 1998
• HPSS is distributed between Indianapolis and
  Bloomington campuses.
• Over 1.8 petabytes of storage available and can
  scale to 4.2 petabytes
• In aggregate, HPSS can handle as much as 2GB/s of
  data flowing in or out.

3
HPSS Design
IUB Subsystem
IUPUI Subsystem
HPSS Core Servers
Research Network
Research Network
FC SAN
FC SAN
4
HPSS Performance

• 100MB/sec single thread over gigabit
• IU HPSS capable of gt1GB/sec in parallel over
  multiple 10 gigabit
• 150TB of DDN disk for cache
• 40 IBM Jaguar drives - 100MB/sec transfers

5
Storing Data

• Minimum file size should be one MB
• Prefer data to be at 10MB or larger
• Small files should be aggregated
• Maximum file size is 10TB
• By default, data is stored on tape at each campus

6
Class of Service

• Each file has class of service (COS)
• COS defines
• maximum file size
• number of copies
• stripe width
• With GridFTP, COS is chosen automatically by file
  size
• User can override by appending ,,ltCOSgt to the
  filename

7
COS Listing

• COS 1 - default max file size 10GB
• COS 2 - max file size 40GB
• COS 3 - max file size 10TB
• COS 4 - max file size 10TB
• 16 way to disk
• 4 way to tape
• Single copy COS available

8
Quotas

• Default is 1TB
• Can request up to 4.9TB
• Double these numbers if single-copy COS used
• What is MRAC and LRAC for storage

9
IU HPSS from TeraGrid

• Accessible by either
• gridftp.archive.iu.teragrid.org
• gridftp.hpss.iu.teragrid.org
• Need to add TeraGrid certificate to IU Big Red
  System
• uberftp and globus-url-copy tested and supported
• tgcp is not tested or supported

10
globus-url-copy Example

• Simple example to and from
• globus-url-copy -rp gsiftp//my.local.site/myfile.
  tar \ gsiftp//gridftp.archive.iu
  .teragrid.org/myfile.tar
• globus-url-copy -rp \
• gsiftp//gridftp.archive.iu.teragrid.org/myfile.t
  ar \ gsiftp//my.local.site/myfile.tar
• Parallel transfer to and from
• globus-url-copy -rp -stripe -bs 8388608 \
  gsiftp//my.local.site/bigfile.tar \
  gsiftp//gridftp.archive.iu.teragrid.
  org2814/bigfile.tar,,4
• globus-url-copy -rp -stripe \
  gsiftp//gridftp.archive.iu.teragrid.org2814/bigf
  ile.tar \ gsiftp//my.local.site/

11
uberftp example

• Simple Example
• uberftpgt put myfile.tar myfile.tar
• uberftpgt get myfile.tar
• Parallel Example
• uberftpgt open -P 2814 gridftp.archive.iu.teragrid
  .org
• uberftpgt lopen my.local.site
• uberftpgt parallel 4
• uberftpgt blksize 8388608
• uberftpgt put bigfile.tar bigfile.tar,,4