Using DataStar Subhashini Sivagnanam Krishna Muriki SDSC

1
Using DataStarSubhashini Sivagnanam Krishna
MurikiSDSC
2
Submit a batch job to express queue on
DataStar
3
Logging in

• SSH2 (Secure Shell 2) client
• ttp//www.sdsc.edu/user_services/consulting/ssh.ht
  ml
• For this workshop Putty
• ssh ltusernamegt_at_dspoe.sdsc.edu (DataStar)

4
(No Transcript)
5
Moving files

• SCP
• scp original_file user_at_dspoe.sdsc.edu/to_dir/copi
  ed_file
• BBFTP
• gt2 GB
• ttp//www.sdsc.edu/user_services/datastar/getstart
  .htmlmoving
• High Performance Storage System (HPSS) /
• Storage Resource Broker (SRB)

6
File System Structure

• /home 1GB quota. Backed up. Do Not store large
  files or ouput
• /scratch Local file system (64 GB on each
  node). Space cleaned after each job.
• /gpfs 116TB shared parallel file system.
• NOT backed. Purgable
• /gpfs-wan Visible for read-write operations via
  TG network (210TB)
• HPSS (archival storage) - 6PB of tape
• http//www.sdsc.edu/user_services/hpss/