SEEGRID Nis Training Material

1
Hands-on V Standard Grid Usage Duan
VudragovicSCL and ATLAS group Institute of
Physics, Belgrade
2
Getting a proxy certificate

• Get onto a machine that understand grid commands
• To create proxy
• voms-proxy-init --voms ltvogt
• To get information about proxy
• voms-proxy-info
• To destroy proxy
• voms-proxy-destroy
• To create long-term proxy
• myproxy-init -s lthost_namegt -d -n
• To get information about a long-term
• myproxy-info -s lthost_namegt d
• Deleting a stored long-term proxy
• myproxy-destroy -s lthost_namegt -d

3
Data menagment

• GUID Grid Unique Identifier
• guidbbffd56a-eff0-4b59-af7b-2a235986001c
• LFN Logical File Name
• lfnTestFile.dat
• SURL Storage URL
• sfn//castorgrid.cern.ch/castor/cern.ch
• TURL Transport URL
• gsiftp//castorgrid.cern.ch/castor/cern.ch

4

• Low Level Data Management Tools
• Checks the existence of a file or directory on a
  SE
• edg-gridftp-exists URL
• Lists a directory on a SE
• edg-gridftp-ls URL
• Creates a directory on a SE
• edg-gridftp-mkdir URL
• Renames a file on a SE
• edg-gridftp-rename sourceURL destURL
• Removes a file from a SE
• edg-gridftp-rm URL
• Removes a directory on a SE
• edg-gridftp-rmdir URL
• Copies files between SEs
• globus-url-copy sourceURL destURL

5

• LCG Data Management Client Tools
• Copies a Grid file to a local destination
• lcg-cp --vo ltvogt ltlfngt ltfilegt
• Copies a file to a SE and registers the file
• lcg-cr --vo ltvogt -d SURL l ltlnfgt ltfilegt
• Registers in the the catalog
• lcg-rf --vo ltvogt -l ltlfngt ltsurlgt
• Unregisters in the the catalog
• lcg-uf --vo ltvogt ltguidgt ltsurlgt
• Gets the GUID for a given LFN or SURL.
• lcg-lg --vo ltvogt ltlfngt
• Lists the replicas for a given LFN, GUID or
  SURL.
• lcg-lr --vo ltvogt ltlfngt

6
Some JDL attributes

• Type
• for LCG2 only Job type supported
• JobType
• values Normal, MPICH, Interactive
• Executable
• command name
• Arguments
• command line arguments
• StdOutput
• file where the job standard output goes
• StdError
• file where the job standard error goes
• InputSandbox
• files for transfer from UI to the WN
• OutputSandbox
• files for transfer from WN to the UI

7

• Requirements
• to send a job to a particular CE
• Requirements other.GlueCEUniqueID
• ce.phy.bg.ac.yu2119/jobmanager-pbs-seegrid
• job must run on a CE where a particular
  experiment software is installed
• Requirements Member("VO-atlas-release-11.0.2",
  
• other.GlueHostApplicationSoftwareRunTimeEnviron
  ment)
• for MPI job
• Requirements Member("MPICH",
  other.GlueHostApplicationSoftwareRunTimeEnvironmen
  t)
• Simple JDL file
• Executable "/bin/sh"
• Arguments "HelloWorld.sh"
• Stdoutput "stdoutput"
• StdError "stderror"
• InputSandbox"HelloWorld.c","HelloWorld.sh"
• OutputSandbox"stdoutput","stderror"
• Requirements other.GlueCEUniqueID
• ce.phy.bg.ac.yu2119/jobmanager-pbs-seegrid

8
Job submission

• To submit a job
• edg-job-submit ltjdl_filegt
• edg-job-submit o ltjob_ID_filegt ltjdl_filegt
• edg-job-submit r ltCE_IDgt ltjdl_filegt
• Retrieving status of a job
• edg-job-status ltjob_IDgt
• edg-job-status i ltjob_ID_filegt
• Retrieving the output of a job
• edg-job-get-output ltjob_IDgt
• edg-job-get-output i ltjob_ID_filegt
• edg-job-get-output dir ltpathgt ltjob_IDgt
• Canceling a job
• edg-job-cancel ltjob_IDgt
• edg-job-cancel i ltjob_ID_filegt
• Listing CE that match a job description
• edg-job-list-match ltjdl_filegt

9
Possible job states in the LCG-2
10
Information Service

• Way to get information relative to the computing
  resources for certain VO
• lcg-infosites --vo ltvogt ce
• To know the status of the storage resources
• lcg-infosites --vo ltvogt se
• lcg-infosites --vo ltvogt closeSE
• To retrieve the tags corresponding to the
  software installation of certain VO
• lcg-infosites --vo ltvogt tag
• To have a list of the supported attributes
• lcg-info --list-attrs
• to find CEs with OS SL or SLC and list
  RunningJobs and FreeCPUs on them
• lcg-info --list-ce --query "OSSC"
• --attrs 'OS,RunningJobs,FreeCPUs'