SRB Tutorial

1
SRB Tutorial

• Michael Wan
• Roman Olschanowsky
• Vicky Rowley

2
Agenda

• Tuesday, March 18th
• 100-130 Introduction to SRB
• 130-145 Installation, Administration
• 145-245 Overview of inQ, mySRB, and Scommands
• 245-300 BREAK
• 300-320 inQ
• 320-340 mySRB
• 340-400 Scommands
• 400-430 QA

3
Goals

• Basic understanding of the SRB, including
• Installation and Administration
• Basic SRB operations on a variety of clients
  (get, put, metadata)
• Sources of additional information and assistance
• Have Fun

4
SRB Info Resources

• http//www.npaci.edu/DICE/SRB
• largest collection of info
• http//www.npaci.edu/SRB
• generally applicable SRB info
• FAQ, tutorial, glossary, hotpage, etc.
• SRB Hotpage
• http//srb.npaci.edu/hotpage.html
• SRB server status

5
SRB Info Resources (contd)

• SRB 2.0 client/server download
• http//www.npaci.edu/dice/srb/tarfiles/main.html
• inQ Homepage
• http//www.npaci.edu/dice/srb/inQ/inQ.html
• mySRB URL
• https//srb.npaci.edu/mySRB2v7
• Online tutorials
• http//nbirn.net/ForUsers/SRB/SRBCentral.html

6
The BIRN SRB Data Grid
7
SRB Space
SRB
SRB
SRB
SRB
SRB
SRB
SRB
DL
SRB
SRB
SRB
DR - Data Repository DL - Dig Library MC - Meta
Catalog SC - SRB Client
8
SRB Location or Server
SRB
Resources at this Location
Location
SRB
9
Logical Resource
SRB
instant replication
fast archival
resource pooling
MyResource
SRB
10
SRB System Admin Tools

• The SRB system admins main function is to ingest
  knowledge of SRB systems and configurations into
  the MCAT database.
• JAVA based GUI.
• Command line based utilities.
• Ingesting New User/User Group, New
  physical/logical Resource, Adding physical
  resource to logical resource,

11
Usually two SRB accounts

• srb The SRB Server account, runs the SRB server
  software for the tower.
• ( Do not use this account )
• srbdev Copy of srbs SRB software for
  development use. ( new software staging for
  server and or client builds )

12
Important files User srb
/
/home/srb
/srb/SRBVault/
SRB-2.0.0
bin
data
13
Important files User srb

• SRBVault/ - Files in srb file-space
• (accessible by Data Grid)
• bin SRB Master and Server binaries
• data srbLog and saved.srbLogs

14
Clients

• InQ
• MySRB
• Scommands

15
inQ

• Windows OS only
• User Guide at http//www.npaci.edu/dice/srb/inQ/in
  Q.html
• Download .exe from http//www.npaci.edu/dice/srb/t
  arfiles/main.html
• Double-click icon enter connection parameters

16
inQ Features

• Familiar Windows Explorer GUI
• Menus
• Buttons
• Top and side
• Most common SRB operations (cut, copy, paste)
• Pull-downs
• Metadata
• Resource/container
• Graphical navigation
• Plus/minus sign for permissions subcollections
• Drag and drop

17
inQ Features (contd)

• Browse a dataset by double-clicking on an icon
• Create, rename, assign metadata to, and delete
  collections and datasets
• Create queries and nest queries underneath your
  results

18
inQ Client Demonstration

• inQ (Roman)
• Connect as roman
• Upload files car.txt and car.jpg
• DragnDrop
• Upload Button
• Set permissions so everyone has read access
• By default, only creator has access
• Set metadata so everyone can query
• KeyValue pair (e.g. MakeFord, ModelMustang)

19
inQ Notes

• can store connection parameters
• pay attention to default resource
• Example change to du-unix for tutorial
• upload limited files using up arrow
• upload unlimited files using drag and drop
• download via arrow or drag and drop

20
inQ Notes (contd)

• viewing and setting permissions
• first pulldown changes, click Add to add
• add permissions and then make recursive
• second pulldown, after Add, adds new permission
• adding metadata
• querying metadata, use AND to join small queries
  into a complex one

21
mySRB

• Web-based access to the SRB
• Secure HTTP
• https//srb.npaci.edu/mySRB2v7.shtml
• Uses Cookies for Session Control

22
mySRB Features

• Access to Both Data and Metadata
• Data File Management
• Collection Creation and Management
• Collection of Varied Objects
• Files, SQL Objects, Databases, URLs, directories,
  archives,
• Metadata Handling
• Browsing Querying Interface
• Access Control
• Support for proxy (remote) operations

23
mySRB Client Demonstration (contd)

• mySRB (Vicky)
• Connect as vrowley
• Upload file set metadata using Ingest File
• Query for MakeFord in /home
• Move Up then Browse Query
• Query is done in current collection
• Query is case sensitive
• Download file
• Select Download File from menu

24
Scommands

• Command line access to the SRB
• Download from http//www.npaci.edu/dice/srb/tarfil
  es/main.html
• Login to machine with Scommand binaries
• via ssh to a nix machine
• Win32 binaries from command window
• Verify/Create /.srb/.MdasEnv
• Verify/Create /.srb/.MdasAuth

25
Scommand Features

• Command line interface -gt SCRIPTING
• Flexibility
• Power
• Complexity
• Installed man pages via Sman Scommand
• alias Sman '/usr/bin/man M /home/srb/SRB-2.0.0/ut
  ilities/man

26
Scommand Features (contd)

• Shelp
• Gives list of commands with brief summary
• Scommand ltreturngt gives usage info (usually)
• Sinit establishes connection
• Senv displays connection information
• Sexit ends connection

27
Common Scommands

• Sinit
• Senv
• Spwd
• Sls -l
• Sget
• Sget (Sget m)
• Sbunload
• Sput
• Sput (Sput m)
• Sbload

• Scp
• Smv (logical)
• Sphymove (physical)
• Srm
• Scd newCollection
• Smkdir newCollection
• Srmdir newCollection
• Serror
• Dont forget to Sexit!

28
Scommands (contd)

• Slscont
• Smkcont
• Ssyncont
• Sreplcont
• Srmcont
• Sannotate
• Scat

• Schmod
• Smeta
• Sreplicate
• Spcommand
• Sregister
• Sattrs

29
Scommands (contd)

• Spasswd
• Sappend
• Smodcoll
• SmodD

• SgetD
• SgetR
• SgetT
• SgetU
• SgetColl newCollection

30
Scommand Client Demonstration

• Scommands (Vicky)
• Connect as vrowley
• Sinit
• Senv
• Sls
• Smkcont vickyCars
• Sput, Sput r, Sput m, Sbload
• Sget, Sget r, Sget m, Sbunload

31
inQ Hands On

• Your mission
• Download car.txt file from Romans home
  collection
• Modify the downloaded car.txt file to reflect
  your car
• Upload car.txt file to your student SRB home
  collection
• Assign metadata for the make of your car to your
  car.txt file
• Extra credit give read permission to student
  next to you

32
inQ Connection Parameters

• Need to know
• Username
• Example dultgt (e.g. du0, du1, du2, etc.)
• SRB server hostname
• Example srb.sdsc.edu
• Domain
• Related to site
• Example npaci

33
inQ Connection Params (contd)

• Need to know (contd)
• Port 5544
• Authorization method
• ENCRYPT1 (almost always)
• GSI_AUTH
• PASSWD_AUTH, SEA (to be deprecated)
• Password

34
inQ Hands On instructions download, resource
selection

• Open car.txt from /home/roman.sdsc by
• double-clicking file icon (opens in editor, saves
  to temp directory)
• clicking download button (saves to location
  edit by hand)
• Edit and save to desktop
• Select resource (e.g. du-unix) for file storage

35
inQ Hands On instructions upload, metadata

• Upload to home collection (e.g. /home/du0.npaci)
• DragnDrop or use upload button
• Attach Makeltwhatevergt metadata
• Select car.txt file icon
• Click M button
• Type Make ltreturngt your_make_here ltreturngt

36
inQ Hands On instructions permissions

• Change access permissions
• Select car.txt file icon
• Click key button
• Click Add . .
• Select npaci domain
• Click username for student next to you
• Select read from pull down list

37
mySRB Hands On

• Your mission
• Download car.txt file from Vickys home
  collection
• Modify the downloaded car.txt file to reflect
  your previous car and save as car2.txt
• Upload car2.txt file to your student SRB home
  collection
• Assign metadata for the make of your previous car
  to your car2.txt file
• Extra credit
• give read permission to student next to you
• Query metadata on /home collection to see who
  else has a car with the same make as yours

38
mySRB Connection Parameters

• Need to know
• Username (e.g. du0, du1, du2, etc.)
• Domain (e.g. npaci)
• Port 5544
• Password

39
mySRB Hands On instructions

• Open car.txt
• Move up
• Open collection vrowley.sdsc
• Choose Download File from menu next to car.txt
• Edit and save as car2.txt
• Use Ingest File to upload car2.txt to
  /home/dultgt and simultaneously attach
  Makeltyour_make_heregt metadata

40
Scommands Hands On

• Your mission
• ssh to multivac.sdsc.edu using username and
  password on sheet provided
• Change permissions on your car.txt file
• Make a new collection where you can store car.txt
  files with the same Make as yours
• Search for other car.txt files with the same Make
  as yours
• Copy one of the located files from its original
  location to your new collection

41
Scommand Connection Parameters

• /.srb/.MdasEnv file
• mdasCollectionName '/home/du0.npaci'
• mdasCollectionHome '/home/du0.npaci'
• mdasDomainName npaci'
• mdasDomainHome npaci'
• srbUser du0'
• srbHost srb.sdsc.edu'
• defaultResource du-unix'
• srbPort '5544'

• /.srb/.MdasAuth file
• ltpasswd_in_plain_text

42
Scommands Hands On instructions

• Sinit
• Schmod r public npaci car.txt
• Smkdir carstuff
• Smeta I UDSMD0Make I UDSMD1ltyour_make_he
  re
• Scp ltresult_of_Smetagt carstuff
• Sexit