So you have a TeraGrid Allocation

1
So you have a TeraGrid Allocation

• What now?

2
What is the TeraGrid?
A free NSF infrastructure for open scientific
research providing

• Computational resources
• Data storage and Management
• Interfaces to data sets
• Specialized gateways for scientific domains
• Centralized help, allocations, and usage tracking
• All connected via high-performance network

For information on individual TeraGrid resources
go here
http//teragrid.org/userinfo/hardware/index.php
3
Outline

• TeraGrid User Portal Overview
• TeraGrid Knowledge Base
• Accessing Resources
• File Transfers
• How to Get Help
• Managing Your Environment
• Security
• Next Steps

4
TGUP (TeraGrid User Portal)

• Web-based single point of contact for
• Access to your TeraGrid accounts and allocated
  resources
• Interfaces for data management, data collections,
  and other user tasks and resources
• Access to TeraGrid Knowledge Base, Help Desk, and
  online training

5
Accessing TeraGrid User Portal

• When you get your accounts packet you will have a
  portal account (username and password) listed
• Important The portal account is also your
  TG-Wide login
• From the portal you can access any allocated
  TeraGrid resource.

6
Accessing TeraGrid User Portal
https//portal.teragrid.org
7
Accessing TeraGrid User Portal

• Login using your TeraGrid portal account
• You can find your username and password for this
  account on the TeraGrid password sheet you
  received via US Mail.
• On the password sheet your username and password
  can be found in the box entitled User Portal
• Enter your username and password

8
Changing Your Portal Password

• For security reasons it is important to change
  your password immediately
• Minimum length 6 characters
• The password you pick must be secure and include
  at least 3 of the following character classes
• Lower-case letters
• Upper-case letters
• Digits
• Punctuation
• Tip Start with the first letters of words in a
  phrase you can remember and add in some
  upper-case letters, numbers, and/or punctuation
  in easy-to-remember spots

9
Change Portal Password
To change your password

• Log in to the user portal
• Select the MyTeraGrid tab
• Go to the Change Portal Password link.
• Enter your original password (which can be found
  on your TeraGrid password sheet and you just used
  it to login)
• Enter a secure password of your choice
• Select the Change portal password button to
  finalize your password change.

10
Portal Overview

• The portal allows you to access various types of
  information pertaining to both your account and
  TeraGrid resources.

My TeraGrid Resources
Documentation
Training Consulting
Allocations
11
Portal MyTeragrid

• Allocations/Usage
• View your allocations usage
• Shows start and end dates of each allocation,
  units awarded and remaining on each resource, and
  your usage (PIs can see all users usage)
• Accounts
• View resources that you can access
• Includes machine login information, resource
  institution, username and resource login
• Profile
• View and or change your user information
  (organization, address)
• Change Portal Password
• Add/Remove User
• Allows a Principal Investigator to add or remove
  users from a given grant
• SSH Terminal
• Connect to multiple TeraGrid systems
  automatically from the convenience of the user
  portal

12
Portal Resources

• Systems Monitor
• View system information that includes CPUs, jobs
  running in queue
• File Manager
• Transfer files between your local workstation
  and/or TeraGrid resources
• HPC Queue Prediction
• Can predict questions like
• What is the chance my job will begin running
  within a certain time?
• How long will it take my job to begin running?
• Remote Visualization
• Offers interactive visualization capabilities for
  users needing to analyze very large data sets
• Science Gateways
• domain-specific computing environment, typically
  accessed via the Web, that provides a scientific
  community with end-to-end support for a
  particular scientific workflow
• Data Collections
• Data collections represent permanent data storage
  that is organized, searchable, and available to a
  wide audience, either a collaborative group or
  the scientific public in general

13
Portal Documentation

• User Information
• Accessing the TeraGrid
• Need Help?
• Latest User System News
• Manage Email Subscriptions
• User Support Updates
• TeraGrid Knowledge Base
• Searchable database with answers to user questions

14
TeraGrid Knowledge Base

• Information is organized in various ways to make
  it easy to find
• Searchable
• Grouped by
• New Documents
• Recently revised
• Most popular
• Most popular last week
• Help with TeraGrid
• Suggestions/Comments/Corrections

15
Example Search Knowledge Base

• Search Results

16
Accessing Resources

• Single Sign On (SSO) is a sign on method that
  provides access to TeraGrid resources.
• Once a session is initiated, you will not be
  asked for other passwords throughout the duration
  of the session (default 12 hours).
• Different SSO methods
• Through the TeraGrid User Portal
• From Command Line of a TeraGrid Resource

17
Web Based SSO via TeraGrid User Portal

• Make sure you are logged into the TeraGrid User
  Portal
• Go to My Teragrid tab
• Go to the Accounts link
• Resources you have access to will be indicated by
  a login link
• Click on the login link of the resource you
  would like to login to

18
Web Based SSO via TeraGrid User Portal

• Initially a blank terminal window will appear in
  your web browser
• The window will fill with text indicating that
  you have successfully been logged into the
  resource of your choice

19
SSO (Non Portal) from a TeraGrid Resource

• SSH to the TeraGrid resource that you've chosen
  as a starting point using the instructions for
  that resource from your account information
  packet.
• Run myproxy-logon -l ltusernamegt You will get a
  prompt to enter your MyProxy passphrase. Use your
  current TeraGrid Portal username and password for
  this step. You can type man myproxy-logon to
  learn more about the options to this command.
• Run grid-proxy-info to verify a proxy has been
  established. This will also tell you how long
  your proxy will last.
• Now you can access TG resources without a
  password using gsissh
• (If you encounter problems, they may be related
  to establishing your environment.
• We will cover this shortly.)

20
Example

• tg-login10 8/joeusergt grid-proxy-info
• ERROR Couldn't find a valid proxy.
• Use -debug for further information.
• tg-login10 8/joeusergt myproxy-logon -l joeuser
• Enter MyProxy pass phrase
• A credential has been received for user joeuser
  in /tmp/x509up_u18228.
• tg-login10 8/joeusergt grid-proxy-info
• subject /CUS/ONational Center for
  Supercomputing Applications/CNJoe User
• issuer /CUS/ONational Center for
  Supercomputing Applications/OUCertificate
  Authorities/CNMyProxy
• identity /CUS/ONational Center for
  Supercomputing Applications/CNJoe User
• type end entity credential
• strength 1024 bits
• path /tmp/x509up_u18228
• timeleft 115942
• tg-login10 8/joeusergt gsissh tg-login.lonestar.tac
  c.teragrid.org
• Last login Wed Jul 9 154704 2008 from
  machine.psc.edu

21
File Transfers Small (lt 1 GB) Files

• scp from Unix command line
• TeraGrid User Portal File Manager
• Log into the TGUP
• Select Resources tab
• Select File Manager tab (now wait for it to
  load)
• To upload a local file to a TeraGrid Resource
• Select TG resource from window on right
• Wait for files on remote resource to appear
• Drag files from local machine to TG resource
• To transfer files between TG resources
• Make sure small rectangle in upper left hand
  corner of each window (with TG logo) is selected
• Select desired TG resources in both windows
• Drag files between resources

22
File Manager

• Click on rectangle pointed to by the red arrow
  to access TG resources (rectangle with TeraGrid
  logo)
• Click on the View tab and select Show
  Transfers to get information on past and ongoing
  file transfers

23
Large File Transfers within the
TeraGridTeraGrid User Portal File Manager

• On the left panel of the file browser, click the
  TeraGrid logo to display your list of available
  resources
• Right click on the resource youre going to
  transfer data from and select Edit
• This will bring up the file transfer parameters
• Click on the Optimize button
• Click the checkbox next to Stripe Transfers
• Click OK
• Repeat for the other panel using the destination
  resource
• Drag and drop the file from source to destination
  to transfer
• Repeat this every time you change Resources

24
Large (gt100 MB) File Transfers within the
TeraGrid Command line method

• globus-url-copy uses the GridFTP protocol
  (GridFTP is not a command) to transfer at rates
  100 MB/sec
• Example (PSC Bigben -gt TACC Ranger)
• Minimal (all on a single line) DO NOT USE FOR
  LARGE FILES!
• globus-url-copy gsiftp//gridftp.bigben.psc.teragr
  id.org/scratcha/joeuser/file gsiftp//gridftp.rang
  er.tacc.teragrid.org/scratch/joeuser/
• Optimized USE THIS FOR LARGE FILES!
• globus-url-copy -stripe -tcp-bs 8388608
  gsiftp//gridftp.bigben.psc.teragrid.org/scratcha/
  joeuser/file gsiftp//gridftp.ranger.tacc.teragrid
  .org/scratch/joeuser
• Look here for names of gridftp servers at each
  site http//teragrid.org/userinfo/data/transfer_l
  ocation.phpdeployment
• speedpage.psc.edu provides advance information
  on the file transfer rate you can expect using
  globus-url-copy with the optimized parameters
  above.
• For more information see http//teragrid.org/user
  info/data/transfer.php

25
How to Get Help

• First, try searching the Knowledge Base or other
  Documentation
• If that doesnt help, submit a ticket
• Send an email to help_at_teragrid.org
• Use the TeraGrid User Portal Consulting tab
• Can also call TeraGrid Help Desk 24/7
• 1-866-907-2383

26
Submitting a Ticket

• Your user information will be autofilled
• Just fill out the rest of the form
• Make sure you include a detailed problem
  description before submitting the form

27
Managing Your Environment Softenv

• What is it?
• One method of manage your software environment on
  TeraGrid machines. In other words, you can use
  it to configure which applications and packages
  are available to you when you log onto a TeraGrid
  machine
• How does it work?
• A .soft file in your home directory contains
  keywords that configure your environment
• Entries beginning with _at_ are suites that
  configure multiple packages
• Entries beginning with are package keys that
  configure a single package
• A .nosoft file in your home directory disables
  softenv
• The default .soft file may vary from site to site
  (or may not exist at all), but the standard
  TeraGrid version contains the following
• TeraGrid wide basic software suite
• _at_teragrid-basic
• TeraGrid wide Globus 4 and Grid software
  suite
• _at_globus-4.0
• Platform recommended development software
  suite
• _at_teragrid-dev

28
Softenv

• Use softenv command to show all available
  keywords on a given platform
• add keywords to your .soft file to change your
  environment
• issue the resoft command to make changes take
  effect (or logout and log back in)
• Use soft-dbq command to show what a given
  keyword does
• joeuser_at_tg-login9gt soft-dbq _at_teragrid-dev
• acml-3.0 atlas-3.6.0 goto hdf4 hdf5
  pgi-6.1.4 totalview-7.0.1-6 xt-pe xt-mpt
  xt-libsci
• joeuser_at_tg-login9gt soft-dbq pgi-6.1.4
• Description PGI compiler suite 6.1.4
• The following environment changes will be made
• LD_LIBRARY_PATH LD_LIBRARY_PATH/opt/pgi/
  6.1.4/linux86-64/6.1/lib/opt/pgi/6.1.4/linux86-64
  /6.1/libso
• LM_LICENSE_FILE LM_LICENSE_FILE/opt/pgi/
  6.1.4/license.dat
• MANPATH MANPATH/opt/pgi/6.1.4/linux86-64
  /6.1/man
• PATH PATH/opt/pgi/6.1.4/linux86-64/6.1/b
  in
• PGI /opt/pgi/6.1.4
• PGI_DIR /opt/pgi/6.1.4/linux86-64/6.1

29
Managing Your Environment Modules

• Some sites also have the option to manipulate
  environment using modules
• module list shows currently loaded modules
• module avail shows available modules
• module show ltnamegt describes module

module load gcc/3.1.1 which gcc
/usr/local/gcc/3.1.1/linux/bin/gcc module
switch gcc/3.1.1 gcc/3.2.0 which gcc
/usr/local/gcc/3.2.0/linux/bin/gcc module
unload gcc which gcc gcc not found
http//modules.sourceforge.net/
30
Softenv and Modules Which do I use?

• Rule of thumb go with the default on a given
  machine
• When you login for the first time issue softenv
  and module list commands
• In general, only one should be active by
• default go with that one
• If you have questions or run into any problems
  contact help_at_teragrid.org

31
Security The Basics

• You are responsible for your account.
• Do not share accounts
• Protect your password(s)
• Includes not sharing passwords, not writing
  passwords down where they can be easily found,
  and not using tools which expose passwords on the
  network
• This includes private keys make sure they are
  password-protected.
• Appropriate Behavior
• Protecting computing, closing SSH terminals when
  done, logging out of TGUP when done, etc.
• Report Suspicious Activity
• If you have any suspicion that your account or
  personal computer has been compromised send email
  to help_at_teragrid.org immediately

32
Next Steps

• TeraGrid Resource User Guides
• http//www.teragrid.org/userinfo/hardware/resource
  s.php
• File Transfers and Data Management on TeraGrid
• http//www.teragrid.org/userinfo/data/
• More Training
• https//portal.teragrid.org/gridsphere/gridsphere?
  cidonlinetraining
• Please complete the Session Survey, online at
• http//tinyurl.com/TGNewUserTraining-Aug09

33
(No Transcript)