BNL Site Report

1
BNL Site Report

• Shigeki Misawa
• June 8, 2005

2
Computing Facility Overview

• RHIC (Relativistic Heavy Ion Collider)
• Data store for all data
• Primary center for data processing
• US Atlas Tier 1 Facility (LHC)
• Secondary data store for fraction of data
• Primary US site for data storage/processing

3
Computing Infrastructure

• 2400 Dual Processor Heavy Linux Farm
• 1 PB disk in the Linux Farm
• dcache/rootd/other for data management
• Centralized disk storage
• 220TB NFS storage (37 servers)
• 80TB Panasas storage

4
Role of HPSS

• Ingest all data experiment data
• 24x7 operation during accelerator running
• WAN based transfers (LHC)
• Source previously ingested data for processing
• What goes in, comes out at least once (not WORN)
• Source/sink data generated from subsequent data
  analysis passes.

5
Site Configuration

• HPSS 4.5.1/AIX 5.1
• Hardware
• H70 Core
• (1) P520/(2) 6H1/(2) H80/(3) H70 Movers
• 4 STK Silos
• (37) 9940B/ (4) 9940A/ (4) 9840B
• 3 FAStT900 Arrays 18TB total capacity

6
Site Configuration (Cont'd)

• (3) GigE/(1) 100Mb connections/mover
• 1 GigE Jumbo (Data Input)
• 1 GigE Non-Jumbo (Data I/O)
• 1 GigE Jumbo (Intermover)
• 100Mb HPSS control

7
HPSS Stats

• 15 Million Files
• 2.9 PB
• 1PB since the start of 2005
• File sized 2GB and smaller

8
Usage

• Data transfers (mostly pftp)
• Authentication via existing 2 Kerberos Realms or
  PKI (Grid Certs)
• Oak Ridge batch / batch replacement
• Optimized file retrieval
• Open and closed loop access to COS's
• Disk SC configured with migration always on

9
Future Growth

• Stored data growth 3-4 PB/year over next 4 years
• First significant refresh of HPSS hardware
• New library
• New complement of servers
• Additional tape drives
• Additional disk drives

10
Hardware Refresh

• Library Options
• STK SL8500
• SpectraLogic T950
• IBM 3584
• Mover OS Options
• Linux
• AIX

11
Hardware Refresh (cont'd)

• Tape Technology
• 3592 (Gen 2)
• STK Titanium
• LTO Gen3
• Disk Technology
• SAS
• SATA

12
Hardware Refresh (cont'd)

• Mover Hardware
• Small big mover/Large small movers
• 2x4 way Opteron server
• 1/2/2x2 way server
• Disk only/Tape only/Disk and Tape

13
Wish List

• HPSS 6.2 in early August
• Access non purge-able cache usage (CLI based)
• CLI On/Off switch for staging
• Better small file performance