Local IBP Use at Vanderbilt University

1
Local IBP Use atVanderbilt University

• Advanced Computing Center for Research and
  Education

2
Introduction

• Current IBP Installation
• IBP Scalability Testing
• Current Enstore Installation
• Production (Stewart Lab)
• Testing
• Enstore Goals
• Planned IBP / Enstore Installation

3
Current IBP Installation
4
Current IBP Installation

• Registered with Public L-Bone
• 1 IBM x335
• Vlad01 ibp.accre.vanderbilt.edu6714
• Vlad02 ibp.accre.vanderbilt.edu6715
• 1 Infotrend EonStor
• Vlad01 1.6 TB
• Vlad02 1.4 TB
• Two of the three largest individual depots on the
  public L-Bone

5
IBP Scalability Testing

• Depot Testing
• 326 Active Depots
• Single File (259 MB)
• Uploaded to each Depot
• Results sorted to determine 50 fastest depots
• Multiple Test Runs to see variations over time

6
IBP Scalability Testing

• Campus Capacity
• ATT 45 Mb/s
• Qwest 180 Mb/s
• Sox 442 Mb/s
• One Workstation
• 267 MB RAM Disk
• 2 GB Total RAM
• Dual CPU (AMD Opteron 246)
• Gigabit Ethernet

7
IBP Scalability Testing

• Ten 259 MB Files (multiple uploads)
• Test Results
• Short Run
• Throughput 399.85 Mb/s (49.98 MB/s)
• Duration 518.19 seconds (8.6 minutes)
• Used 90 of Internet2
• Long Run
• Throughput 338.08 Mb/s (42.26 MB/s)
• Duration 1761.6 seconds (29.36 minutes)
• Used 76 of Internet2

8
IBP Scalability Testing
! /bin/sh bwTest.sh for i in seq 1
10 do ./upload.sh i gt upload.out.i
done wait ! /bin/sh
upload.sh time /klm/lors/bin/lors_upload -o
/bw/test1.xnd --depot-list \ --xndrc
/bw/bwTest1.xndrc --threads10 --timeout'5m'
\ --copies1 --none --duration300
/mnt/rd/small.tar rm -f /bw/test1.xnd
9
Python Integration Layer

• Uses Python.h
• Limited IBP changes
• Called on IBP store / load
• Proof of concept to disk
• Next step integration with encp

10
Current Enstore Installation
Production (Stewart Lab)
11
Current Enstore Installation

• Production (Stewart Lab)
• 2 IBM x335 (1 Enstore Server / 1 Enstore Client)
• WhiteBox Linux
• 2.4 Kernel
• 1 Infotrend EonStor attached to Enstore client
• 1 Overland Storage PowerLoader
• 1 SDLT Drive
• 15 Tapes
• Total Capacity 2.4 TB Native (4.8 TB Compressed)
• Current Usage 0.81 TB

12
Current Enstore Installation

• Testing
• 2 IBM x335 (1 Enstore Server / 1 Enstore Client)
• CentOS Linux
• 2.6 Kernel
• 1 Infotrend EonStor
• 2 Overland Storage Neo-2000
• 2 LTO-2 Drives each
• 30 Tapes each
• Total Capacity 12 TB Native (24 TB Compressed)

13
Enstore Goals

• Obtain latest code base
• Simplified installation
• Add ability to mark read-only tapes writable
• Incorporate Vanderbilt changes into CVS

14
Planned IBP / Enstore Installation
15
Planned IBP / Enstore Installation

• Private L-Bone
• Multiple IBP Depots around campus
• IBP Depots attached to cache mechanism
• SRM-dCache
• LoDN-Cache
• Integrated with Enstore for tape archival