Storage%20and%20Transfer%20Solutions%20Between%20Clusters

1
Storage and Transfer Solutions Between Clusters

• The I-Cluster project (HPLabs ID-IMAG) aims at
  developing clustering solutions for office
  machines.
• Ranked 385 at the 2001 TOP500.

• Clustering tools developed
• NFSP (storage)
• GXfer (site to site transfer)
• Ka-Tools (installation, monitoring)
• OAR (batch scheduler)

• NFSP file system
• aggregate unused disk space
• standard NFS server
• easy installation on clients
• performances for low-cost

Reply
Request
Interconnection (UDP)
Distributed files
Meta-server
I/O daemons
Meta
Meta
Data
Data

• GXfer tool
• aggregate low-end system bandwidth to fill the
  network pipe
• optimize bandwidth use for inter-clusters
  tranfers

Large bandwidth
Small bandwidth
Small bandwidth

• GXfer comes with I/O daemons
• dynamic loading of file system plugins
• aggregate low-end system bandwidth to fill the
  network pipe
• optimize bandwidth use in inter-clusters tranfers