Towards Storage On-Demand on Petabyte Grids

1
Towards Storage On-Demand on Petabyte GridsA
case forQuotas and Reserve-ahead, Timed Leases
and Contracts
Frank Wuerthwein UC San Diego
Abhishek Singh Rana UC San Diego
2
Towards Storage On-Demand on Petabyte GridsA
case forQuotas and Reserve-ahead, Timed Leases
and Contracts
Frank Wuerthwein UC San Diego
Abhishek Singh Rana UC San Diego
3
Case List

• Priority 0
• Reserve-ahead File transfer level (Implicit
  Reservation)
• Priority 1
• Bulk Quotas VO level (Explicit Partitioning)
• Fine Quotas Individual User level (generally
  Oversubscribed)
• Priority 2
• Reserve-ahead (from a Quota) User level
  (Explicit Reservation)
• Reserve-ahead (from a Quota) VO level (Explicit
  Reservation)
• Priority 3
• Hierarchical and Cumulative Exhaustion of Quotas
• Priority 4
• Storage space accrual and Time
• Timed Leases Contracts VO/User level
• Timed Leases Contracts Grid/Enterprise level

4
Quota
Reserve-ahead

• Based on agreements between a Site and VOs
• Assigned by a Site
• Ceiling on storage space to a VO or User
• Oversubscription possible
• Timeless configuration

• Based on needs of Users/Jobs
• Requested by a User/Job
• Can only be a subset of Quota
• Timed lease

5
Reserve-ahead File transfer level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Needed primarily for robust transfers. Independent
of quota as file size ltlt quota.
6
Bulk Quotas VO level
Storage at a Site
Owner/Primary VO
7
Bulk Quotas VO level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
8
Bulk Quotas VO level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Need bulk quotas for VOs to co-exist on SE
9
Fine Quotas User level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
10
Fine Quotas User level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
?
11
Fine Quotas User level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Need user level quota For users to co-exist.
12
Reserve-ahead User level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
13
Reserve-ahead VO level
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
14
Hierarchical and Cumulative Exhaustion of Quotas
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Used U1 Reserved R1 Exhausted Used
Reserved Available Total Exhausted
R1
U1
15
Hierarchical and Cumulative Exhaustion of Quotas
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Used U1 Reserved R1 Exhausted Used
Reserved Available Total Exhausted
R1
U1
16
Hierarchical and Cumulative Exhaustion of Quotas
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Used U11U12 Reserved R11 R12 Exhausted
Used Reserved Available Total Exhausted
R12
R11
U12
U11
17
Storage space accrual and Time Leases
Contracts VO/User level
f(t)
Storage at a Site
Owner/Primary VO
Peer VO1
Peer VO2
Used U11 U12 Reserved R11 R12 Exhausted
Used Reserved Available Total Exhausted
R-peer1
R12
R11
U12
U-peer1
U11
18
Storage space accrual and Time Leases
Contracts Grid/Enterprise level
f(t)
19
Storage space accrual and Time Leases
Contracts Grid/Enterprise level
f(t)