Storage Manager Scalability on CMPs

1
Storage Manager Scalability on CMPs

• Ippokratis Pandis
• CIDR 2009 - Gong Show

2
Scalability on CMP
Linear (ideal) scaling

• Scalability problems
• Are database systems ready for modern hardware??

Sun Niagara I - 32 HW Contexts Update intensive
workload No database lock conflicts
3
Problem?
Many HW Contexts (16-64)
1-25 GB/sec
20 cycles
L2

• Too many active concurrent threads
• Physical contention on centralized structures

4
Breaking the barrier

• Distribute everything!
• Locking, Logging, etc
• Rethink parallel databases
• on CMP context
• Instead of
• Moving data to computation
• Unregulated access to resources
• Distribute computation closer to data
• Control which thread is accessing each resource

5
Take-away Message

• Focus on Scalability!!
• Not Single-thread Performance
• Centralized mechanisms are evil
• Distribute computation to data
• Instead of moving data to computation
• Use Shore-mt!!

EDBT2009 Soon at http//www.cs.cmu.edu/stagedd
b/shoremt