Data Intensive Sciences HE Physics, Astro

1
Data Intensive SciencesHE Physics, Astro
EarthOb

• VL-E proposal meeting
• NIKHEF, KNMI, ASTRON, JIVE

2
Data Intensive Sciences

• Application specific challenges
• Handing large (10 Pbyte) datasets
• In a distributed O (10k) user community
• Worldwide
• High Energy Physics (LHC, DØ)
• Earth Observation (ozone, weather pred.)
• Astronomy and astrophysics (radio, VLBI)

3
Application PSE

• Apps share common characteristics
• Trivially parallel to large extent
• Similar distribution problems
• Data replication and management
• Bandwidth, mass storage
• Data driven computing (scheduling)
• Automatic job partitioning

CAL