NPACI All Hands Meeting

1
The Cosmic Data Portal

• Catherine Mills
• cmills_at_sdsc.edu
• San Diego Supercomputer Center

2
Goal

• Describe the need for a cosmic portal
• Demonstrate abilities of Cosmic Data Portal

3
Outline

• Background on ENZO
• SRB browsing interface
• Basic File Browsing
• Meta Data
• Building Blocks
• Future Work

4
Enzo
ENZO is an adaptive-mesh-refinement calculator
built to study the origin and evolution of
structure in the cosmos. ENZO models the
universe as a cube and can be run at varying
resolutions (256 or 512).
5
Enzo

• Needs Large Input Files
• Create Large Amounts of Data
• Has Several Types of Data
• This Data is Valuable

6
Enzo Data

• Data is output in groups or dumps
• Each dump is about 35 min apart
• Each dump is about 14 GB
• Each run can be up to 75 dumps

7
What does that mean?

• One run can take over 37 hours
• One run can produce 1 TB of data

8
Cosmic Provides

• An interface to create input files
• An interface to browse this data

9
(No Transcript)
10
(No Transcript)
11
Cosmic SRB web browser

• Enables users to browse data by logical location
  rather than physical location

12
Cosmic SRB web browser

• Enables users to browse code by attributes rather
  than location
• Following Slide
• Query on
• Resolution 2563
• data type cube (raw)
• Redshift 3.6

13
(No Transcript)
14
Gridport and SRB

• Perl API for CGI programming
• Grid Tools for remote access to resources

15
Enzo data without SRB
Scenario 1
Scenario 2
Compute Resource
Long Term Storage
16
SRB for caching
Compute Resource
Disk Cache
Long-Term Storage
17
Future Work

• Migrate SRB browser to GP 2.2
• Expand Cosmic to include job submission and
  management
• Login abilities limited to myproxy

18
Thank You

• Gridport
• http//gridport.npaci.edu
• SRB
• http//www.sdsc.edu/DICE/SRB
• Enzo
• http//cosmos.ucsd.edu/