SolarB Global DataGrid Update for AstroGrid SAG 10

1
Solar-B Global DataGridUpdate for AstroGrid SAG
10

• RAL MSSL
• Tim Folkes Elizabeth Auden
• Jens Jensen Paul Lamb
• Matthew Wild Matthew Whillock
• Len Culhane

Elizabeth Auden

28
September 2006
2
Overview

• The Solar-B mission was launched on Friday 22
  September 2006, from the Uchinoura Space Center
  in Japan.
• Mission duration 3 years nominal, 10 years
  lifetime expected
• Scientists and software engineers at MSSL and RAL
  have designed the Solar-B global data grid to
  provide mission data to solar research
  communities in the UK and abroad.
• Solar-B science objectives
• Data transfer and processing
• Data storage
• User access to data
• Data security

3
Solar-B Mission Overview
4
Solar-B Science

• Key Science Questions
• How is the solar corona heated? Are active
  regions heated in a different way to the quiet
  Sun?
• What causes solar flares and coronal mass
  ejections?
• How is energy transferred in the quiet Sun? How
  are solar magnetic fields affected?

Solar events like flares and coronal mass
ejections can have a profound affect on the
Earths magnetosphere. A geomagnetic storm in
1989 triggered a blackout of the Hydro Quebec
power system.
5
Transfer of Solar-B Data to ADS

• Data Migration Facility
• Manages NFS area
• Produced by SGI
• User transparent file migration
• Licence for 500Tbytes storage
• Backend STK SL8500
• 10,000 tape slots
• STK 9940B drives (200GB 30MB/sec)
• STK T10000 drives (500GB 120MB/sec)

ISAS Japan
Satellite data
LL data
ADS RAL
LL data
HL data
LL
processing
HL

• Solar-B data transferred via GridFTP from ISAS
  and MSSL to an NFS mounted disk at ADS.

6
ADS Data Storage
The DMF monitors the Solar-B NFS area and removes
disk copies of data to keep free space at
required level.
ADS Interface
NFS
DMF STK SL8500 robot
Tape

• Hardware
• Based on Altix 350
• Numaflex architecture
• 40 Tbytes raid disk
• Network
• Local server 1Gbit network
• Part of 10Gbit back-bone
• Coming soon SJ5 10Gbit link

Small files have primary copy on disk. (Speeds up
read/writes.)
Larger files have primary copy on tape.
All files have secondary copy on tape. These are
periodically moved to the firesafe.
Firesafe
7
User Access to Solar-B Data
Instrument Data SOT Solar Optical
Telescope Magnetic field images Optical
images Magnetic field velocity measurements
XRT X-Ray Telescope X-ray coronal images EIS
EUV Imaging Spectrometer Coronal line strengths
and profiles Plasma diagnostics
DMF
Files via URLs and DMF system at RALs UKSSDC
Users access data as URLs through the AstroGrid
workbench, STAP web services, browsers, or wget.
8
Accessing Solar-B data through AstroGrid
AstroGrid DSA
INPUT ADQL queries
AstroGrid workbench
MySQL
OUTPUT FITS keywords, URLs
DSA DataSet Access ADQL to SQL
AstroGrid STAP service
FITS keywords, Data URLs
INPUT start / stop dates
AstroGrid HelioScope, STAP enabled tools
OUTPUT URLs
STAP Simple Time Access Protocol
ADS Web-visible file system
AstroGRID PLASTIC tools, Solar-B website, wget,
browser
INPUT URLs
OUTPUT Solar-B files
9
AstroGrid User Components
AstroGrid workbench STAP service access through
HelioScope, DSA access through the Task Launcher.
Task Launcher locate DSAs, submit ADQL queries
Workbench http//www2.astrogrid.org/desktop/index
STAP Simple Time Access Protocol http//personal
pages.manchester.ac.uk/staff/s.dalla/astrogrid/str
ap.html DSA DataSet Access http//www.astrogrid.
org/maven/docs/HEAD/pal/index.html ADQL
Astronomical Data Query Language http//www.ivoa.n
et/Documents/latest/ADQL.html
HelioScope solar data results from STAP services.
10
Conclusions

• Solar-B launched on 22 September 2006
• Data transferred via GridFTP to ADS at RAL
• ADS facility uses DMF to manage files on disk and
  tape
• Data searchable through AstroGrid DSA and STAP
  web service
• Solar community accesses data through AstroGrid
  workbench, HelioScope or a web browser
• LINKS
• AstroGrid http//www.astrogrid.org
• Solar-B countdown http//www.mssl.ucl.ac.uk/www_s
  olar/