Introduction to Resource Registry

1
Introduction to Resource Registry

• Kevin Benson
• Astrogrid, MSSL
• UK

2
The first 3 steps
Build Tools to do Science
Take-up Standards Register Resources
Agree Build Standards Test Technologies
3
Current Look
4
Presentation Overview

• Resource Discovery Tool The Registry
• Introduction to IVOA resource types
• Interoperability Requirements
• Harvesting and search functionality
• Future Plans

5
Registry Definition

• The IVOA Registry allows an astronomer to be able
  to
• locate,
• get details of,
• make use of any resource
• located anywhere in any Virtual Observatory.
  The IVOA will define the protocols and standards
  whereby different registry services are able to
  interoperate and thereby realise this goal.

IVOA Resource Registry http//www.ivoa.net/
6
Resource Registry

• Type of resource catalogues, image archives,
• services, skynode, applications
• Coverage in space, time, and frequency
• Where data comes from, who curates it

• Resource
• Primarily data and services provided by
  organizations, projects,etc.
• Refers to the simple set of resource types, which
  are describable or identifiable.

• Registry
• provides a list of resource descriptions by means
  of structured metadata.
• Allows automated search and processing.

7
Registry Features

• Select based on criteria
• Dynamic resource integration
• Distributed architecture
• Allow extension to new types of resources

8
Registry (Model)
Harvest (pull)
Harvest (pull)?
Full Searchable Registry
Replicate?
Full Searchable Registry
Local Searchable Registry
9
Resource Discovery

• Search by criteria
• Harvesting based on metadata
• Open Archives Initiative (OAI) Protocol has been
  adopted and followed for exposing metadata to
  searchable registries (i.e.harvesters)
• http//www.openarchives.org/
• Also uses Dublin Core A standard for core
  resource metadata http//www.dublincore.org

10
Standards

• Registry standards come in two sections
• XML Schemas defining the various Resource types
• Interface Specifications defining the various
  search and harvest interfaces.

11
Registry Interface

• http//www.ivoa.net/twiki/bin/view/IVOA/RegistryIn
  terface
• SOAP Web Service interface Standard
• Searching
• Search(ADQL)
• KeywordSearch
• Harvesting
• To get updated records from publishing registries
• Web Browser (HTTP Get) Standard
• Harvesting
• To get updated records from publishing registries
  via http get OAI standard.
• Harvesting interface/verbs
• ListRecords, Identify, ListMetaDataFormats,
  ListSets

12
More on Harvest Interface

• Why OAI
• Allowed us to already use a interface, did not
  have to re-invent.
• Fairly easy to implement and many locations
  already had tools for OAI publishing.
• Several tools to help publish the metadata in a
  OAI format.
• Exposes our metadata to digital library community.

13
The Metadata

• They are organised into separate hierarchy
  schemas
• The core metadata (top level) Resource
• Capable of describing
• Data centres, services, cgi, web services, sky
  nodes, applications, archives, data collections.
• applications is not yet a ivoa published set.

14
Metadata Example

• http//www.ivoa.net/twiki/bin/view/IVOA/ResourceMe
  tadata
• ltresource xsitype"siaSimpleImageAccess"gt
• lttitlegtNCSA Astronomy Digital Image Library
  Simple Image Accesslt/titlegt
• ltshortNamegtADILlt/shortNamegt
• ltidentifiergtivo//adil.ncsa/sialt/identifiergt
• ltcurationgt
• ltpublisher ivo-id"ivo//adil.ncsa/adil"gt
• NCSA Astronomy Digital Image Library
  (ADIL)
• lt/publishergt
• ltcreatorgt
• ltnamegtRamon Williamsonlt/namegt
• ltlogogthttp//adil.ncsa.uiuc.edu/gifs/adilf
  ooter.giflt/logogt
• lt/creatorgt
• ltcontributorgtDr. Raymond Plantelt/contributor
  gt
• ltdate role"created"gt2003-01-01lt/dategt
• ltcontactgt
• ltnamegtADIL Librarianlt/namegt
• ltemailgtadil_at_ncsa.uiuc.edult/emailgt
• lt/contactgt

15
Metadata Example II

• ltcontentgt
• ltsubjectgtdata repositorieslt/subjectgt
• ltsubjectgtdigital librarieslt/subjectgt
• ltdescriptiongt
• This Simple Image Access Protocol
  implementation allows clients to
• progrommatically search for images in
  the ADIL that overlap with
• the given region.
• lt/descriptiongt
• ltreferenceURLgthttp//adil.ncsa.uiuc.edu/lt/re
  ferenceURLgt
• lttypegtArchivelt/typegt
• ltcontentLevelgtUniversitylt/contentLevelgt
• ltcontentLevelgtResearchlt/contentLevelgt
• ltcontentLevelgtCommunity Collegelt/contentLeve
  lgt
• ltrelationshipgt
• ltrelationshipTypegtservice-forlt/relationsh
  ipTypegt
• ltrelatedResource ivo-id"ivo//adil.ncsa/
  adil"gt
• NCSA Astronomy Digital Image Library
• lt/relatedResourcegt

16
Metadata III

• ltvrinterface xsitype"vsParamHTTP"
  qtype"GET"
• xmlns"http//www.ivoa.net/xml/VODa
  taService/v0.5"gt
• ltvraccessURL use"base"gthttp//adil.ncsa.u
  iuc.edu/cgi-bin/voimquery?surveyfamplt/vraccess
  URLgt
• ltresultTypegttext/xmlvotablelt/resultTypegt
• ltparamgt
• ltnamegtPOSlt/namegt
• ltdescriptiongt
• Search Position in the form "ra,dec"
  where ra and dec are given
• in decimal degrees in the ICRS
  coordinate system.
• lt/descriptiongt
• ltdataType arraysize"2"gtfloatlt/dataTypegt
• ltunitgtdegreeslt/unitgt
• lt/paramgt
• lt/vrinterfacegt
• ltvscoverage xmlns"http//www.ivoa.net/xml/VOData
  Service/v0.5"gt
• ltspatialgt
• ltregion xsitype"AllSky"/gt
• lt/spatialgt

17
Metadata IV

• ltvstable xmlns"http//www.ivoa.net/xml/VODataSer
  vice/v0.5"gt
• ltcolumngt
• ltnamegtCodenamelt/namegt
• ltdescriptiongt
• ADIL Image Identifier - Unique
  identifier for image, as assigned
• by the ADILlt/descriptiongt
• ltdataType arraysize""gtcharlt/dataTypegt
• lt/columngt
• lt/vstablegt
• ltsiacapability xmlns"http//www.ivoa.net/xml
  /SIA/v0.7"gt
• ltimageServiceTypegtPointedlt/imageServiceType
  gt
• ltmaxQueryRegionSizegt
• ltlonggt360.0lt/longgt
• ltlatgt180.0lt/latgt
• lt/maxQueryRegionSizegt
• ltmaxImageExtentgt
• ltlonggt360.0lt/longgt
• ltlatgt180.0lt/latgt

18
Metadata Models
19
Current Types of Resources

• Resource
• Service
• Registry
• CEAService
• DataCollection
• CeaApplication
• Authority
• SkyService
• TabularSkyService
• ConeSearch
• Simple Image Access (SIA)
• SkyNode

20
Future Plans

• Registry of Registries
• Validation Level and Curation
• Standard Interface

21
Registry of Registries (Model)
Harvest (pull)
Registry of Registries At IVOA
Harvest (pull)?
Full Searchable Registry
Replicate?
Harvest (pull)
Full Searchable Registry
Local Searchable Registry
22
Validation Level and Curation

• Registries will begin setting validation levels
  on metadata.
• Curation to improve.

23
Interface Spec

• Addition of paging style to the search interface.
• Additional XQuery search.
• Using ADQL 0.9
• Additional search for only returning identifiers.
• Additional getResource(identifier).
• Describe how to use the registry of registries.
• Determine if the registry is selective or full
  and the OAI interface urls to the registry.

24
RoadMap on Specifications

• Working Draft
• Registry Interface 1.0 Oct 31 Kevin Benson
• VOResource Schema 1.0 Oct 31 Ray Plante
• Published
• Resource Metadata v1.10 - http//www.ivoa.net/Docu
  ments/latest/RM.html

25
In the Tutorial

• Searching the Registry.
• Edit Registry entries with XML and XForms.
• Installing and Configuring the registry.
• Harvesting other registries such as JVO, NVO, and
  others.
• How to extend/customize the registry.