Image Information Mining for Earth Observation ESA ESRIN perspective

1
Image Information Miningfor Earth
Observation-ESA ESRIN perspective

• Sergio DElia
• Head of Research and Technology Development
  Section
• EO Ground Segment Department EOP Directorate

2
Table of Contents

• ESA activities in IIM
• Wider perspective
• Conclusions

3
EO Data Exploitation Chain
4
IIM Research Pattern
5
ESA Projects in IIM
K
6
ESA Investments Summary

• ESA has invested / booked so far 5.3 M, from
• GSP 250 K
• TRP 4360 K
• EOP 710 K
• Additional 525 K are available from GSTP
• Limited EOP funds might be available (within
  Oxygen) for installation of results
• Which results ? When ?

7
Results Expected from IIM
8
Results expected this year

• Probabilistic IM being validated on small
  archives for
• Interactive Information Discovery (search via
  training)
• Content Based Image Selection
• CB Image Selection
• Implemented for MERIS, to select images
  satisfying
• Normal parameters (mission, sensor, )
• Spatio temporal constrains
• With cloudiness lt threshold over user AOI
• In principle can be extended to other features in
  MERIS images (e.g. algae blooms, fires, etc.)
  just via additional system training (no need to
  re-ingest images)

9
MERIS CB Image Selection
10
MERIS CB Image Selection (cont.)
11
MERIS CB Image Selection (cont.)
Due to the very large number of cloud objects,
special methods are being implemented for clouds
to improve performance
12
Table of Contents

• ESA activities in IIM
• Wider perspective
• Conclusions

13
EO Data Exploitation Chain
14
Oxygen Objectives

• Oxygen is a concept (might become a programme)
  aimed at
• Facilitating access to EO data ? from ESA
  and other missions
• Increasing sustainability of EO data provision
  ? widening the range of offered data sources
• Oxygen has
• Consolidated the historical EOP-G multi-mission
  approach
• Extended it also to Partners (non-ESA missions
  and GS)

15
Oxygen Implementation Plan (2003 2005)

• S-pillar Developing Services
• Development of Prototype Services (including
  Image Information Mining Services)
• Creation of a new Service Support Environment
  for easing provision of Services by Service
  Providers

16
Oxygen Ground Segment Model
Forthcoming components
Quality Control
User Services
Help Desk Web Portal
Mission Planning
Catalogue
Data Ordering
CO-ORDINATION CENTRE
SERVICES INFRASTRUCTURE
Network
Monitoring Control
Information Mining Services
Acquisition
Archive
Production
Dissemination
FACILITY
17
Services Infrastructure - Background

• Some TRP / GSTP projects are providing results,
  of wide interest also for Oxygen partners, which
  create a newService Environmentdimension
• Encompassing ESA non-ESA resources
• Providing a bridge towards non-EO domains
• Satisfying identifiedrequirements, like
• Service Support
• Simple Catalogue Service
• Image Information Mining Support

18
Towards Services Infrastructure

• Currently available Service Support System
  Prototype
• Derived from MASS project (GSTP, 2.4 M, B and I,
  3 years)
• For on-/off- line Services, at Service Providers
  sites
• For Service publication, activation, monitoring,
  chaining
• Becoming Service Support Environment by Oct.
  2004
• With over 20 Prototype Services
• Neutrally managed by ESA (requested by Service
  Providers)
• Potentially relevant as model for GMES, TESI,
  INSPIRE,
• Will evolve in 2007 to European Service
  Infrastructure
• Enhanced for OGC, automation, e-business,
  e-collaboration
• Responding to new requirements (e.g. GMES, )

19
Prototype Architecture

• Handles control information
• Implements service chaining

20
Protocols and Interfaces
Client Web Mapping (OpenGIS)
ICD (Interface Control Document)
HTTP
Portal Directory WSI Descriptions WSDL /
XSD Workflow BPEL (OASIS)
Service Provider Legacy System
Toolbox
SOAP / XML HTTP (80) TCP/IP
ODBC, OS, FTP, SMTP, Scripts

• Service Providers can publish Services from their
  legacy system as Web Services (W3C) using
• WSDL over SOAP (implementing the ICD)
• The ESA TOOLBOX (provided / maintained
  free-of-charge), which also converts local
  terminology to common ICD terms

21
Workflow Example
22
Service Chaining Example
User need NPP (service) over Belgium (AOI) in
GeoTIFF (format)
MASS Portal Workflow Net Primary Productivity
S1
S3
S2
Format Conversion (GIM)
NPP Processor(VITO)
Clipping Service (GIM)
NPP EuropeGeoTIFF
NPP EuropeHDF
NPP BelgiumGeoTIFF
Spot Végétation S10
() NPP or Net Primary Productivity represents
repeatable estimates of the net flux of carbon.
23
Other System Functions
Result ftp//sp1.com/layer1 click to
view
Oil spill (SP1)
Oil rigs (WMS1)
Layer3 (WMS1)
User
Layer4 (WMS2)
Layer5 (WMS3)
WMS1
AOI Client browser
WMS Viewer
Portal
WMS2
Internet
ESRIN OpenGIS WMS
AOI Server
WMS3
Service Provider 2
Service Provider 1
24
Service Support Environment
Contract
Comments
Partners

• Upgrades
• Services consolidation
• Portals and rules

MASS-Env KO Nov 03 End 1Q 05
Spacebel, GIM (B), Intecs (I)
MASS-Ser-D KO Nov 03 End 1Q 05
Telespazio, Planetek (I), VISTA (D), ARGOSS (NL),
GIM, Vito (B)

• 6 new services

MASS-Ser-O KO 1Q 04 End 1Q 05
QinetiQ, CCLRC, RSI, Comsine, NEODC, NPA (all
UK)

• 11 new services
• UK Regional portal ?

MASS-Ser-O2 KO 1Q 04 End 1Q 05
Gael, GSC (F), Planetek (I), Phenix (UK),
Joanneum (A), RapidEye (D)

• 8 new services

MIMS KO 2Q 04 End 4Q 07

• Installation, loading and maintenance for 3 years
  of MERIS IM Service

(TBD)
SSEM KO 4Q 04 End 4Q 07

• SSE Manag. for 3 years

(TBD)
ISAC, GEO (GSTP-4) KO 1Q 04 End 4Q 05

• Dedicated Client
• GRID Support

Spacebel (B) TBD for GEO
25
Simple Catalogue Service

• Since
• The system was already permitting access to
  limited Service Providers catalogues (via AOI,
  time range, )
• Existing large image catalogues, if chainable,
  could be of interest for some services
• IIMCG requested parallel access to Envisat /Spot
  catalogues
• An attempt was made to
• Access large EO catalogues as simple, chainable
  services, via a few parameters but with adequate
  performance
• Demonstrate the function for Envisat and Spot

26
Simple Catalogue Service

• Parallel activation
• Results recombination

27
USER AREA
SPOT
ENVISAT
28
Table of Contents

• ESA activities in IIM
• Wider perspective
• Conclusions

29
Coming soon

• Service Support Environment (SSE) by end 2004
  with a core of Services
• Based on standards / widely used protocols and
  only 2 commands (RFQ and Order)
• New Service Providers can join on request, with
  the following benefits
• NO NEED TO MOVE services (full CONTROL and
  EXPLOITATION of existing infrastructure)
• Can achieve SYNERGIES with other partners and
  reduce COSTS and TIME TO MARKET
• Simple Catalogue Service (tested between Envisat
  and Spot)
• Obtained by enveloping existing catalogues as
  simple Services with translation of terms
• Based on two additional commands (Search,
  Present) for better performance
• Catalogue access can be chained with other
  Services under Workflow control
• Interactive Information Discovery Tool
• Learns and applies training results to identify
  features / objects in ingested images
• Remotely accessible for mining specific image
  sets ingested for the purpose (TBD)
• Content Based Image Selection
• Being tested for MERIS (search images with cloud
  cover lt threshold within user area of interest)
• Chainable with other SSE Services
• Relevant for image catalogues (Archives,
  Distributors, Service Providers, )

30
Useful Links

• SSE Introduction Workshop being organised
• Location / date ESRIN / April 22, 2004
• Web site (in preparation) http//earth.esa.int/rt
  d/Events/SSE_2004
• Details on ESA IIM and RTD projects at
• http//earth.esa.int/rtd
• Details on IIMCG at site (in preparation)
• http//earth.esa.int/rtd/IIMCG

31
Services Infrastructure - from
32
Services Infrastructure - To
Including IIM Services