Institute of Information Science and Technologies ISTI

1
Institute of Information Science and Technologies
- ISTI Italian National Research Council -
CNR http//www.isti.cnr.it/ Ovidio Salvetti,
Massimo Martinelli Patrizia Asirelli Signals
and Images Research Laboratory
2
Ovidio Salvetti
He is Senior Scientist at ISTI-CNR working in
the field of theoretical and applied computer
vision. His fields of research are image
analysis, pictorial information systems, spatial
modelling and intelligent processes for image
understanding. He is scientific coordinator of
the activity on "Representation and Communication
of Data and Metadata" in the EU Network of
Excellence MUSCLE, Multimedia Understanding
through Semantics, Computation and Learning. He
is co-author of three books and monographs and
more than three hundreds technical and scientific
articles he is also owner of ten patents
regarding systems and software tools for image
analysis. Dr. Salvetti has been scientific
co-ordinator of several National and European
research and industrial projects, in
collaboration with Italian and foreign researc4h
groups, in the fields of computer vision and
high-performance computing for diagnostic
imaging. He was vice-coordinator of the
Subproject Dedicated Processors of the CNR
Finalised Programme Information Systems and
Parallel Computation and one of the promoters of
the CNR Strategic Project Knowledge through
Images. He is member of the Editorial Boards of
the International Journals G. Ronchi Foundation
Acts and Pattern Recognition and Image
Analysis. He is at present the CNR Contact
Person in ERCIM (the European Research Consortium
for Informatics and Mathematics) for the Working
Group on Vision and Image Understanding and
Member of IEEE and Head of the Signals and Images
Lab at ISTI.
Ovidio.Salvetti_at_isti.cnr.it
http//www.isti.cnr.it/php-pers/iselpers.php?Salve
ttiOvidio
3
Massimo Martinelli
He is is a staff member at ISTI-CNR Since 2002
he is involved with the activity of the "Signals
Images" Research Laboratory at ISTI-CNR
working in the fields of Web technologies, of
the XML language family and of the the Semantic
Web. Since 1999 coordinates the ISTI (IEI) Web
Systems Group Since 1997 member of the XML-ITALIA
Organizer Group Since 1989 collaborates with CNR
(permanent staff since 1997)

• He has been involved in several international
  research projects
• Currently he is involved in projects related to
  multimedia ontologies information integration
• - M.U.S.C.L.E. (EU) Multimedia Understanding
  through Semantics, Computation and Learning
• - Heartfaid (EU) Medical-clinical processes and
  requirements in HF domain and
• formulation of the decision making problems

Program Committee at WWW10 (Hong Kong
2001) Scientific Committee at the XML Italy
2000 (Pisa)
Massimo.Martinelli_at_isti.cnr.it
http//www1.isti.cnr.it/Martinelli/
4
Patrizia Asirelli
She is senior researcher at the Institute o
Science and Technology (ISTI) of the Italian
National Research Council (CNR) and is involved
with the activity of two research groups the
Signal and Image Lab working in the MUSCLE NoE
, and the Formal Methods and Tools Lab.
In the past years she has been responsible of
many Research Projects Head of the Language and
Operating System Group at ISTI Secretary of GULP
(the Italian Association for Logic Programming)
Deputy Leader of the Database Research Group of
ERCIM, Scientific Officer for Mathematics and
Information Technology at INTAS (Bruxelles).
Research interests have concerned Logic
Programming and its applications. In particular
her background is on Integrity Constraints for
Deductive Databases Semantic Integration of
Deductive and/or Knowledge bases, with concerns
on Languages for Mediation Security issues,
focusing on Access Control Policies. At present
her research interests regards the application of
previous issues to the Semantic Web, this
includes multimedia metadata handling, logic /
knowledge representation, and all issues related
to ontology.
Patrizia.Asirelli_at_isti.cnr.it
http//www.isti.cnr.it/php-pers/iselpers.php?Asire
lliPatrizia
5
Signal Image Research Lab.

• Years of experience in the field of image
  representation and understanding (also expertise
  in Sound and Video)
• Collaboration with the Dorodnicyn Computing
  Centre of the Russian Academy of Sciences.
• MUSCLE NoE - Multimedia Understanding through
  Semantics,
• Computation and Learning.
• Leading WP9 Representation and Communication
  of Data and Meta-Data
• Participation to the MultiMedia Ontology Group
• Meeting, London
• Call for Common Multimedia Ontology Framework

6
Our Goals

• To grant interaction between different
  communities in the MUSCLE NoE(vision, speech,
  text, ML, etc.)
• To define a strategy for the NoE to develop,
  maintain and provide an integrated metadata
  service able to support multiple meta-data
  standards, multiple users and the management of
  distributed and heterogeneous data, metadata and
  methodologies
• To act as facilitator in the communication,
  exchange and interoperability by advising on
  common formats, creating exchange interfaces,
  establishing additional standards where needed
  and formats for meta-data
• To establish a liaison with Standardization
  Bodies (W3C,...)
• Automated retrieval of image analysis algorithms
• Automated construction and combination of
  algorithms

7
Multimedia Semanticsissues interesting/contribut
ing

• Multimedia Metadata
• Infrastructure
• Annotations
• Ontology

8
Multimedia Metadata

• Background
• Multimedia data coming from different fields
• Metadata production, storing, retrieve,
  elaboration
• Key tools
• MPEG-7 provides detailed and multimedia specific
  metadata descriptors.
• Semantic Web technologies (RDF, OWL, etc),
  promoted by the W3C, enable large scale
  interoperability of structured knowledge
  repositories.

9
4M InfrastructureMultiMedia Metadata Management
M
lt?xml version1.0 ?gt ltmpeg-7gt . . . lt/mpeg-7gt
MPEG-7feature processing
XML DB
X
O
Algorithms Ontology
I
Integration
A
Annotations
10
4M

• Approach to the integration of 4M based on
  Semantic Web - state-of-the-art considered
• Java-based Infrastructure for
• MPEG-7 features processing,
• XML database managing,
• algorithms ontology exploiting,
• multimedia semantic annotating,
• functions integrating.
• Different contexts P2P, semi-authoritative,
  cluster.

11
Annotations

• A tool to add annotations describing information
  inherent to particular application areas
• (health care information, personal
• photo DB, etc...)
• Current annotations based on
• MPEG-7
• Design of rules to improve searching and
  reasoning capability (SWRL)

A
Annotations
12
Multimedia Ontologies

• To represent characteristics at different
  levels
• Low level Multimedia Object characteristics
  (media-dependent features etc.)
• High level - semantic information/annotations,
  algorithms, processes, services, workflow, user
  preferences, etc.
• With different purposes Annotation, Retrieve,
  Reasoning, etc.
• Harmonization of existing ontology
  (modularization, combination/linking of ontology,
  integration)
• ?
• Core ontology-gtUpper Ontology
• gtNeed for a Common Multimedia Ontology Framework
  
• Contribute to the Call for Common Multimedia
  Ontology Framework for the definition of a
  meta-ontology for multimedia objects.

13
Multimedia Ontologies

• Two-Level Ontology Description
• Multimedia Object - MPEG-7
• Multimedia Understanding (high level)
• Algorithm Ontology
• towards the definition of a Concept-System

14
Algorithms Ontology

• Image analysis thesaurus of more than 1000 terms
  describing
• image characteristics
• algorithms used to obtain images
• relations among terms

O
Algorithms Ontology
Developed at the Dorodnicyn Computing Center of
the Russian Academy of Science. Under
transformation into OWL.
15
Formal Method Tool Laboratory at ISTI

• Active in the fields of development and
  application of formal notations, methods and
  software support tools for the specification,
  design and verification of complex computer
  systems.
• These systems often must meet real-time, security
  constraints and are used in safety-critical
  missions where also human factors play a major
  role.
• In particular, we are currently involved in
  research activities in the areas of
• Model-checking algorithms,tools and applications
• Quantitative extensions of Process Algebras e
  related tools
• Formal Approaches to the modeling of
  Human-Computer Interaction
• Precise UML
• Formal Approaches to Requirements Engineering
• Integration of process-algebraic, state-based
  and functional specification models

16
Formal Method Tool Laboratory at ISTI
Interest in this Incubator Group wrt

• Semantics issues
• Ontology issues
• No multimedia (for the moment).

17
Formal Method Tool Laboratory at ISTI
SENSORIA IP Software Engineering for
Service-Oriented Overlay Computers
(IST-3-016004-IP-09  2005-2008) Sensoria
Service OntologyThe aim of the ontology is to
provide a terminological background to enhance
the integration among the work packages to
define a basic set of concepts to include in
languages for the design of service-oriented
systems (high-level and user-oriented perspective)
18
Thank You for your attention