Diapositive 1

1
(No Transcript)
2
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

3
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

4
SIMILAR Context(1)

• 32 partners
• mostly universities
• research centers
• one commercial company

5
SIMILAR Context (2)

• Create a single research group of excellent on
• Human-Computer Interaction (HCI)
• Signal Processing
• Integrate a task force on multimodal interfaces
• speech,gestures,vision,haptics,direct brain
  connections
• Develop a network of usability test facilities
  and establish an assessment methodology
• develop a common distributed software platform
• OpenInterface

6
SIMILAR Context (3)

• Organized in 7 SIGs
• multimodalities
• adaptation
• usability
• disabled applications
• edutainment applications
• medical applications
• fusion-fission

7
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

8
Speech Modality (1) FPMs - Multitel
Speech is the most natural media for human-human
communication. Can it be adapted to
human-machine communication?
9
Text-to-speech
Speech FPMs-Multitel (2)
10
Automatic Speech Recognition
Speech FPMs-Multitel (3)
11
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

12
HAPTIC Interfaces (1) ITI/CERTH

• Haptic application Navigation for the blind
• White cane emulation environment
• The virtual white cane aims to emulate haptic
  interaction of the real white cane in a virtual
  environment
• The cane was simulated to be an extension of
  the users index finger

13
HAPTIC Interfaces (2) Navigation for the blind
14
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

15
Fusion-Fission (1) ICARE, CLIPs-IMAG, University
of Grenoble

• Issue
• Multimodal interfaces difficult to design and
  develop
• Goal
• A tool
• That enables the designer to quickly and easily
  create multimodal interfaces
• That enables the designer to quickly explore
  several possibilities
• Approach
• Component-based approach
• Tool for the designer not yet available
• Components are assembled manually

16
Fusion-Fission ICARE (2)

• A software engineering point of view
• Modality (device, interaction language)
• M1 (microphone, natural language)
• M2 (keyboard, command language)
• M3 (mouse, direct manipulation)

17
Fusion-Fission ICARE (3)

• Combination of modalities CARE properties
• Relationships between Devices, Interaction
  languages and Tasks
• C Complementarity
• A Assignment
• R Redundancy
• E Equivalence

18
MEMO Multimodal Input Interacton
Fusion-Fission ICARE (4)
19
Summary

• SIMILAR Context
• SIMILAR Partners
• FPMs-Multitel, ITI/CERTH, CLIPs-IMAG, TELE
• OpenInterface
• Interconnection problems
• Main goals
• General specifications
• Architecture
• Conception
• Examples

20
Medical Application (1) Medical Studio, TELE UCL

• Medical Studio is a multi-platform framework for
  visualization and processing of medical image.
  It's based on popular open source libraries such
  as VTK for visualization, ITK for image
  processing, GTK for graphical user interface and
  DCMTK for Dicom compatibility.

21
Medical Application Medical Studio (2)

• Base Language C
• Patterns
• Template (inheritance, polymorphism, )
• Graphic Library Interface Gtk, Gtkmm
• Modular Architecture
• Kernel
• Components and plugins
• Advanced interactions
• Stereovision , augmented reality, tracking
  systems,

22
Components and plugins
Medical Application Medical Studio (3)

• Kernel automatically recognize plugins and make
  them available to the programmers/applications
• Each functionality is a component
• Easy integration of new functionalities
• Categorisation of components
• Minimal redundancy
• Several components are grouped into a plugin
• Plugin shared library
• Easy update through simple file copy
• High modularity of the final program

23
Medical Application Medical Studio (4)
Plugin 3 - read Dicom - read Ecat
Plugin 1 - 3D visualisation iso -
read VTK - registration
Plugin 2 - 3D raycast visualisation
- automatic segmentation
24
Multi-Platform
Medical Application Medical Studio (5)

• Use of a cross-compiler
• One development platform
• One source code
• Many execution platforms

25
Prototype in developmentMarkerless Approach for
Augmented Reality Systems
Pierre Delville Michel Cornet dElzius
26
Medical Application Medical Studio (7)
27
Medical Application Medical Studio (8)

• One integrated platform for
• Content design and verification
• 3D Reconstruction tools
• Segmentation tools
• Visualization tools
• Augmented Scenario
• Video aquisition
• Tracking and registration
• Augmented visualization