Spoken Language Interaction in Telecommunication at ENST/CNRS-LTCI

1
Spoken Language Interaction in Telecommunication
at ENST/CNRS-LTCI
G. CHOLLET, R. CROCE, J.Ph. DEMOULIN, D.
PETROVSKA-DELACRETAZ, M. SIGELLE, P. VAILLANT, F.
YVON (chollet,croce,petrovsk,sigelle,vaillant)_at_ts
i.enst.fr(demoulin,yvon)_at_infres.enst.fr ENST/CNRS
-LTCI46 rue Barrault75634 PARIS cedex
13http//www.tsi.enst.fr/chollet
2
Outline

• What is ENST/CNRS-LTCI ?
• Research and application topics related to
  COST-278
• The SIROCCO project
• The EUREKA !2340 MAJORDOME project
• BIOMET, COST-275
• VoIP, VoiceXML, Human-Computer Interaction
• Perspectives

3
Our affiliations
ENST Ecole Nationale Supérieure des
Télécommunicationshttp//www.enst.fr CNRS
Centre National de la Recherche
Scientifiquehttp//www.cnrs.fr LTCI
Laboratoire de Traitement et Communication de
lInformation
4
What is ENST?Ecole Nationale de
Télécommunications

• classed among the
• Grandes Ecoles d'Ingénieurs.
• 250 state certified engineers
• each year .
• part of Groupement des Ecoles
• de Télécommunications

5
SIROCCO project Unlimited Vocabulary Speech
Recognition
INRIA (IRISA et LORIA), LIA, IRIT,
ENST-LTCI http//www.irisa.fr/sirocco/
6
SIROCCO

• Unlimited vocabulary speech recognition system
• French lexicon (MathLex) with 64kwords (AUF task)
• Feature extraction with Spro (G. Gravier)
• Context-dependent HMM phone models
• Word pronunciation graph
• Uses CMU-Toolkit for Language modeling
• Beam search for word hypothesis
• Rescoring of word hypothesis by A

7
EDF
Holistique
MAJORDOME Unified Messaging System Eureka
Projet no 2340
D. Bahu-Leyser, G. Chollet, R. Croce, K. Hallouli
, J. Kharroubi, D. Kofman, L. Likforman, E.
Matta-Sanchez, D. Petrovska, M. Sigelle, P.
Vaillant, F. Yvon
8
Majordomes Functionalities
9
Overview of Majordome

• Background tasks (server-side only)
• sorting and filtering messages from different
  sources (E-mail, voice, fax, SMS,)
• extracting relevant information for reporting to
  user (names of senders, subject,).
• Dialogue with the user over phone or Web.
• The system presents the state of the mailbox, the
  type of messages, their sender, subject, and may
  sum them up or read them on request
• The users access their mailbox, addressbook, time
  schedule, or URIs (Web addresses).

10
Voice technology in Majordome

• Server side background tasks
• continuous speech recognition applied to voice
  messages upon reception
• Detection of senders name and subject
• User interaction
• Speaker identification and verification
• Speech recognition (receiving user commands
  through voice interaction)
• Text-to-speech synthesis (reading text summaries,
  E-mails or faxes)

11
Majordome partners
12
Majordome / NetCentrex project
PABX /Gateway ENST -Call Control
Server -Application Server
Calling person
Usual
NetCentrex
Voice Interactive call
No response
MAJORDOME
IP-VR NetCentrex

• Speaker verification
• Dialogue
• Vocal e-mail
• Routing
• Updating the agenda
• Automatic summary

Usual user called
13
Perspectives

• The application context of the Majordome project
  could be of interest to COST-278.
• The Majordome/NetCentrex platform could be made
  available to interested partners.
• HTK, ISIP and SIROCCO softwares are available as
  freeware. One of them will be used on the
  NetCentrex platform.
• Looking for summarisation software and concept to
  speech synthesis.