Bilingual Sign Language Dictionary

1
Bilingual Sign Language Dictionary
10th International Conference on Computers
Helping People with Special Needs

• J.L. Fuertes, A.L. González, G. Mariscal, C.
  Ruiz
  
• Facultad de Informática, Technical University of
  Madrid
  
• agonzalez_at_fi.upm.es

2
Contents

• Introduction
• Spanish Sign Language
• Compilation of signs
• Description of the signs
• DILSE
• Framework
• Search algorithm
• The application

3
Introduction

• Language is important for communication
• Ones mother tongue is the most natural way of
  communicating
  
• What is deaf peoples mother tongue?
• Sign language needs to be recognized as an
  official language
  
• The first stage is to formalize a language

4
Spanish Sign Language

• Word Selection
• Key Concepts
• Neologism
• Geographical varieties
• New concepts emerge
• New signs are needed
• There no body regulating LSE
• Signs are confined to region in which they
  appear
  
• There are different sign for the same concept

5
Spanish Sign Language

• A description of the sign is needed for bilingual
  dictionary
  

Initial active hand
1 hand
2 hands
shape
? shape
with contact
without contact
movement
? movement
Initial passive hand
without contact
with contact
without contact
with contact
without contact
with contact
6
DILSE

• DIccionario de Lengua de Signos Española
• Traditional dictionaries have weaknesses
• Multimedia resources are needed
• First truly bilingual Spanish Sign
  Language-Spanish Dictionary

7
DILSE

• More than just a bilingual dictionary
• Define a framework for multimedia dictionary
• Framework based on concept-context-representation
  
• COREUS (COnstructor of RElations with the USer )

8
DILSE

• COREUS
• Generate interaction process in run time
• Interpreted script-based language
• Easy-to-learn language
• Simplifies interface construction
• Simplifies interface alteration
• Large numbers of components
• Flexible and expandable

9
DILSE

• COREUS was applied in the Tutor, Virtual
  Alhambra, DILSE projects

10
DILSE

• Search algorithm is needed
• Based on sign description

Two- Handed?
No
Select. Family
Select Active Hand
Select Contact
Select Two-Handed
Search
Yes
Search
Initial A. Hand Shape Initial P. Hand Shape
Yes
Select Movement
No
Search
Passive Hand
11
Select Family
12
DILSE

• Search algorithm is needed
• Based on sign description

Two- Handed?
No
Select. Family
Select Active Hand
Select Contact
Select Two-Handed
Search
Yes
Search
Initial A. Hand Shape Initial P. Hand Shape
Yes
Select Movement
No
Search
Passive Hand
13
Configuration Parameters
Select Hand Shape
Sign Description
Select Parameters
14
DILSE

• Search algorithm is needed
• Based on sign description

Two- Handed?
No
Select. Family
Select Active Hand
Select Contact
Select Two-Handed
Search
Yes
Search
Initial A. Hand Shape Initial P. Hand Shape
Yes
Select Movement
No
Search
Passive Hand
15
Sign Selection
Sign Selection
Meaning/Variety List
16
Sign Information
Exit
Restart
Meaning
Video/Image definition
Definition
Example
Extra Information
Lexical correspondences
Back
Educational Games
17
Educational Games
Story Teller
Standard Test
18
Bilingual Sign Language Dictionary
10th International Conference on Computers
Helping People with Special Needs

• J.L. Fuertes, A.L. González, G. Mariscal, C.
  Ruiz
  
• Facultad de Informática, Technical University of
  Madrid
  
• agonzalez_at_fi.upm.es