Facetop for Note Taking Assisting Deaf to Follow Presentations

1
Facetop for Note TakingAssisting Deaf to Follow
Presentations

• Dorian Miller
• Computer Science, PhD candidate
• dorianm_at_cs.unc.edu [phone]
• http//www.cs.unc.edu/dorianm/facetop/overview

2
Deaf Person Attending Presentation

• Audience member divides attention between
  simultaneous information.
• Attend to one information, miss other information

Watch Presentation
and watch Speaker
and watch Interpreter
While taking notes
3
Facetop for Note Taking

• Deaf person uses computer to take notes
• While taking notes watch interpreter
• Looking at screen, it is easier to switch focus

Computer screen shows notes and interpreter
Web cam Connected to computer
Computer to take notes
Interpreter

• Notes Outline
• Main point
• Sub point
• Sub point

4
Regular Video Window

• To see notes, have to
• Keep video window small
• Move window
• Facetop feature
• Mouse cursor pushes video window aside

5
See-Through Video Window

• Advantage
• Larger video window
• Notes are not covered
• Disadvantage
• Details of signer washed out

6
Third Eye Idea

• Using see-through video
• Deaf person can watch for action in the room
  while taking notes

7
Camera Feature

• Logitech Camera tracks persons head
• if we are lucky

8
See-Through Video onWindows vs MAC

• Windows
• Limited

• MAC
• Ideal

Contact me for demo and implementation details
9
History of Facetop Research

• Main Facetop research on see-through video
  conferencing for hearing programmers
• UNC Deaf student suggested note taking
  application

Regular video conferencing
Facetop video conferencing
10
Continued Research

• Welcome your feedback
• You are invited to participate in our user study
  to evaluate Facetop see-through video conferencing

11
User Study Invitation

• Participants Needed for a User Study
  InvestigatingComputer Supported Cooperative Work
  (CSCW) Systems
• Payment 10 for one sessionTime required A
  session is approximately 2 hoursDates of
  Experiment March-JuneLocation Dept. of
  Computer Science, Sitterson Hall, University of
  North Carolina at Chapel Hill

12
Description of Study Eligibility

• We are investigating three computer interfaces to
  support collaboration. During the user study
  session two participants will work together to
  complete one of four possible tasks
• play checkers against a computer
• draw a diagram
• solve a jigsaw puzzle
• play Sudoku, a Japanese number game
  Participants will also be asked to complete a
  questionnaire about their experience working with
  the other person and using the computer
  interfaces. For participants with hearing
  impairments, instructions will be provided as an
  ASL video. EligibilityWe encourage persons
  with and without hearing impairments to
  participate. Also
• Participants must be at least 18 years old.
• Participants must be proficient in
•     Spoken and written English.  OR
•     Written English and American Sign Language
• Participants should have normal or corrected to
  normal vision
• Want More Info? Send Email To    Dorian Miller,
  facetop_at_unc.edu

13
Outline

• Situation for a deaf student in class
• Assistive technology research
• Demonstration
• Future research

14
Conclusion

• We are researching Facetop for note taking to
  assist deaf audience members follow presentations