The EClerk

1
The E-Clerk

• Seth Teller
• Joint work with Darrell et al., Glass et al.,
  Karger et al.
• Students Jonathan Wolfe,Jeremy Schwartz

2
E-Clerk Scenarios
Friday
Monday
This is from lunch with Rod. Reimburse from
Oxygen.
Whats the name of that place Rod took me for
lunch?
Who was the vendor for those camera parts?
This is the parts receipt for the camera
project.
E-Clerk
(Purchase Order retrieved)
E-Clerk
(Lunch Receipt retrieved)
3
E-Clerk

• Paper flow into your office is not going away
• So build assistant that collects metadata
  for,and indexes, every document that comes to
  you
• Input document scans speech (metadata)
• (Queries incorporate touchscreen for choice)
• System combines three key capabilities
• Document imaging and processing (OCR)
• Speech recognition (Galaxy)
• Information retrieval (Haystack)

4
System Components
Input Streams
Computational modules
Video
Galaxy
OCR
Scanner
Hub
Video
Microphone array
GUI
Haystack
Touch- screen
5
E-Clerk

• Primary design principles
• Fluidity of user interface (continuous input)
• Multi-sensor input (speech video)
• Interaction as with a helpful human assistant
• Proof-of-concept applications
• Parsing and routing reimbursement requests
• Managing contact info (cards) and metadata
• Fundamental advantage
• Merges paper with soft-copy information

6
(No Transcript)