TOUCHSPEAK

1
TOUCHSPEAK
2
TouchSpeakTM Communication Aid
TypeSpeakTM

• The PCAD Project of 1996-2000 introduced speech
  therapists to the first touch-screen Augmentative
  and Alternative Communication Aid
• Feature rich MicroSoft Windows platform
• Its central, fully customisable vocabulary design
  enhances its users communication, literacy and
  general life skills and assists in maximising and
  realising their existing competences
• Systems can be configured to behave as a totally
  dedicated aid or to introduce the Microsoft
  applications as and when they are required

3
TouchSpeak Designer Philosophy

• The main client group are adults with acquired
  conditions, which were initially those with
  aphasia
• Its core design philosophy and comprehensive
  toolkit makes it easily and successfully
  adaptable for other client groups
• Such as MND, Parkinsons, CP, Dysarthria,
  Dyspraxia, etc.,
• TouchSpeak is available in two discrete but
  combinable, forms
• For lower functioning users requiring all the
  symbolic, text etc., support features and
• TypeSpeak for higher-functioning, more literate
  users with limited or impaired speech output etc.
• Plus integrated SMS and Telephony mobile access

4

• Topic Vocabulary
• A coherently organised set of interactive pages
  which contain all the symbols and/or text that
  allows the user to generate speech directly and
  QUICKLY
• Symbolic Pictorial Aid
• An aid where the communication method is via
  symbols such as, PCS (Boardmaker), PICTO, photos
  and on-board sketches etc.,
• Dynamic
• An aid where the communication screen changes
  when selections are made.
• Text-based Aid
• Communication is via TTS Text to Speech input
  (e.g. word prediction, completion etc.,)
• Mobile-enabled
• Communication is via the devices mobile/cellular
  network using TypeSpeaks TTS Text to Speech
  module

5
General core design and implementation concepts

• Designs created within TouchSpeak Designer, with
  minimal Computer skills
• Designs are held in the central database
• This central resource is therefore available to
  all
• Therapists can share vocabularies and all their
  respective elements
• Vocabulary transferred to the PDA via MicroSoft
  ActiveSync or Memory Card
• The therapist builds the vocabulary
  collaboratively with their client
• The vocabulary is tested in real-time using the
  on-screen PDA Simulator
• The client has a real, positive and motivational
  role in the process
• Therapists and the Departments are the primary
  beneficiaries
• Different versions of the clients vocabulary can
  be deployed for their practical evaluation
• Normative vocabularies
• Import and Export vocabularies
• Export to a Word file, in Text or as Pictures for
  the clients case notes
• Vocabularies are securely stored for easy
  recovery

6
Configuring a Topic Vocabulary with the Simulator
7
Building the multi-level Vocabulary hierarchy
with the central dynamic design module
Virtually every facet is user designable

• CONTENT
• The Levels
• Appearance
• Font sizing
• Behaviour
• Toolbars
• Colours
• Etc.

Even more of my features
8
... the Key Features

• Scalable (symetric or asymetric) Topic buttons
  to further emphasise a particular key
• Multiple, unlimited multi-level topics
• Topics introduced as required
• Comprehensive dynamic, symbolic, text vocabulary
• Images categorised for easy searching and
  browsing
• e.g symbolic, semantic, functional, photos
  etc., actually anything which is machine readable
• Hotspots to identify and speak a special spot
• Simple consistent navigation (scrolling) toolbar
• Repositioning to accommodate visual problems such
  as Hemianopia
• Synthesised and Digitised voice output
• Phonemic Cueing
• Fishing and Voice over
• Essential Vocabulary building direct on to the
  PDA
• Scanning and switch access

Examples
9
Examples of various screen content configurations


10
Drawing Gallery

• An alternative method of expression
• Personal
• Motivational - great fun
• Drawing Gallery
• Annotate drawings
• Embody into the News Page or Vocabulary
• Print results

11
NEWS

• Multi-level on-the fly News
• Add a Photo
• Add a personalised drawing
• Record a spoken message
• Create a Talking Album

12
Scanning (example shown by Row)

• Switch or Bluetooth access
• Extensive control
• Automatic
• Row/column etc.,
• Timings
• Appearance
• Shape, colour etc.,
• Fully supported in the Simulator

13
Quick Objective Summary

• AAC devices generally require a prepared set of
  generalised predictive messages, questions and
  possible appropriate responses for basic needs
  and preferences, to a listening partner.
• Suitable for someone with only moderate
  comprehension skills
• Who has reasonable dexterity
• Scanning and switch assisted
• Limited or impaired voice output
• Where speed of response is not necessarily a
  primary objective

14
TypeSpeak

• Communication is not Conversation
• TypeSpeak delivers
• Real-time, interactive spontaneous conversation
• Empowers social networking
• Supporting existing competencies
• In acceptable more natural and less-robotic
  sounding female and male voices

15
Text to Speech

• Text input to Voice output
• Scalable user-definable screen area
• On-screen scalable soft keyboard
• Sophisticated, comprehensive keyboard designer
• Standard QWERTY, ABC, 123, EARDU, keyboards
• External Bluetooth keyboard
• Transcriber cursive hand written text to speak
• Etc.

16

• Portrait or Landscape mode
• Word prediction and in reverse order
• Dynamic re-sizing
• Spelling suggestions - word completion
• 2 dictionaries supplementary or personal
• Colour highlight next probable / possible letter
• Speak on just the letter, word or complete phrase
• Message Gallery for repeat use
• Phrase/Abbreviation
• Topic/Vocabulary style structure
• Full expansion
• Auditory feedback
• Recency
• Frequency
• etc

17
Who could use and benefit from this type of AAC ?

• Someone with higher functioning skills
• Whose language and comprehension skills are
  reasonably intact
• Who has reasonable dexterity or can use the
  external keyboard (scanning switch assisted)
• But limited, impaired, unintelligible, or no
  voice output.

18
Thanks to Homer Simpson
19
TouchSpeak TypeSpeak Establishing new AAC
platforms
Windows Mobile Pocket PC Ultra high specification
Large touch screen 5 VGA display 8GB hard disk
3 mega pixel camera Separate Keyboard Wallet ETC.

20
TouchSpeak TypeSpeak e.g. HTC 7500 Series
in TouchSpeak mode
in TypeSpeak mode
21
TouchSpeak TypeSpeak
UMPC Windows XP Tablet Self-contained, fully
configurable dedicated device Large 7 touch
screen 20Gb Hard Disk Separate USB
Keyboard Connectivity 1 watt speaker Media
centre ETC.
22

TouchSpeak Mobile

• SMS
• One-to-One Telephony
• conversation
• Requires TypeSpeak
• Requires MicroSoft Phone Edition Mobile 5.0
• PAYG or contract
• Subject to prevailing Network Tariff

23
TouchSpeak Mobile Speak One-to-One in real-time

• User speaks via their keyboard directly to
  their listener
• Mix existing and prepared stored messages
• Compose questions and responses
• Benefits the user and their listening partner
• SMS texting provides a familiar, secure and
  unambiguous method to communicate
• Ideal in resolving risk situations
• Etc.,

24
Who could benefit from this type of fully
Telephony-enabled AAC ?

• Someone with higher functioning skills
• Whose language and comprehension skills are
  reasonably intact
• Who has reasonable dexterity
• Who wants to be in the mainstream
• But limited, impaired, unintelligible, or no
  voice output

25
In summaryWhy TouchSpeak TypeSpeak ?

• Solution delivered in a contemporary ergonomic
  and stylish designs
• Solution thoroughly tested - with 10 years of
  professional therapist and clinical partnership
  involvement
• Organic benefit of UK and European clinical
  partnerships
• Continuing development