Decoding Mobile Technologies:

1
Decoding Mobile Technologies

• Review of accessibility features of Android, iOS,
  and other mobile operating systems

2
Todays Agenda

• Introduction
• What youll learn
• Review of accessibility features available in
  todays most popular mobile operating systems
• Summary
• QA

3
Introduction

• Korey Singleton, Assistive Technology Initiative
  Manager
• Mission of ATI provide individuals with
  disabilities an accessible university environment
  by supporting access to all technological,
  architectural, and educational resources
  available at George Mason University through the
  incorporation of assistive technologies...
• More information about us at http//ati.gmu.edu

4
Learning Objectives

• Learn about the built-in tools/features that
  enable access to mobile technologies for
  individuals with disabilities.
• Discuss the differences and similarities, in
  terms of accessibility, between the different
  mobile operating systems.
• Understand and identify which mobile operating
  systems provide the greatest level of access to
  users of a specific disability type (e.g., vision
  loss).

5
Content Questions

• In what version of the Android operating system
  did accessibility start to be incorporated?
• Oratio for Blackberry is available for most
  Blackberry smartphone?
• Which smartphone manufacturer markets the Symbian
  OS?
• Which mobile OS are supported by Google and
  Apple, respectively?
• iOS supports wireless (Bluetooth) refreshable
  braille displays?

6
Lets Get Started

• Understanding the market for mobile technologies

7
Market Penetration (Business)

• Smartphones now represent more than half of all
  handheld wireless devices used by corporate
  wireless usersup 22 from 20106

8
Types of Devices Business users6

• RIMs blackberry remains the leading smartphone
  OS. iPhone is the fastest growing.
• Blackberry has about 69 market penetration,
  increasing to 81 among businesses with 1000 or
  more employees.
• Inverse is true among smaller companies, there is
  increased usage of iOS and other mobile operating
  systems.

9
Market Penetration (Personal Use)

• TNS Global reports1
• Evolution of mobile technology has fueled rapid
  consumer adoption
• Smartphone penetration among individual wireless
  households up from 1 in 4 US households in late
  2009 to 1 in 3 US households just a year later
• Most notable uses in USpersonal email and text
  messaging3

10
Types of Devices Personal users6

• RIMs blackberry remains the leading smartphone
  OS among personal users as well with about 36
  market share. iOS and Android are close behind
  with about 25 and 24 , respectively.
• Android is the fastest growing mobile OS in the
  US among individuals 13 years and older.

11
Future Trends

• Workplace considerations - According to the IDC,
  smartphones outsold PCs for the first time in Q4
  2010. 4
• Higher Education considerations
• Barnes Noble campus bookstores recorded a 3000
  increase in eTextbook sales in 2010industry
  projections forecast 60 of textbook titles
  available digitally by 2014. 2
• Students report lower costs and lighter carrying
  load as primary reasons for adoption of digital
  textbooks. 5
• General Use - Worldwide tablet sales have
  exploded in the past year. One of the reasons
  for that growth is believed to be the adoption of
  iPads as teaching tools in k-12.9

12
Mobile OS Review

• Android OS, iOS, and others

13
Android Accessibility
14
Important Facts about the Android OS

• Fastest growing mobile OS in the US1
• All Android versions starting with v1.6 or later
  have built-in support for speech output and
  accessibility
• There are 50 different types of phones worldwide
  that are running some version of the Android OS
• Major problem in terms of accessibility Android
  versions are not standardized across all
  manufacturers, platforms, etc. Depending on
  model of phone, one user could have v1.6, while
  another has v2.2 (latest release).

15
Android OS

• Why is this a problem?
• User experiences may differ Carriers and device
  manufacturers will sometimes create customized
  versions of the Android OS. For example, HTC
  ships phones that include a custom user interface
  called HTC Sense. Samsung, LG, and Motorola
  could also change the user interfaces if they
  choose.
• There is no guarantee that devices with
  customized Android operating systems include
  accessibility support.

16
Vision

• Enabling Basic Accessibility
• By default, accessibility is turned off. Users
  with little to no vision will likely require
  sighted assistance to turn on this feature. Once
  enabled, however, it will remember the setting.
• Can be enabled through Menu/Settings/Accessibility
  
• Voice Input/output allows for customization of
  speech settings

17
Vision cont.

• Important Note Certain Android phones may not
  have Talkback installed. When turning on
  Accessibility, OS will prompt user to go to
  Android Market, download and install the
  application.
• Check box to turn on Accessibility, then turn on
  the following
• Talkback enables speech output
• Kickback enables vibration (haptic feedback)
  along with speech
• Soundback enables additional sound
  notifications when activating a control

18
Another Option for Setting Up Accessibility

• Installer guides from IDEAL Apps4Android
• Installs several accessibility apps
• Eyes Free Suite (Talkback, Kickback, Soundback,
  Eyes Free Shell, Talking Dialer, Walky Talky,
  Intersection Explorer)
• In addition to the Eyes Free Suite, several 3rd
  party apps like K9 Mail, IDEAL Magnifier, IDEAL
  Item ID, and IDEAL Web Reader are installed.

19
Another Option for Setting Up Accessibility cont.

• Eyes Free Shell User interface designed to to
  make it easier for individuals with low vision
  and blindness to navigate the Android OS
• Talking Dialer accessible dialing interface
• Walky Talky (walking) and Intersection Explorer
  (auto) accessible GPS applications
• 3rd party apps
• K9 Mail accessible email application
• IDEAL Magnifier basic magnifier using phones
  camera
• IDEAL Item ID bar code scanner
• IDEAL Web Reader accessible web browser
• Important Note User experience depends on the
  phone model. Individuals with vision loss will
  likely require sighted assistance in setting up
  some of the apps.

20
Hearing

• Basic Features
• Notifications Panel Alerts the user to battery
  status, incoming emails, SMS messages, voicemail
  messages, etc.
• Audible, Visible, and vibrating alerts for all
  notifications
• Hearing Aid Compatibility Mode (HAC)
• Allows user to amplify in-call volume

21
Hearing cont.

• Notable Features
• Visual Voicemail
• Allows you to view all of your voicemails at
  once, read in order of preference
• Control playback
• Check with carrier for costs Sprint
  Voicemail-to-Text transcription costs 1.99/month

22
Hearing cont.

• Notable Features
• Video Chat and/or Video messages using Qik
• Users have the ability to chat in real-time using
  front (certain models) or rear-facing cameras
• Or, send video messages Can be created on phone
  and saved to user account at www.qik.com

23
Physical Motor

• Basic Features
• Tactile Buttons (Power, volume keys, call button,
  other keys depends on model)
• Hands-free speakerphone
• Downloadable, Assignable ringtones
• Auto-sync (contacts, calendar events, mail)
• 3rd party apps required to sync podcasts, music,
  movies, etc.)

24
Physical Motor

• Notable Features
• Speech-to-text capabilities Available as a
  separate app like Voice Search or Voice Dialer,
  also imbedded in default onscreen keyboard (i.e.,
  Evo 4G)

25
Physical Motor

• Notable Features
• Swype Keyboard (example shown is Evo 4G)
  Alternative keyboard input method where using
  literally drags finger across keyboard to choose
  characters

26
Physical Motor

• Notable Features
• Talkback, Kickback, Soundback While these
  features were designed with low vision/blind
  users in mind, they could be especially useful
  for individuals with physical/motor difficulties.
  
• For example, Talkback can read notifications,
  emails and messages (with 3rd party support),
  thus enabling a user to receive certain
  information without having to pick up the phone.

27
Physical Motor

• Notable Features
• Long Press You can use a long press to open
  menus that are specific to the active item -
  think of it like opening a context menu on a PC.
• Examples
• Performing a long press on a song in the Music
  player application in Android 2.2 will open a
  menu that allows you to add or remove it from a
  playlist.
• Long press of the Home key opens the most
  recently used applications
• Long press of the Search key opens the Voice
  Search app

28
Accessible Android Phones12

• T-Mobile G2 (v2.2)
• LG Ally (v2.1)
• Samsung Epic 4G (v2.1)
• Motorola Droid (v2.2)
• HTC Dream (v1.6)
• Not so accessible Android Phone HTC Evo 4G
• Demo Android OS Accessibility features
  previously discussed
• Demo HTC Evo 4G vs. Samsung Epic 4G (specific
  focus on navigation using speech)

29
Review Questions

1. In what version of the Android operating system
   did accessibility start to be incorporated?
2. Which mobile OS are supported by Google and
   Apple, respectively?

30
Any questions about the Android OS?
31
iOS Accessibility (i.e., iPod, iPhone, iPad)
32
Important Facts about the iOS

• Arguably, the most exciting mobile OS in the
  world!!
• Versions are same across all platforms (i.e.,
  iPod Touch, iPhone, iPad).
• What does this mean?
• More uniformity in terms of accessibility
• No learning curve - If you know how to use one
  device, it is easy to use another
• User experiences are the same!
• Apps that come with OS (i.e. mail, messaging,
  calendar, contacts, notes, calculator, internet,
  app store, maps) are accessible

33
Vision

• VoiceOver Same gesture-based screen reader that
  is available on Mac OS
• Available on the iPad, iPhone 3GS/4G, and iPod
  Touch
• Support for up to 21 different languages
• Very important feature Can be enabled without
  sighted assistance using a compatible screen
  reader and latest version of iTunes

34
Vision cont.

• VoiceOver reading features
• Voice rate adjustment
• Rotor adjustment Text navigation by
  character/word
• Speak auto-text
• Full support for all built-in applications (i.e.,
  Phone, Mail, iTunes, Safari, Maps)

35
Vision cont.

• Zoom/Contrast Settings
• Very important feature Can be enabled without
  sighted assistance using a compatible screen
  reader and latest version of iTunes
• Allows full-screen magnification
• Double tap with 3 fingers instantly zooms in and
  out 200. Double tap and drag 3 fingers to
  adjust magnification between 100 and 500
• Reverse video can be used with both Zoom and
  VoiceOver

36
Vision cont.

• Other notable features
• Tactile buttons
• Audible, visible, and vibrating alerts
• Support for Bluetooth compatible refreshable
  braille displays. Braille displays with input
  keys can be used to control iOS

37
Hearing

• Support for playback of captions (open, closed,
  subtitles)
• Instant messaging/chat
• Apps available in App Store (e.g., AIM, Yahoo.
  MSN, Google Talk)
• Multimedia Message Service (MMS) supports text
  messages with multimedia attachments
• TTY Support requires iPhone TTY adapter

38
Hearing cont.

• Audible, Visible, and vibrating alerts
• Visual Voicemail
• Allows you to view all of your voicemails at
  once, read in order of preference
• Control playback
• Mono Audio route both audio channels into each
  earbud so that you can hear both channels in each
  ear (very useful for individuals with hearing
  loss in one ear)

39
Hearing cont.

• Notable Features
• Video Chat using Facetime
• Users have the ability to chat in real-time using
  front-facing cameras on the Mac, iPhone, iPad, or
  iPod Touch
• Free for iPhone and iPod touch users, 0.99 in
  Mac App Store for Mac users

40
Physical Motor

• Stereo headset control music playback,
  answer/end calls
• On-screen keyboard with predictive text entry
  learns as you type, allow user to increase text
  input speed over time

41
Physical Motor cont.

• Voice Control
• Supports 21 different languages
• Allows user to play music and make phone calls

42
Physical Motor cont.

• Tactile Buttons
• Hands-free speakerphone
• Downloadable, Assignable ringtones
• Auto-sync (music, movies, podcasts, contacts,
  calendar events, etc.)

43
Physical Motor cont.

• Demo iPod Touch and iPad 16GB WiFi

44
Review Questions

1. Which mobile OS are supported by Google and
   Apple, respectively?
2. iOS supports wireless (Bluetooth) refreshable
   braille displays?

45
Any questions about iOS?
46
Other Mobile Operating Systems, Resources, Etc.
47
GARI Project

• Stands for Global Accessibility Reporting
  Initiative
• http//www.mobileaccessibility.info
• GARI Project is a way for manufacturers of mobile
  devices to provide consumers with disabilities
  and other limitations with a universal
  accessibility features database that can be used
  when learning about what a particular mobile
  device offers in terms of accessibility.

48
Nokia/Symbian OS

• Symbian is the mobile OS for all Nokia handsets.
  As Nokia is the leader in smartphone market share
  (36) worldwide8 and it is popular
  everywhereexcept in the US.

49
Nokia/Symbian OS cont.

• Nokia emphasizes accessibility!
• http//www.nokiaaccessibility.com
• Member of the Global Accessibility Reporting
  Initiative (GARI) Project http//www.mobileacces
  sibility.info

50
Nokia/Symbian OS cont.

• Vision
• 3rd party Text-to-speech available using Nuance
  Talks Zooms or Mobile Speak (89)
• Mobile Speak demo

51
Nokia/Symbian OS cont.

• Vision
• Nokia TTS Reader
• Reads text messages, multimedia messages, and
  emails
• Available on compatible Nokia Series 60 phones
• Nokia Magnifier (89)
• Uses existing camera functionality
• Available on compatible Nokia Series 60 phones

52
Nokia/Symbian OS cont.

• Hearing
• Lower RF emissions for hearing aid compatibility
• Most models are compatible with TTYs
• Nokia Wireless Loopset for hearing aid users
• Newer Nokia E5 handset comes with Mobile Captions
  Service preinstalled allows user to receive
  captions directly on their cell phone

53
Nokia/Symbian OS cont.

• Mobility
• Dished keys to make it easier to use a mouthstick
  or other device to dial
• Audio/voice interaction with user interface
  eliminating need to see or grasp phone
• Speakerphone with voice-activated answering
• Speech-independent name dialing
• Voice dialing, voice recorder, and voice commands
  with integrated hands-free speaker
• Bluetooth functionality
• Eyelets for connecting lanyards

54
Nokia/Symbian OS cont.

• Cognition
• Dial-out buffer memory allowing for more time to
  complete a process
• Phone books with images for easy identification
• Audio, visual or vibrating alerts
• Keys provide audio, visual and tactile feedback
  when pressed
• Pre-recorded voice commands to control phone
  functions
• Distinct sounds and on-screen icons alert you to
  network strength and battery level

• Friendly screen layouts
• Familiar language and descriptive icons
• Functionality thats consistent from screen to
  screen, menu to menu
• Help menus designed to anticipate the information
  being sought
• Keypad shortcuts to make every step quick and
  efficient

55
Other Tools available for Symbian OS

• Mobile Magnifier (89)
• Magnification levels from 1.25x to 16x
• Can be used with or without speech
• Font-smoothing for easier readability
• Three different layouts full-screen, split and
  distributed view
• Different color schemes, including inverted color
• Automatic panning and cursor-tracking
• Automatic zoom function that detects areas of
  interest on the screen
• Works with Windows Mobile and Symbian OS
• Available through ATT Partnership

56
Other Tools available for Symbian OS cont

• Mobile Speak (89)
• Make and receive calls, emails, text messages.
• Manage your contacts and call lists.
• Review the numbers entered in the dialer screen,
  and check the caller ID on incoming calls.
• Browse the Internet.
• Manage the calendar to schedule appointments and
  keep track of them using alarms and reminders.
• Create text and voice notes.
• Perform calculations.
• Listen to music and podcasts.
• Configure phone settings, profiles and ringtones,
  speed dial keys and voice tags.
• Share data between your device and other mobile
  phones and computers.
• Works with Windows Mobile and Symbian OS
• Available through ATT Partnership

57
Nokia/Symbian OS cont.

• ATT Partnership
• Started in 2007, ATT customers can purchase a
  supported Symbian Series 60 or Windows Mobile
  Standard smartphone with a Code Factory screen
  reader or screen magnification application from
  ATT.
• Currently supported devices (taken from ATT
  website)
• Nokia Surge(6790)
• Nokia E71x

58
Nokia/Symbian OS Updates

• Current State Until this year, Symbian was the
  primary OS for all Nokia handsets. As Nokia is
  the leader in smartphone market share
  worldwide8, it is popular everywhereexcept in
  the US.
• Until Sept. 2010, the Symbian OS was sold
  primarily on Nokia and Sony-Ericsson handsets.
  Since that time, Sony-Ericsson has adopted
  Android7 and Nokia has partnered with Microsoft
  to market Windows Mobile 78 as their primary
  mobile OS.

59
Nokia/Symbian OS Updates cont

• What does this mean for Symbians future?
• Not entirely sure right now. There are still
  millions of Symbian users out there worldwide and
  many more phones that will still be sold.
  However, it seems to have very little future of
  ever gaining a foot hold in the US Market.

60
Windows Mobile OS

• Recently released version Windows Phone 7 (WP7)
• Microsoft started over This version was a
  complete re-work of the Windows Mobile platform
• As a result, none of the applications that ran on
  previous versions will run on this one.
• Different levels of accessibility expected
  Similar to Android, the OS will be supported by
  major manufacturers like HTC, Samsung, LG, Dell,
  Nokia, and LG.

61
Windows Mobile OS cont.

• There are basic accessibility features
• Speakerphone, Bluetooth, Phone books with images
  for easy identification, Audio/visual/vibrating
  alerts, SMS messaging, IM, predictive text,
  gesture support, and other features that may
  depend on the model of the phone
• Most Notable features
• Live Tiles Offers friendly home screen with
  large tiles/pictures, large print notifications
  (i.e., email, messaging, social media, etc.).
  The ability to pin contacts, apps, etc. to the
  home screen makes for easier navigation.

62
Windows Mobile OS cont.

• More Notable features
• TTY Support
• Speech recognition support for making calls,
  searching the web, or opening applications

63
Windows Mobile OS cont.

• Windows Mobile 6.5
• Windows Mobile 6.5 is still available on some
  newer model phones (.e., HTC Touch Pro 2 from
  Sprint, HTC Imagio from Verizon, Samsung Jack
  from ATT). Older models still enjoy some
  support as well.
• This version of Windows Mobile was considered to
  be very accessible.
• Required 3rd party apps like Mobile Speaks and
  Mobile Magnifier to provide full access to the OS
  for individuals with low vision and blindness
• Important Note Support timeline??

64
Blackberry OS

• Blackberry Accessibility mentions many of the
  same features that support access to their
  products for individuals with disabilities (i.e.,
  vision, hearing, mobility, cognitive).
• Most notable features
• Physical keyboards, Tactile buttons
• Audible, visible, and vibrating alerts
• Contrast settings, etc.
• Text messaging (SMS or MMS)
• Support for closed and/or open captioned
• multimedia (select Blackberry models)
• Predictive text, auto-text
• Shortcut keys
• Voice notes, voice dialing

65
3rd party text-to-speech with Oratio (Humanware,
Inc.)

• Manage instant messaging, emails, SMS and MMS.
• Make and receive calls with access to caller ID
  on incoming calls.
• Manage contacts and call log.
• Schedule appointments and tasks with alarms and
  reminders.
• Access to the phone's settings, ring tones and
  speed dials.
• Only available on Blackberry Curve 8250
  smartphone from ATT 10

66
Clarity Theme for Blackberry Smartphones

• Available for free from Blackberry App World
• Simplified, easy-to-use Home screen interface
• Large, text-only icons on the Home screen
• High-contrast screen displayed in dark on light
  or light on dark
• Clickable header that allows you to easily switch
  between Date and Time or Battery and Network
  level views

67
Review Questions

1. Oratio for Blackberry is available for most
   Blackberry smartphone?
2. Which smartphone manufacturer markets the Symbian
   OS?

68
Any questions about any of the other mobile OS
that we just covered?
69
Summary

• Trends in mobile technology
• Most popular mobile OS
• Blackberry (workplace)
• Android OS (personal/business)
• iOS (personal)
• Most Accessible??

70
References

• Android fastest growing smartphone OS in U.S.,
  survey finds - Computerworld. (n.d.). . Retrieved
  May 7, 2011, from http//www.computerworld.com/s/a
  rticle/9199499/Android_fastest_growing_smartphone_
  OS_in_U.S._survey_finds
• E Textbooks A Fast Growing Trend For
  Entrepreneurs And Tablet Makers - Pressed -
  Portfolio.com. (n.d.). . Retrieved May 8, 2011,
  from http//www.portfolio.com/views/blogs/pressed/
  2011/02/25/e-textbooks-a-fast-growing-trend-for-en
  trepreneurs-and-tablet-makers/
• Mobile Trends Smartphone Usage and Penetration
  in Latin America and the United States Antonio
  Altamirano. (n.d.). . Retrieved May 7, 2011, from
  http//www.altamirano.org/mobile-technology/smartp
  hones-penetration-usa-latin-america/
• Smartphones Outsell PCs. (n.d.). . Retrieved May
  7, 2011, from http//www.readwriteweb.com/archives
  /smartphones_outsell_pcs.php
• The Future is Here e-Textbook Sales Increase
  3000 Percent Barnes Noble College News.
  (n.d.). . Retrieved May 8, 2011, from
  http//www.bncnews.com/the-future-is-here-e-textbo
  oks-grow-3000-percent

71
References cont.

1. TNS survey Smartphones gain traction for both
   businesses and consumers. (n.d.). . Retrieved May
   7, 2011, from http//www.tnsglobal.com/news/news-E
   BE5DD9AE77B4A09AB7FA6B1AF0E4BE2.aspxIDC
   smartphone shipment figures for Q1 2011 - All
   About Symbian. (n.d.). . Retrieved May 10, 2011,
   from http//www.allaboutsymbian.com/news/item/1285
   8_IDC_smartphone_shipment_figure.php
2. Sony-Ericsson Chooses Android Over Symbian So
   What? Tech News and Analysis . (n.d.). .
   Retrieved May 10, 2011, from http//gigaom.com/201
   0/09/27/sony-ericsson-chooses-android-over-symbian
   -so-what/
3. Why Nokia cant crack the U.S. market - Sep. 16,
   2010. (n.d.). . Retrieved May 10, 2011, from
   http//money.cnn.com/2010/09/16/technology/nokia/i
   ndex.htm
4. Tablet Sales to Spike in 2011, Forrester Says -
   NYTimes.com. (n.d.). . Retrieved May 11, 2011,
   from http//bits.blogs.nytimes.com/2011/01/04/tabl
   et-sales-to-spike-in-2011-forrester-says/

72
Contact Information

• Assistive Technology Initiative (ATI)
• George Mason University
• Aquia Building, Room 238
• Hours M-F, 830am-500pm
• Office Phone [phone]
• TTY [phone], Fax [phone]
• E-mail ati_at_gmu.edu
• Web http//ati.gmu.edu