Robert Gadd

1
Session 112 Mobilizing Tests Building
Deploying Assessments to Cell Phones
Robert Gadd OnPoint Digital, Inc. November 12,
2008
2
THE BIG PICTURE
What do all of these people have in common?
Eric Schmidt, Google CEO "Mobile phones are
cheaper than PCs, there are three times more of
them, growing at twice the speed, and they
increasingly have Internet access. What is more,
the World Bank estimates that more than
two-thirds of the world's population lives within
range of a mobile phone network. Mobile is going
to be the next big Internet phenomenon. It holds
the key to greater access for everyone - with all
the benefits that entails.
3
Session Agenda

• mLearning Approach Building Blocks
• Mobile Tools Process Flows for Tests
• Delivery Modalities for Mobile Tests
• Audience Participation Mode (APM)!
• Additional Case Study Examples
• Summary QA

4
Audience Survey!

• Who has tried mLearning already?
• Who owns an iPod a cell phone?
• Who has their iPod with them?
• Who has their cell phone with them?
• Who has a cell phone w/ a data plan?
• Who has a smartphone? What kind?

5
Background Experience
6
CORPORATE CAPABILITIES

• Formed in 2001 by experienced team of systems
  integration, software development media
  experts targeting enterprise accounts
• Offering end-to-end mobile content delivery and
  communications technology under the CellCast
  Solution brand
• Complement core offerings with consulting,
  support, content production and custom
  development services
• Acquired LiquidTalk (Oct 08) combined entity
  manages 100 enterprise installations and 850,000
  licensed users worldwide, including over 100,000
  mobile participants
• Offices in Savannah (HQ), Chicago New Zealand
  w/ channel partners in APAC, EMEA

7
INDUSTRY AWARDS PRESS RECOGNITION
OnPoints software meets an increasing need for
smartphone applications that go beyond e-mail.
CellCast Solution wins five awards from Mobile
Village Oct 2007 Oct 2008
Mobile Widget Contest April 2008
2003
Uses the iTunes style content-syncing and
organization to manage business info that mobile
workers need. Great idea.
Assessments Go Mobile with CellCast Sept. 2008
FreePad Solution Sept 2003
Theres no question applications like these will
be embraced by forward-looking CIOs
Best Mobile Learning DevLearn Nov 2007
8
TRADITIONAL LMS/LCMS CUSTOMERS
9
MOBILE EXPERIENCE
Customers, Pilots Active Proof of Concept
Accounts
Also, Partner Opportunities Through
10
mLearning Building Blocks
11
DEFINITIONS
mLearning is
M-learning, or "mobile learning", now commonly
abbreviated to "mLearning", has different
meanings for different communities. Although
related to e-learning and distance education, it
is distinct in its focus on learning across
contexts and learning with mobile devices. One
definition of mobile learning is Learning that
happens across locations, or that takes advantage
of learning opportunities offered by portable
technologies.
12
MOBILE DEVICE CAPABILITIES MATRIX
mLearning Toolkit Tools
Media Content (Vodcasts/Stream/3G)
Video Audio (Push or Stream)
Rich Content (XHTML, J2M, OTA)
Content (PPTs, Modules, SWF)
Resources (PDF, Moblogs, JIT)
Static Materials (PDF, HTML, RSS)
AudioCasts (Content, Tests)
Audio Tests via Cell/Podcasts
SMS MMS (Status, Scheduled)
2-Way Content, Tests/Data Collect
Pushed Email SMS Messages
Notifications
13
TYPICAL MOBILE USE CASES
mLearning Toolkit Tools
Media Content (Vodcasts/Stream/3G)
Engaging Content, Info-tainment
Rich Content (XHTML, J2M, OTA)
Courseware, Rapid Learning
Resources (PDF, Moblogs, JIT)
EPSS, Checklists, JIT Info
AudioCasts (Content, Tests)
Narrative, Podcasts, Conf Calls
SMS MMS (Status, Scheduled)
Interactive Tests, Data Collection
Reminders, Updates, Alerts
Notifications
14
TESTING POSSIBILITIES ARE EVERYWHERE!
mLearning Toolkit Tools
Media Content (Vodcasts/Stream/3G)
Measure Retention after Media
Rich Content (XHTML, J2M, OTA)
Knowledge Check after Module
Resources (PDF, Moblogs, JIT)
Complete a Checklist
AudioCasts (Content, Tests)
Provide Feedback, Insights
SMS MMS (Status, Scheduled)
Interactive Polls/Surveys
Dont Forget to
Notifications
15
MOBILE DEVICE CAPABILITIES MATRIX
mLearning Toolkit Tools
WOW!
HARD!!
Rich Media (Vodcasts/Stream/3G)
Courseware (XHTML, J2M, OTA)
Resources (PDF, Moblogs, JIT)
AudioCasts (Content, Tests)
SMS MMS (Status, Scheduled)
Notifications
16
MOBILE DEVICE CAPABILITIES MATRIX
mLearning Toolkit Tools
Rich Media (Vodcasts/Stream/3G)
Courseware (XHTML, J2M, OTA)
Resources (PDF, Moblogs, JIT)
AudioCasts (Content, Tests)
SMS MMS (Status, Scheduled)
Notifications
17
MOBILE DEVICE DIVERSITY
mLearning Toolkit Tools
Basic Phones
Smart- Phones
Premium Phones
Rich Media (Vodcasts/Stream/3G)
Courseware (XHTML, J2M, OTA)
Resources (PDF, Moblogs, JIT)
AudioCasts (Content, Tests)
SMS MMS (Status, Scheduled)
Notifications
US0.99
US99
US599
US199
18
MARKET PENETRATION
Basic Cell Phones
Smart- Phones
Premium Phones
3 Billion
400 Million
35 Million
19
MOBILE DEVICE CAPABILITIES MATRIX
mLearning Toolkit Tools
Rich Media (Vodcasts/Stream/3G)
Advanced CellCasts
Courseware (XHTML, J2M, OTA)
Resources (PDF, Moblogs, JIT)
AudioCasts (Content, Tests)
Basic CellCasts
SMS MMS (Status, Scheduled)
Notifications
20
mLearning Tools/Vendors Content Creation
Process Flow
21
CORE LMS/LCMS FLOW MODEL
Typical eLearning Creation Deployment Model
AUTHORING TOOLS
CONTENT AUTHORS
DELIVERY PLATFORM
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
Managers
LMS
Online Users
PORTAL
LCMS
Authors
Offline Users
22
MOBILE TESTING ARCHITECTURE
AUTHORING TOOLS
CONTENT AUTHORS
WEB PHONE PLATFORMS
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
Online Users
Articulate
LMS
Offline Users
SurveyMonkey
PORTAL
Authors
LCMS
Managers
Cell Phones Smart Phones
Flash
PDAs UMPCs
Authors
OnPoint
23
COMPETITIVE ANALYSIS
Traditional mLearning Creation Deployment Model
AUTHORING TOOLS
CONTENT AUTHORS
DELIVERY PLATFORM
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
MCMS
SMEs Managers
Managers
LMS
PORTAL
Online Users
LCMS
Authors
Offline Users
24
COMPETITIVE ANALYSIS
AudioCast Content Creation Deployment Model
AUTHORING TOOLS
CONTENT AUTHORS
DELIVERY PLATFORM
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
Mobile Learners
MCMS
Managers
SMEs Managers
LMS
PORTAL
Online Users
LCMS
Authors
Offline Users
25
COMPETITIVE ANALYSIS
Media-based Content Deployment Model Tools
AUTHORING TOOLS
CONTENT AUTHORS
DELIVERY PLATFORM
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
Mobile Learners
MCMS
Managers
SMEs Managers
LMS
PORTAL
Online Users
LCMS
Authors
Offline Users
26
How many different types of mobile tests are
there?
27
MOBILE ASSESSMENTS MODALITIES
28
TECHNICAL APPROACH
VS.
Develop as Web App
Develop as Native App
29
VARYING APPROACHES
Web App
Native App

• CellCast Players
• Development Time lt 4
  Days 6-8 Weeks
• Development Platform HTML, AJAX, 3rd Party
  HTML, AJAX, Java, .NET, Obj C
• Deployment Efforts Easy! (URL Link)
  Challenging! (OTA Installs)
• Media Player Integration Limited
  Extensive
• Content Access Web Only
  Local Playback or Web
• Content Delivery Methods Requested
  Scheduled or Requested
• Content Delivery Options
  Passive
  Active
• Content Inclusion Text
  Graphics Very Diverse Media
• Branding/Customization Limited
  Extensive
• Maintenance/Support
  Easier Harder
• Value Add Potential () Limited
  Value (Web) Tangible Value (Widget)

30
TYPICAL TESTING SCENARIOS

• Tests Quizzes On-demand tests (push/pull) for
  knowledge checks, reinforcement and
  certification/compliance efforts.
• Surveys/Feedback Forms Determine needs,
  requirements, readiness or satisfaction.
• Field Data Collection Gather info from remote
  workers/crews.
• Spot Polls Measure reaction to current
  concepts/issues.

31
CELLCAST INTERFACE
Voice/IVR-based Tests on Cell Phones

• Easy Intuitive Using Voice, SMS Keypad.
• Flexible Listen to or Read your Assessments
  Interact.
• Secure Access Utilizes Caller ID Functions
  Optional PIN Codes.

32
QUESTION TYPES ON PHONES
Multiple Choice Questions
True/False Questions
Numeric Response Questions
Likert/Graded Scale Questions
Comment/Spoken Response Questions
33
CELLCAST ON SMART PHONES
Packaged Tests on Smartphones

• More Options Using Voice, SMS, Keypad/Keyboard,
  Camera, Media Players via WebApp or Native App
• More Flexible Read, Listen or Watch your
  Assessments then interact plus Offline Access is
  possible.

34
INTEGRATION REQUIREMENTS
mLearning Content Creation Deployment Model
35
INTEGRATION REQUIREMENTS
What Does Integration Entail?
AUTHORING TOOLS
CONTENT AUTHORS
MOBILE WSDL PIPE
DISTRIBUTION/ACCESS TO LEARNERS MANAGERS
mLearning CellCast
PORTAL
LMS/LCMS
mLearning
Mobile SMEs
Managers
36
3rd PARTY CONTENT/TEST INTEGRATION
What About Integrating with Other Tools?
37
Lets Start the Audience Participation Mode
Examples!
38
Assessment Creation Logic
CellCast Nuggets
39
Technology Demonstrations
Part 1 - Text-based Assessments
What is the most simple form of test delivered to
a persons cell phone?
Mobile Marketing/Messaging Campaigns!
40
CASE STUDY EXAMPLES
CASE STUDY 1
CO Kauffman Foundation/Hot Lava SW
Reqs Mobile Education Campaign
Tech CellCast SMS Gateway


Market 50K Fans (Summer-Fall 2008)
Overview OnPoints CellCast Solution supported
Hot Lava Software, an OnPoint Reseller/Partner,
to facilitate Event-based education for students
and young adults attending major league sporting
events (soccer baseball games) during the
Summer/Fall 2008 season. The mission of the
Kauffman Foundation is to increase STEM (Science,
Tech, Engineering Math) skills for school aged
children using progressive and engaging methods.
CellCast provided interactive 2-way
learning/testing to participants via text
messages using their cell phones.
41
LETS ALL TRY IT!!
DEVLEARN 2008 JUMBOTRON The stitches on a
baseball are more than cosmetic they cause
friction which creates a boundary layer around
the ball when thrown. Do you think this makes
the ball travel faster? Text your answer to us
now to qualify to win a prize! If true text
SPORTA to 653276 now! If false, text
SPORTB to 653276 now!
CASE STUDY 1
Scenario To help motivate kids and young adults
attending major league and minor league sporting
events to learn more about STEM, scenarios were
placed up on the JumboTron at sporting events
asking them to answer questions like these The
stitches on a baseball are more than cosmetic
they cause friction which creates a boundary
layer around the ball when thrown. Do you think
this makes the ball travel faster or slower?
Text your answer to us now to win a prize! If
True text SPORTA to 653276 now! If False,
text SPORTB to 653276 now!

42
Technology Demonstrations
Part 2 - Text-based Assessments
What about getting tests out to mobile users in
my community -- how is that different?
Opt-In Testing Campaigns!
43
CASE STUDY EXAMPLES
CASE STUDY 2
CO DevLearn 2008 Interactive Test
Reqs Demonstration of Functionality
Tech CellCast SMS Gateway Campaign


Market Session 112 Attendees
Overview Now, lets demonstrate how the SMS
Gateway functionality of OnPoints CellCast
Solution platform can be used to plan, deliver
and manage secure 2-way interactive SMS campaigns
for mobile learners/workers who opt into the
program either online or via their cell phone.
44
LETS ALL TRY IT!!
CASE STUDY 2
DEVLEARN 2008 JUMBOTRON Step 1 - REGISTRATION
If register text devlearn to 653276
now! Step 2 - BEGIN CAMPAIGN Once in
text poll21 to 653276 to answer this weeks
interactive poll as follows Q1 To the best of
your knowledge, do you feel you will achieve your
sales quota this fiscal quarter? Text back 1
for yes and 2 for no.
Scenario This time, youre going to need to
register or opt-in to the 2-way SMS campaign
you wish to participate in by doing so, youre
informing the CellCast system that you are a
willing participant in these interactions and
that you accept all applicable charges for the
messages youre going to receive and send as part
of the campaign. Step 1 - REGISTRATION If
register text devlearn to 653276 now! Step
2 - BEGIN CAMPAIGN Once in text poll21
to 653276 to answer this weeks interactive poll
as follows Q1 To the best of your knowledge,
do you feel you will achieve your sales quota
this fiscal quarter? Text back 1 for yes and
2 for no.

45
Technology Demonstrations
Part 3 - Audio/IVR Testing
In this section, well hear a typical audio
IVR-based CellCast experience and review the wide
range of results/benefits possible for mobile
teams.
46
Part 3 - Basic CellCast Demo
Standard CellCast Navigation Options include
47
TEST QUESTION TYPES
CellCast Tests/Survey Functionality
Using the Keypad
Using your Voice
Click Here to Access CellCast Manager
48
CASE STUDY EXAMPLES
CASE STUDY 3
CO USA Wireless Carrier
Reqs Mobile Workforce Enablement
Tech CellCast Solution v2.0

Serving Programs launched Summer 2008 with 100s
of Salespeople Techs
Overview Anytime/anywhere training and support
for sales teams and technical resources spread
across North America. Mobile workers have access
to market information, product updates and
surveys for on-the-go learning, training
reinforcement and onsite data collection.
49
CASE STUDY EXAMPLES
CASE STUDY 3
APPLICATION Data Collection
Reqs Mobile Field Enablement
Tech CellCast Solution v2.0

• Overview
• In this simplified example, well have a new
  field tech
• Create a CellCast account using a simple web
  form.
• Have a survey assigned to them.
• Access/complete the survey send results back to
  the server (mgmt) for review.
• A Volunteer with an iPhone?

50
Technology Demonstration
Part 3 - Smartphone Examples
In this section, well show you what it looks
like to take an assessment using a smartphone
WebApp or a Native Player.
Click Here to Launch iPhone WebApp Demo
Click Here to Launch BB Native App Demo
51
Technology Demonstration
Part 4 - Tracking/Results
In this section, well show you what the
individual cumulative results look like for
CellCast Programs.
Click Here to Review CellCast Results
52
Other Case Studies
53
CASE STUDY EXAMPLES
CASE STUDY 3
CO Sales Quenchers
Reqs Iterative learning, JIT Reinforcement
Tools CellCasts, SMS Card Decks


Market 10K users
Overview Delivering a new paradigm for high
tech/high touch sales training programs to
subscriber organizations in MLM space. Provides
an automated way for sales mgmt to reach out and
touch their sales teams with market updates
important reminders supplemented with content
from Sales Library of 1-2 minute Learning Nuggets
(audio, messaged, flash, PDF or video) distilled
from leading Sales Industry Experts (Blanchard,
Tracy, Mackay, Gitomer, Ziglar). Leverages
community network. Major customers include
Aflac, Amway, others.
54
CASE STUDY EXAMPLES
CASE STUDY 2
CO Applied Industrial Technology
Reqs Mobile Workforce Enablement
Tech CellCast Solution v2.0

Market Launched July 2008 with 1,000 sales and
technical workers across N.A.
Overview Anytime/anywhere training and support
for sales teams and technical resources spread
across North America supporting Applied 2M SKU
inventory. Teams have access to audio-based
content, surveys forms and can retrieve their
assignments from a custom web portal for use on
their cellphones or their MP3 Players. New
content is created by management and product
managers using OPRI call-in tools.
55
CASE STUDY EXAMPLES
CASE STUDY 2 - RESULTS

• Deployed to 1,000 personnel in 4 months with
  plans to increase to 3,500 people for Year One
• Content creation time was reduced from 3 days to
  1 day 50 fewer resources were needed to produce
  and deploy the content
• Delivery assimilation dramatically accelerated
  from an average of 48 days to just 6 days
• Completion rates during the pilot with virtually
  100
• User satisfaction levels with the experience were
  rated 4.5 on a 5 scale

56
Summary Conclusions
57
CONCLUSIONS
mLearning is NOT a O.S.F.A. Solution

• mLearning is Many Things to Many Groups
• Pure Learning Assessment
• Reinforcement/Refreshers (Learning Nuggets)
• Performance Support/Job Aides
• Data Collection/Surveys Analysis
• Reference (Fingertip Knowledge)

One Size Fits All
58
CONCLUSIONS
Mobile Assessments are Possible Varied

• Mobile-Delivered Assessments Include
• Message-based Alerts
• Interactive, 2-Way SMS Campaigns
• Feature-rich Audio/IVR-based Tests Surveys
• Web Tests Accessible from Internet-attached
  Phones
• Embedded/downloadable Tests for Smartphones
• The Tools to Design/Build/Deploy Mobile-delivered
  Assessments Available, Proven Easy to Use

59
4 YEARS OF MARKET EXPERIENCE

• Successful mlearning projects are equal parts
  content, communications community.
• Successful mLearning projects require ease of
  deployment, ease of access, ease of adoption plus
  adequate resources2!
• User-generated content social networking are
  increasingly key mobile learning drivers
• The most relevant business case to help drive
  mobile learning initiatives may lie outside the
  learning organization (e.g., sales, field, execs)
• Dont get intoxicated by the latest device

60
SUMMARY CONCLUSIONS
Contact Information

• For more Information on CellCast Solutions from
  OnPoint Digital
• www.onpointdigital.com
• Please contact us at [phone]
• Try a CellCast at [phone]
• Sign up today at
• http//www.mlearning.com