Tablet PCs as Mobile Multimedia Data Collection

1
Tablet PCs as Mobile Multimedia Data Collection
Analysis ToolsMalu Roldan, Ph.D.Associate
ProfessorSan Jose State UniversityPrincipal
InvestigatorSJSUHP Mobility Project
2
Project GoalInvolve Multidisciplinary Teams in
the development of Tablet-PC enabled mobile
applications for the community
Portability Connectivity Hypermedia
Ink
3
VideoTabletPCs Across Campus

• Journalism
• Teacher Training
• Management
• Library
• Education
• Art and Illustration
• Health Science

4
AnytimeAnywhereAny Position

• Editing Student Work
• Student feedback during Field Observations
• Digital Illustration
• Collaboration
• Customer Service (Library)
• Field Research

5
Anthropology

• Professor Chuck Darrah
• First Reaction --Replace/Enhance field work
  procedures

6
Qualitative Research Capturing
Others/Multiple Perspectives

• Ethnography
• Community Based Participatory Research (e.g.
  Photovoice)
• Interviews/Focus Groups
• Content Analysis

7
Applications

• Research
• Anthropology
• Health Science
• Industrial Design
• Product Development
• IDEO
• Lead User Studies
• Used to develop many familiar and successful
  products including Intuits Quicken, First Apple
  Mouse, Microsofts Tablet PC, HP Consumer Devices

8
What is OneNote?A portable, multimedia, digital
file cabinet
9
Tablet PC Data Collection

• Multimedia Data
• Text synchronized with video and audio
• Diagrams Other clippings
• Collaborative Data Collection
• Connectivity allows for real-time collaboration
  on single document
• Connectivity allows for publishing from the field

10
Tablet PC Data Analysis

• Field notes can call attention to compelling
  video/audio materials
• Flags to tag/code content
• Multimedia Search recognized text, ink, text in
  graphics, audio
• Search Summaries

11
Annotating multimedia data

• Presentations recorded using webcam or other
  video camera
• Annotations linked to video
• Video and notes may be emailed with OneNote page

12
Community Based Learning User-led Design

• OneNote used to capture user impressions of
  community asset mapping application v1
• Developer team notes user suggested tweaks
• Audio synched to notes

13
Community-Based Research Hypertext Reports

• Students used OneNote to build multimedia notes
  on their community visits
• Multimedia materials (e.g. WMA files) used in
  reports in OneNote, on the Web, in powerpoint

14
Analysis withFlags to tag notes Multimedia
Search
15
Emerging Platform for Qualitative Research

• Ubiquitous Connectivity 802.11x and/or 3G
• Repositionable Video Recorder
• Advances in Multimedia Search and recognition
• User-managed Privacy
• Software as a Service

16
Beta Site Demo
Questions and Comments?
www.sjsu.edu/cats/2003/showcase/