Participatory Testing

1
Participatory Testing

• Ashish Shah
• Vice President, Offshore Development

2
Agenda

• Open Testing
• SpikeSource Test Automation
• Collaboration in Testing
• Test Results Publication
• Demo
• Contributing Tests
• Demo
• Future Directions

3
One Opinion Prerequisites to Open Source

• Collaboration demands media of collaboration
• In other words tools for structured
  conversations
• Open source development needs development
  collaboration
• Repositories cvs, svn
• Issue tracking Bugzilla
• Project and other standard build machines
• Build Repositories
• Templates, definitions, procedures
• Unstructured mailing lists, categorized
  threaded message boards

4
Prerequisites to Open Testing

• Collaboration demands media of collaboration
• In other words tools for structured
  conversations
• ???

5
SpikeSource Test Automation
SpikeSource
Query
Web Site
Test Harness Scripts Drivers
Results
Components
Open Source Components Versions
Productization
Systems Library
System
SUT
Community
6
SpikeSource Test Automation
7
Test Results Collaboration
Test Results Publication Interface (TRPI)
SpikeSource
Web Site
Query
Test Harness Scripts Drivers
Results
Web Service
Components
Open Source Components Versions
Productization
Systems Library
System
SUT
Community
8
Take Part! Test Results Collaboration
9
Test Results Collaboration
10
Component Builds and Tests
SpikeSource
Web Site
Query
Test Harness Scripts Drivers
Results
Web Service
Components
Open Source Components Versions
Productization
Systems Library
System
SUT
CVS Alerter
Community
11
Component Builds and Tests
12
Component Builds and Tests
13

• Test Results Demo

14
Test Collaboration
Test Upload Service (TUS)
SpikeSource
Web Upload Interface
Web Site
Query
Test Harness Scripts Drivers
Results
Data Driver
Web Service
Test Script
Tool Spec
Open Source Components Versions
Components
Productization
Payload Spec
Systems Library
System
SUT
System Spec
CVS Alerter
Community
15
Test Collaboration
16
Test Collaboration
17

• Test Upload Demo

18
Take Part! Test Upload Service
19

• Possible Future Directions

20
Increasing Test Granularity
Single Defect Patches
SpikeSource
Web Upload Interface
Web Site
Query
Test Harness Scripts Drivers
Results
Data Driver
Web Service
Test Script
Payload
Tool Spec
Open Source Components Versions
Components
Productization
Payload Spec
Systems Library
System
SUT
System Spec
Patch Reconciliation
Patch Reconciliation
CVS Alerter Patch Spider
Community
21
Prerequisites to Open Testing

• Collaboration demands media of collaboration
• In other words tools for structured
  conversations
• Standard Interfaces
• Test Upload Service Interface
• Test Results Publication Interface
• Services
• Test Upload Service
• Component Builds Publication
• What else? Let us know ...

22

• Q A

23
Participatory Testing

• Ashish Shah
• Vice President, Offshore Development
• ashah_at_spikesource.com