PS1-MOPS Revised Testing System

1
PS1-MOPS Revised Testing System
2
Master Configuration File

• JSON format.
• Testing executables are generated from the file.
• Testing performs tests that are defined within
  the configuration file.

3
Test Definitions

• Tests are grouped by their target, a library or
  executable file, into test sets.
• A test set may contain zero or more unit tests.

4
Test Definition Example

• "test set"
• "type" "perl module",
• "target" "PSMOPSDCShape",
• "environment" "PSMOPSTestInstanc
  e" ,
• "tests"
• "test_new"
• "description" "Create a new
  Shape object."
• "params" ""
• "expected result" "Reference to
  new Shape object."
• "test_modcsh_insert"
• "description" "Insert a Shape
  object into the DC."
• "params" ""
• "expected result" "Data for
  Shape object is inserted into the DC."
• "test_modcsh_retrieve"
• "description" "Retrieve a Shape
  object from the DC."
• "params" ""

5
Code Template Example

• !/usr/bin/perl -w
• Unit tests for PSMOPSDCShape.
• use strict
• Testing environment.
• use PSMOPSDCShape
• use PSMOPSTestInstance
• our instPSMOPSTestInstance-gtnew()
• Use Perl testing framework.
• use TestMore tests gt 3
• Run tests.
• ok(test_new(),"test_new")
• ok(test_mod_csh_insert,"test_mod_csh_insert")
• ok(test_mod_csh_retrieve,"test_mod_csh_retrieve")
  

6
Test Running

• Tests defined in the master configuration file
  will be run.
• Intermediate test failures will not interfere
  with subsequent testing.
• Test results will be collected for each test set.

7
Testing Results

• Manual testing
• Test results will be reported to STDOUT.
• Automated testing
• Test results will be inserted into the testing
  results database.
• Testing results will be reported by email.
• Test result insertion requirements to be
  determined.

8
Implementation Notes

• Testing is language specific.
• Perl module testing makes use of TestMore
  facilities.
• Equivalent functionality sought in Python.
• Equivalent functionality sought for testing
  executable files.