Compliance Test Language CTL

1
Compliance Test Language (CTL)

• Chuck Morris
• Northrop Grumman

2
CTL Test Structure

• lttest name"QName"gt
• ltparam name"string"gtParam descriptionlt/paramgt
• ltcontextgtExpected context descriptionlt/contextgt
• ltassertiongtAssertion statementlt/assertiongt
• ltcommentsgtstringlt/commentsgt
• ltlink href"url"gtSpec Title and section
  lt/linkgt
• ltcodegt
• ltinstructiongt
• ltxslif test"XPath-expr"gt
• ltfail/gt
• lt/xslifgt
• lt/codegt
• lt/testgt

Metadata
XSL/CTL Instructions
3
CTL Instructions

• XSL Instructions
• Template-level XSL instructions are supported
• Includes instructions for decisions, looping,
  variables, etc.
• CTL Instructions
• Request Submit a GET or POST HTTP request
• Form Ask for user input using an XHTML form
• Fail Used to indicate a test failure
• Call-test Execute a sub-test
• Call-function Execute a java or XSL function
• Message Log a message to the user

4
CTL Extensibility

• Custom Parsers
• Convert web service response from binary to XML
• Written in Java
• Example ImageParser
• Custom Functions
• May be used in XPath expressions or called with a
  call-function tag
• May be written in Java or XSL
• Many existing Java functions can be used
• Java functions can accept and return built-in
  Java types and W3C standard DOM XML nodes

5
CTL Test Suites

• Just one starting test per suite
• ltsuite name"QName"gt
• lttitlegtstringlt/titlegt
• ltdescriptiongtstringlt/descriptiongt
• ltstarting-testgtQNamelt/starting-testgt
• lt/suitegt
• Tests calls subtests, resulting in a test
  hierarchy
• The test hierarchy is dynamic
• Tests that are not applicable to the
  implementation being tested are not executed
• Tests may be called multiple times, from several
  parent tests, with different parameters
• If a subtest fails, its parent test fails