The OASIS Interoperability and Conformance Technical Committee ebXML Test Framework

1
The OASIS Interoperability and Conformance
Technical Committee ebXML Test Framework

• Michael Kass
• ITL Standards Conformance Testing Division
• mkass_at_nist.gov

2
Goals of OASIS Implementation, Interoperability
and Conformance Technical Committee (IIC)

• Provide a means for software vendors to create
  infrastructure and applications which adhere to
  the ebXML specifications and are able to
  interoperate
• Promote ebXML technologies through conformance
  and interoperability testing of ebXML Messaging
  Services (MS), Registry Services (RS), Business
  Process Specification Schema (BPSS) and
  Collaboration Protocol Profile/Agreement (CPP/A)
  and Core Components (CC)
• Encourage vendor contribution to ebXML
  conformance testing tools and test suites
  through participation in the OASIS
  Implementation, Interoperability and Conformance
  Technical Committee (IIC)

3
Current Work in the IIC

• Provide non-intrusive interoperability testing
• Support "maintenance" interoperability testing
• Provide automated testing tools
• Provide configuration and deployment guidelines

4
IIC Collaborators

• eBusiness Consortia Asia (ECOM, KorBIT, NCA),
  Europe (EAN-UCC) North America (OASIS)
• Companies Sun Microsystems, Drake Certivo,
  Fujitsu, GE Global Exchange Services, SeeBeyond
  Technology Corporation, Yellow Dragon Software
  Corporation, Drummond Group

5
Testing for the Interoperability Stack

• Deployed System
• CPP/A instances
• Registry Services
• BPSS definitions
• Message content
• (core components)

• Infrastructure
• ebMS MSH
• Registry Server
• BPSS engine

6
OASIS IIC Specifications and Products
7
The OASIS/ebXML Test Framework V1.0

• Flexible test architecture Test Driver and Test
  Service can be configured for conformance or
  interoperability testing
• Requirements-based testing Uses formalized XML
  schemas to define testing requirements and test
  assertions
• Uses falsification testing through verification
  and validation of message content generated by
  candidate applications
• Generates formal test reports against test
  requirements, with traceability back to the
  specification document
• Available via HTTP download from OASIS IIC web
  page

8
Test Framework Components
Test Service
Test Driver

• Standalone mode for conformance testing
• Interfaced with local MSH/BSI for interop testing

• Simulates application side for remote testing
• Interfaced with candidate MSH/BSI for interop
  testing

9
Test Framework Configurations
Messaging/CPPA
Business Process
Registry
10
ebXML MS V2.0 Conformance Test Suite

• ebXML Messaging Services 216 conformance test
  requirements and executable test cases
• Requires ebXML Test Framework V1.0 implementation
• Available via HTTP download from OASIS IIC web
  page

11
ebXML MS V2.0 Interoperability Test Suite

• ebXML Messaging Services 10 interoperability
  test requirements and executable test cases
• Requires ebXML Test Framework V1.0 implementation
• Available via HTTP download from OASIS IIC web
  page

12
EAN-UCC Deployment Guidelines

• Describes the details of the ebXML Message
  Service Implementation specified for EANUCC
• Available via HTTP download from OASIS IIC web
  page

13
Demonstrators of IIC Test Framework

• KorBIT Korea
• MS Conformance Test Suite
• MS Interoperabilty Test Suite
• NCA Korea
• MS Conformance Test Suite
• Registry Conformance Test Suite
• NIST OAG Testbed - (Drake Certivo)
• OAG BOD conformance testing

14
KorBIT Test Framework Demonstration

• Illustrates the value of performing conformance
  testing first, as inexpensive regression
  testing prior to performing an interoperability
  test across Asian and North American ebXML
  Message Handlers
• Perform 3 IIC MS conformance tests against 2
  Asian, 1 North American MSH
• Message packaging test
• Message Reliability test
• Security test
• Generate standard IIC conformance report for each
  implementation
• Run ebXML Interoperability test case (packaging,
  reliabilty and security) against 2 Asian and
  North American MSH
• Show how conformance test results validate
  interoperability test results and predict
  interoperability outcome

15
NCA Test Framework Demonstration

• Demonstrates the IIC Test Framework used across
  both ebXML Messaging Services and Registry
  specifications
• Perform 3 IIC MS conformance tests against 1
  Asian ebXML Message Service Hanlder
  implementation
• 6 MIME packaging tests
• 1 ebXML Manifest content verification test
• Generate a standard IIC conformance report
  against the MSH implementation
• Run ebXML Registry V2.5 LifeCycleManager
  conformance test cases
• 10 LifeCycleManager tests, including exception
  handling, UUID tests and audit trail
• Generate a standard IIC conformance report
  against the Registry implementation

16
Drake Certivo Test Framework Demonstration

• Demonstrates the IIC Test Framework used across
  both ebXML Messaging Services and Application
  specific (OAG) conformance testing
• To be determined

17
Summary

• OASIS IIC Conformance/Interoperability Test
  Framework is being implemented and used in ebXML
  MS and Registry conformance and interoperability
  testing by
• KorBIT
• NCA
• KIEC
• NIST
• NIST is exploring the use of the test framework
  in BPSS and OAG BOD conformance testing
• CPP/A, Core Component and vertical application
  conformance and interoperability testing are
  other areas that need testing

18
Future IIC directions

• Collaborating with other standards consortia and
  testbeds in Europe and Asia
• Acting as a global hub for ebXML conformance
  and interoperability testing resources