Conformance Testing with State Mapping

1
Conformance Testing with State Mapping

• Vadim Mutilin
• ISP RAS

2
Conformance Testing
Implementation
Specification
Sys
M
conforms-to?
Test suite
Test case
T
t

Sys passes T
T is sound if Sys conforms-to M gt Sys passes T T
is complete if Sys conforms-to M ltgt Sys passes T
3
State Mappings

• MAPPINGS SPECSIMPLS?FUNCS
• fMAPPINGS(M,Sys)
• fSSys?SM
• In practice
• Reading an implementation state
• Converting it into a specification one

4
Example
5
Differences from FSM-based Testing

• FSM vs. Labelled Transition System (LTS)
• Equivalence vs. Conformance relation
• Status message vs. State mapping

6
Test cases

• ISO IS-9646 OSI Conformance Testing Methodology
  and Framework
• OMG UML Testing Profile

• Tretmans formalization
• Labelled transition system S, L, T, s0
• Test case St, L, Tt, ?, s0t,
• ? St ? pass, fail verdict function.
• Test run synchronous parallel composition
  tSys (in initial state)

7
Composite Test Suites
8
Derived Test Suite

• T3Derived(Te3)

• Sys passes Te ltgt Sys passes Derived(Te)

9
Time of Test Execution

• ?(Te ) lt ?(Derived(Te))
• In example ?(Te3) 20 lt ?(T3) 53
• When lt
• Circles
• Non-determination

10
Conclusions and Future Work

• Theory
• More efficient way of writing test suites
• Practice
• UniTESK formalized as FSM-based testing
• Future
• Conditions for test suite completeness

11
Thank you!Questions?

• Vadim Mutilin (ISP RAS)
• mutilin_at_ispras.ru