Testing, Reliability, and Interoperability Issues in CORBA Programming Paradigm

1
Testing, Reliability, and Interoperability Issues
in CORBA Programming Paradigm
2
Outline

• Motivation
• Testing CORBA Program
• Reliability Evaluation
• Interoperability
• Future Work
• QA

3
Motivation

• Implement distributed applications with CORBA
  become popular
• Testing, reliability, and interoperability for
  the CORBA programming paradigm remain unexplored
• These issues is important to develop the reliable
  distributed system in CORBA

4
What is CORBA?

• Architecture and specification
• Allow object in the network communicate through
  an "interface broker"
• Developed by Object Management Group (OMG)
• Standard architecture for distributed objects (or
  Components)

5
Experiment Project Description

• 19 Programs,same specification
• Soccer Management System
• 10 operations
• team rules
• Different ORBs(Visigenic/Orbix)
• Different Languages (C/Java)

6
Program Metrics

• 7 programs use Iona Orbix(C)
• 12 programs use Visigenic
• 9 uses Java for client and server
• 2 uses C for client and server
• 1 uses Java as client and C as server

7
General Software Metrics
8
Testing the Programs

• Test Preparation
• Generate Test Cases
• Test Procedure
• Test Execution
• Result Analysis

9
Generate Test Cases

• Specification
• IDL

10
Test Procedure
11
Pass Rate
Pj - number of Pass cases for program j. Mj
-number of Maybe cases program j. C- total
number of cases apply to the programs (57)
Oi -number of Pass test cases for operation
i OMi- number of Maybe test cases for operation
i Ti - total cases for operation i
12
Test Result for Each Team
Test Results for Each Team
Maybe Some Test cases not applicable
13
Test Results for Each Operation
14
Defects Classification

• Exceptions
• Server Side
• Missing
• Extra or Wrong
• Client Side
• Missing
• Wrong
• Memory Management
• Ref Count
• Language Mapping
• Other

15
Distribution of Defects
Distribution of Defects
Missing/Extra or Wrong Missing/Wrong
16
Distribution of Defects
17
Reliability

• Develop the Operational Profile
• Define the Reliability of the Program
• Analysis the Results

18
Operational Profile
Operation Profile List of occurrence
probabilities of each element in the input domain
of the program.
19
Reliability Evaluation

Rj - Reliability for program j Rj' - Reliability
for program j (treat maybe as
pass) OPi,j-Pass test cases for operation i ,
program j Mi,j-Maybe test cases for operation i
, program j Ti - total cases for operation i ?i-
Probability for operation I n-number of operation
20
Evaluation Results
21
Evaluation Results
22
Comparison
23
Why Interoperability?

• Same Specification
• Try to Exchange the Client and Server
• Availability
• Higher Reliability Server/Client lead to higher
  system reliability?

24
Interoperability Evaluation
The difficulty of Interoperability
1 very difficult to inter-operate 2 possible
to inter-operate, but with considerable effort
3 interoperable with moderate effort. 4
interoperable with some effort. 5 readily
interoperable with minimal effort.
25
Evaluation Results
26
Difficulties in Interoperability

• IDL
• Interface
• Attribute/Operation
• Exception
• Other
• Between ORBs
• CORBA Service
• Specification

27
Summary

• Introduction to CORBA
• Testing the CORBA program
• Evaluating the reliability
• Evaluating the interoperability

28
Future Work

• Testing Techniques
• Reliability Evaluation Techniques
• Apply Software Fault Tolerance Techniques
• Reliability Model
• Implement Software Reliability Middleware

29
QA
30
Thank You!