The AGEDIS Project

1
The
Project
Automated Generation and Execution of Test Suites
Bernd Mattern
imbus AG Kleinseebacher Strasse 9 91096
Moehrendorf
2
What is AGEDIS?
A utomated G eneration and E xecution of Test
Suites for Dis tributed Component-based Software
Total budget 4,3 M EUR EC pays 2,3 M EUR
3
Agenda

• 1. Motivation
• 2. Goals of AGEDIS
• 3. Overview of AGEDIS
• 4. AGEDIS Modelling Language
• 5. Other Approaches
• 6. Summary and Outlook

4

1. Motivation
Design Specification
FunctionalSpecification
Review
Test Specification
5

1. Motivation
Review
AGEDIS Model
automaticderivation
Design Specification
FunctionalSpecification
6
2. Goals of AGEDIS

• Creation of a new testing methodology
• Cheaper software development costs
• Continuous approach to testing from modelling
  the software to the evaluation of the test run
  results
• Adoption of standards

7
3. Partners (Institutions)
8
3. Partners (Institutions)
9
3. Architecture
Intermediate Format Encoding
Software Model
Abstract Test Suite
Test Goals
Suite Execution Trace
Test ExecutionDirectives
10
3. Work Package Structure

• Work Package (WP) total effort
• WP1 - Project Management 33 PM
• WP2 - Software Modelling Language 25 PM
• WP3 - Modelling Language Compiler 31 PM
• WP4 - Test Generation Tool 32 PM
• WP5 - Test Execution Tool 32 PM
• WP6 - Test Productivity Tool 37 PM
• WP7 - Test Automation Environment 36 PM
• WP8 - Application Experiments 56 PM
• WP9 - Technology Transfer 54 PM
• Sum 336 PM (28 PY)

11
3. Roles of Partners
12
3. Flow of Events
Today
Survey Language Spec First Experiments
Prototypes Compiler Generator Executor
4 months
2nd Experiments
Final Tools
Exploitation Publication
12 months requirements design implementation test
12 months
3 months
13
4. Modelling Language

• UML based
• Subset of UML diagrams
• Definition of special semantics
• Definition of software design
• Definition of test goals / test directives

14
4. From Software Design

• Class Diagrams

0..
15
4. From Software Design
State transition diagrams
For each class
initial
decision
every state has - entry exit
actions - internal transitions - NEW in AGEDIS
deferred eventstimer events
triggergard/action
final
16
4. AGEDIS Semantic extension
Stereotype ltltsignalgtgt used to specify events and
actions in state diagrams

Controllable Signals, that can be sent to the
system by the tester
Observable Signals from the system, that can be
validated by the tester
17
4. Test Directives
ltltstartgtgt

Object Diagrams - Define states of the system
during test. Attributes are defined. - AGEDIS
Semantic extension Special stereotypes are
given to diagrams ltltstartgtgt, ltltfinishgtgt,
ltltincludegtgt, ltexcludegtgt
18
4. Test Directives
ltltexcludegtgt
ltltstartgtgt

ltltexcludegtgt
ltltincludegtgt
What does the AGEDIS test generator do? Searches
for test cases
ltltincludegtgt
ltltincludegtgt
ltltincludegtgt
ltltexcludegtgt
Good case!
ltltfinishgtgt
19
4. Test Directives
ltltexcludegtgt
ltltstartgtgt

ltltexcludegtgt
ltltincludegtgt
What does the AGEDIS test generator do? Searches
for test cases
ltltincludegtgt
ltltincludegtgt
ltltincludegtgt
ltltexcludegtgt
another Good case!
ltltfinishgtgt
20
4. Test Directives
ltltexcludegtgt
ltltstartgtgt

ltltexcludegtgt
ltltincludegtgt
What does the AGEDIS test generator do? Searches
for test cases
ltltincludegtgt
ltltincludegtgt
ltltexcludegtgt
ltltincludegtgt
Bad cases!
ltltfinishgtgt
21
4. Test Directives

Alternative approach - Definition of a
system-wide state transition machine - AGEDIS
semantic extension Accept and Reject state
signal1
signal2
signal2
signal1
22
4. Output from AGEDIS
obj1Class1
obj2Class2
envEnv

• Lots of sequences including
• Variations in work flows
• Variations in input data
• Variations in output data
• Summed up
• An abstract test suite
• Output format
• XML
• Details under discussion

put(1)Signal1
send(1)Signal4
receive(1)Signal4
get(1)Signal3
put(0)Signal2
get(0)Signal3
23
4. Bringing the test suite to life

• Testbeans
• GTC (Gotcha - TCBeans from IBM)
• Meta-Words (WinRunner Script based method from
  imbus)
• Your collection of black or white box test
  functions

24
4. Test Execution Engine

• Arbitrary GUI Test tools
• e.g. WinRunner (Mercury Interactive)

• Protocol interface driver
• customer tools

25
5. Other approaches

• StP/UML (Software through pictures, Aonix)
• template technology
• gt 50 source code generation
• j-UML (Extension for Java, VTT, Finland)
• Symbols for special Java features
• no tool
• xUML (Kennedy Carter)
• complete Action Language for source code
  generation
• Tool bases validation of design through test cases

26
6. Conclusion

• AGEDIS will reduce test specification and review
  effort
• The AGEDIS software derives test cases from UML
  diagram via test directives
• AGEDIS brings test documentation closer to
  development departments
• AGEDIS makes testing more complete
• AGEDIS makes testing more fun

27
Contact
Headquarter Erlangen/Moehrendorf imbus AG
Tel [phone]Kleinseebacher Strasse 9
Fax [phone] 91096 Moehrendorf
Email info_at_imbus.deGermany


Office Munich imbus AG Tel [phone]Unter
der Linde 16 Fax [phone] 80939 München
Email info_at_imbus.de Germany
Office Frankfurt imbus Rhein-Main
GmbH Tel [phone]Zanggasse 6
Fax [phone] 65719 Hofheim
Email info_at_imbus.deGermany
28
www.agedis.de
29
Download further information
30
Discussion and Newsletter