FINDING TEST DATA on THE WEB

1
FINDING TEST DATA on THE WEB
CENTRE FOR RESEARCH ON EVOLUTION SEARCH  TESTING

• By Mustafa Bozkurt Mark Harman
• Astranet Workshop on Web Service and Testing
• Kings College London

2

• In order to generate test cases test data is
  needed
• Generating real life data is hard
• Techniques used in data generation
• Using existing test cases
• Using databases
• Recorded user sessions

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
3

• "Web services are not yet widely used because of
  security
• concerns. But there's an even bigger roadblock
  waiting just
• down the road -- it's called trust. The big issue
  is 'Will the
• service work correctly every time when I need
  it?' As yet few
• are thinking about the issues of testing and
  certification. We
• suggest that testing and certification of Web
  services is not
• business as usual and that new solutions are
  needed to
• provide assurance that services can really be
  trusted."
• 
  -- In CBDi Forum, 11 Jul 2002

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
4

• Testing web services is difficult because
• web services are distributed
• numerous runtime behaviors
• involves multiple standard protocols
• service subscriber only gets WSDL specifications
• multiple web services are involved, selected, and
  executed

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
5

• Fortunately, we can also derive testing benefit
  from the existence of web services.
• How?
• Web Services are ready source of test data

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
6

• OWL-S is an ontology built on top of Web Ontology
  Language (OWL)
• Development of OWL-S aims to enable the following
  tasks
• Automated Web service discovery
• Automated Web service invocation
• Automated Web service composition and
  interoperation

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
7

• The OWL-S ontology has three main parts
• The service profile
• The process model
• The service grounding

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
8
OWL-S Process Model
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
9
Example OWL-S process taken from Congo.com
example Available at http//www.daml.org/services
/owl-s/1.0/examples.html
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
10

• The proposed system generate test cases using
• OWL-S process model
• Existing semantic web services
• Test inputs may require multiple web services
  output and existing data.

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
11
System Architecture
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
12

• Pellet - An open-source OWL-DL reasoner
• Opossum - Semantic Web Service Search Engine
• OWLSM - An OWL-S Matcher
• OWLS-MX - Semantic Web Service Matchmaker
• WSMO-MX Matchmaker - WSMO Matchmaker

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
13

• Issues with the proposed technique
• Matchmaking problem
• Input for output problem
• Type inconsistencies
• Semantic issues

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
14

• BPEL/BPMN testing
• Automated regression testing
• Fully automated testing
• QoS rating

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
15
Applying Search Based Techniques to WS Testing
Verifying the Functional Behavior of Modules
(Tracey 2000)
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
16

• How do we define failure
• pre-condition
• negated post condition
• n gt 0 and n lt 10 and n lt 10 r !
  n1
• n gt 0 and n lt 10 and n 10 r ! 0

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
17
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
18
distance ( n gt 0 ) and distance ( n lt 10 ) and
distance ( n 10 ) and distance ( r ! 0 )
Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
19

• Metaheuristic search techniques (Tracey et. al
  ISSTA98)
• GAs, Simulated Annealing,
• Logical behavior of a system.
• Pre and post conditions form the constraint
  system
• Conversion of the constraint system to DNF

Finding test Data on the Web by Mustafa Bozkurt
Mark Harman
20
Thank You

• Finding Test Data on the Web
• Mustafa Bozkurt
• http//www.dcs.kcl.ac.uk/pg/mustafa/
• Mark Harman
• http//www.dcs.kcl.ac.uk/staff/mark
• CENTRE FOR RESEARCH ON EVOLUTION SEARCH TESTING
• http//crest.dcs.kcl.ac.
  uk/