Business Process Testing

1
Business Process Testing

• Johan Adriaansen
• April 3rd 2008

IT_at_CORK - Business Process Testing April 3rd 2008
2
Agenda

• Introduction
• Top 3 Reasons why Automation Fails
• Why bother? Why Automate?
• Traditional Test Automation Approach
• Business Process Testing
• Examples
• Questions

IT_at_CORK - Business Process Testing April 3rd 2008
3
Introduction

• 10 years of Test Automation experience
• Consultant
• Design Business Process based automation
  solutions
• Citco Performance Automated Testing Group

IT_at_CORK - Business Process Testing April 3rd 2008
4
Top 3 Reasons why Automation Fails

• Unrealistic Expectations
• Maintenance Nightmare
• Lack of Support

IT_at_CORK - Business Process Testing April 3rd 2008
5
Unrealistic Expectations

• Management
• Cost
• Effort
• Silver Bullet
• No patience

IT_at_CORK - Business Process Testing April 3rd 2008
6
Maintenance Nightmare

• Reliance on single person
• Not transparent
• Not scalable
• 1000 tests ? 1000 scripts
• Repetitive code
• Large applications
• Many builds / short timelines
• RAD / Agile

IT_at_CORK - Business Process Testing April 3rd 2008
7
Lack of Support

• Awareness
• Test Environment
• Tooling
• Test Data
• Hardware
• Business knowledge

IT_at_CORK - Business Process Testing April 3rd 2008
8
Why bother? Why Automate?

• Growing functionality
• Short timeframe
• Can save time and money
• reduces involvement of valuable specialists
• it can consolidate a structured way of working
• Clean / Repeatable process
• Its fun

IT_at_CORK - Business Process Testing April 3rd 2008
9
Traditional Automation Approach

• Record Playback
• poke and hope
• Requires stable application
• Fast ramp up
• Not suitable for applications without UI

IT_at_CORK - Business Process Testing April 3rd 2008
10
Traditional Automation Approach

• Production Line
• Many / very similar scripts
• Not searchable
• What scripts are affected by application changes?
• Maintenance Nightmare
• Prototyping

IT_at_CORK - Business Process Testing April 3rd 2008
11
Business Process Testing

• First developed in 1994
• AEX
• Calculations
• Actionword Based Testing
• Hans Buwaldawww.happytester.com
• Large scale use
• HP BPT
• Industry, government, finance, publishing,
  telecommunication

IT_at_CORK - Business Process Testing April 3rd 2008
12
Business Process Testing

• Split How What to test
• Test Analysis ? Creating Tests using limited
  number of Business Processes
• Test Navigation ? Creating automated scripts for
  each Business Process

IT_at_CORK - Business Process Testing April 3rd 2008
13
Test Analysis

• The WHAT
• Requires business knowledge
• SMEs
• No application required
• Risk Based
• Readable
• Non technical
• Spreadsheets
• Tools / macros

IT_at_CORK - Business Process Testing April 3rd 2008
14
Test Navigation

• The HOW
• Technical
• Little / no business knowledge required
• Developers
• Requires application
• Programming functions
• SDE
• Off-shoring

IT_at_CORK - Business Process Testing April 3rd 2008
15
The Engine

• Standard Module
• Reads Excel sheets
• Calls automated functions
• Reporting
• Error handling
• Keep Refer
• Manage Test Data
• Reusable asset
• Keep it simple
• Integration with Test Management tools

IT_at_CORK - Business Process Testing April 3rd 2008
16
Example 1

• 1 of World largest petrochemical companies
• Consolidation of applications
• 2000,
• Team of 20 testers
• 2 Automation engineers

IT_at_CORK - Business Process Testing April 3rd 2008
17
Example 1

• Very little system documentation available
• All tests in BPT format
• Reviewed pre execution
• Results signed off
• Stored
• Mainframe ? WEB
• gt75 automated
• signature Business Process
• 1 code ratio

IT_at_CORK - Business Process Testing April 3rd 2008
18
Example 1
IT_at_CORK - Business Process Testing April 3rd 2008
19
Example 2

• Short Message Service Centre
• Open VMS / UNIX
• Terminal Emulator
• Excel macro
• HLLAPI
• Minimal cost

IT_at_CORK - Business Process Testing April 3rd 2008
20
Example 2
IT_at_CORK - Business Process Testing April 3rd 2008
21
Example 3

• SmartNet
• Tactical Access Unit
• ATM switch
• Radio / Ethernet / Intercom / ISDN
• MMI
• Highly configurable

IT_at_CORK - Business Process Testing April 3rd 2008
22
Example 3

• Nothing to record
• First 5 months
• Stub development
• Framework development
• Test case creation
• 1000x faster execution
• CMM Level 3

IT_at_CORK - Business Process Testing April 3rd 2008
23
Example 3
IT_at_CORK - Business Process Testing April 3rd 2008
24
Lets Compare

• Planning
• Scalability
• Platform independency
• Transparency
• Shared responsibility
• Outsourcing
• Ease of maintenance

IT_at_CORK - Business Process Testing April 3rd 2008
25
Questions?
IT_at_CORK - Business Process Testing April 3rd 2008