Selecting a Testing Tool by Clemente Beltran

1
Selecting a Testing ToolbyClemente Beltran
2
Agenda

• How to select a tool?
• What is available on the market?
• Commercial vs. Open-Source
• Selection process
• What is the best tool?
• QA

3
How to select a tool?

• Requirements
• Tool Scope
• Development Environment
• Leading Edge vs. Legacy
• Investment
• Long term use of tools
• Maturity (Are you ready to automate?)
• Human Resources

4
How to select a tool?

• Tool Scope
• Project specific
• Company wide implementation
• Project then company wide

5
How to select a tool?

• Development Environment
• Do you have legacy applications?
• Do you have projects with the latest
  technologies?
• Are you working with leading edge technology?
• Would you need support on emerging technologies?

6
How to select a tool?

• Leading
• Technologies
• Web
• Java
• .Net
• Web Services
• Siebel
• SAP
• Oracle

• Legacy Apps
• Delphi
• PowerBuilder
• Terminal Emulator
• Visual Basic

Testing Tool
7
How to select a tool?

• Investment
• Tool price
• Development
• Framework development
• Hardware
• Maintenance
• Training

8
How to select a tool?

• Long term use
• Are you planning to use this tools for many
  years?
• Would you use the tool in multiple projects?
• Will the supplier be around supporting your
  investment?
• What is the complexity factor/risk to upgrade to
  new versions?

9
How to select a tool?

• Maturity
• Is your organization ready to automate?
• Do you have the testing infrastructure required
  to automate?
• Is your application ready for automation?
• What to automate?

10
How to select a tool?

• Human Resources
• Automated Testing experience
• Programming experience
• Business experience

11
How to select a tool?

• Tool Checklist
• Environment Support
• Programming Language, ease of use, skills needed
• Validation Methods
• Data Management
• Unsupported controls objects workarounds
• Reusability (libraries other shared resources)
• Reusability resources management
• Advance Features

12
What is available onthe market?

• Commercial Software
• Borland
• SilkTest SilkPerformer
• Compuware
• TestPartner QALoad
• Empirix
• e-Test e-Load
• HP
• QuickTest Professional LoadRunner
• IBM
• Rational Robot Functional Tester
• Parasoft
• JTest WebKing

13
What is available onthe market?

• Open Source
• Abbot Costello
• BadBoy
• Dogtail (Phyton)
• MaxQ (Phyton)
• Marathon (Jython)
• LogiTest
• Selenium

14
Commercial Vendors vs Open Source

• Vendor investment
• Dedicated support staff
• Third party partnerships
• Training availability

• Cost
• User community development
• User Community Support
• Tool Language

15
Selection Process

• Finalize requirements
• Review long term plan
• Perform a Proof of Concept (technical validation)
• Evaluate tool use (data entry, test automation,
  data management, etc..)
• Review implementation plan with tool capabilities

16
What is the best tool?

• No Magic Solution out there
• No tool solves all the problems
• No tool works all the time out-of-the-box
• Any tool requires planning, infrastructure and
  design
• Any tool will eventually need users with
  programming experience to develop workarounds
• Growing pains are inevitable

17
What is the best tool?
Answer

• Matches most of your technical requirements
• Provider will be in business for sometime
• Good Technical support
• Large user community
• Code reusability features
• Test Data management capabilities
• Ease of use

18

• Questions