Title: Each Test Set can be run as many times as you want, result
1 Applied Testing and Technology
- Management for
- Manual Software Testing
- www.aptest.com/atm2
2Overview
- Manages and tracks testing status and results
- Provides consistent, repeatable QA process
- WWW based
- Persistent information repository
- Integrated requirements management
- Extensive reporting
- Role-based security
- Highly flexible and customizable
3QA Testing Challenges
- Process inconsistent and is not repeatable
- Personnel turnover loses knowledge
- Time consuming and difficult to
- monitor progress
- measure productivity
- assess quality
- share information
4The ApTest Manager Solution
- Consistent, repeatable process
- Permanent information store
- Real time access to tests, results, status
- Geographically distributed users
- QA, customers, development, . . .
- Test method and tool neutral
5ApTest Manager Benefits
- Higher product quality
- Better tests, better coverage, better process
- Find and fix bugs sooner in the development cycle
- Shorter projects at a lower cost
- Improved, measurable productivity
6Manage Manual/Automated testing
Requirements Test Cases
Manual Testing
Reporting
Test Results
Automated Testing
7Requirements Repository
- User defined tree of FoldersAs deep and wide as
you want - Folders contain Requirements and Files
- Requirements fields totally configurable. As many
fields as you want menu fields, text fields,
date fields, tables, etc. - Requirement names can be strings or automatically
assigned numbers
8Test Repository
- User defined tree of FoldersAs deep and wide as
you want - Folders contain Test Cases and Files
- Test Case fields totally configurable. As many
fields as you want menu fields, text fields,
date fields, tables, etc. - Test Case names can be strings or automatically
assigned numbers
9Link Requirements and Tests
- Tests can be linked to Requirements in any
relationshipOne-to-one, many-to-one, and
one-to-many - Tests can be automatically created and linked to
Requirements
10Execution
- Unlimited number of different groups of tests
(Test Sets) - Created by querying test characteristics e.g.
the tests for a particular version or feature. - Each Test Set can be run as many times as you
want, results stored separately for different
test environments (Test Sessions)
11Typical Project
- Reqs Tests Sets
Sessions -
test subsets execution results -
-
. . .
. . .
12Customization
- Easily customized
- What fields make up a Test Case
- Name, Format, Default Value
- How a Test Case is displayed
- Editing, Executing, Reporting
- Session Variables
- Characterize test environment H/W-S/W
- Design your own gold standard configuration
13Reports
- On part or all of a project composed of different
Sets and Sessions - Status done, results, vs. schedule
- Coverage of test cases
- Productivity of users
- Compare Sessions
- On specific sessions
- Custom queries can be defined and saved
14Integrates with Existing Tools
15Test Repository
- Tree of folders of tests
- Create
- Edit
- Copy
- Rename
- Delete
- View
16Test Editing
- Field Types
- Menus
- Text Areas
- Tables
- Field Styles
- WYSIWYG HTML Editor
- Text
17Requirements Repository
- Tree of Reqs
- Create
- Edit
- Copy
- Rename
- Delete
- View
18Repository Reports
- Test Requirements Reports
- Test Specification Reports
19Test Execution
- Run specificgroups of Tests (Test Sets)
- Run them inspecific TestEnvironments(Test
Sessions)
20Test Execution
- Any number of Test Sets (subset of Test Cases for
different test cycles, product versions, etc.) - Any number of Test Sessions, each recording the
execution of a Test Set (in a different H/W-S/W
environment). - Test Cases only need be defined once, so easily
maintained and evolved
21Test Set
- Group ofTest Cases based onan ad hocquery
ofTest Casefield values
22Test Sets
- Queries select different groups of tests
23Test Session
- Results ofrunningTest Casesfor a Test Set
- SessionVariablesspecify testenvironment
24Test Sessions
- Session Variables tag the session with info on
where and how it was run. e.g. O.S., browser,
hardware, product version, tester, . . . - You can search for and report on Sessions based
on a variety of criteria, including session
variables, e.g. compare the results of all the
Sessions run on Windows XP with Oracle.
25Test Execution
- Tester is given
- Requirements
- Procedure
- Tester enters
- Test result
- Time spent (optional)
- Notes
26Reports
- Are generated for one or moresessions
- Sessions can beselected with ad hoc queries
27Status Report
- Multiple sessions
- Complete
- Time remaining
- Trends
- Result Details
- Links to persession reports
28Users Report
- Results
- Productivity
- Schedule analysis
29Results Report
- Test Case detailsand results
30Regression Report
- Multiple Sessions
- ComparesResults
31Coverage Report
- Coverage ofTest Casesby Sessions
- Can createTest Sets of uncoveredTest Cases
32Configuration
- Specify Test Case Fieldsand their formats
33Configuration
34Configuration
- Specify how a Test Case is displayed for
editing,execution, reports
35Configuration
36Security
- Password protected accounts
- Access controls per user by Test Suite
37Security
- Admin functionscontrolled by admin users
38Email Notifications
- Per User,Per Suite
- Multiple event triggers
39Other Features
- Integrates with third-party tools
- Bug tracking
- Source control
- Import and Export Test Cases and Requirements via
CSV files (e.g. from Excel spreadsheets) - Import of automated test results from test
harnesses
40Support Maintenance
- Multiple releases annually
- Bug fixes
- Enhancements
- Updated OS, browser and server compatibility
41Whats Coming Up
- ApTest Manager Automation Edition
- Adds Test Automation support
- Scripts can be associated with tests and executed
over your network - Results stored and reported with manual tests
- Separately priced add-on
42System Requirements
- Windows, Linux, or MacOS
- Perl
- Web Server, e.g. Apache, IIS
- Server of moderate size (e.g. 2.8GHz P4)
- Server does not have to be dedicated
43Licensing/Pricing
- Purchase and run on your server
- Per Seat floating licenses. Number of Seats
limits number of logged in users. - seats /seat discount 1-5
500 n/a 6-10 475
5 11-15 450 10 16-20
425 15 21-30 400
20 31-40 375 25 41-50
350 30 51 call factory
- Can add more licenses at any time
- Support 100/seat/year
44Licensing/Pricing
- As a service, hosted on our servers
- For short term projects
- High up time, fast connections
- 45/user/month, 200 set up fee
- Support included
45Performance
- ApTest QAs the product
- With Test Suites containing 30,000 tests
- With 100 concurrent users
46What customers say
- We love the use of your software, it's doing a
lot to streamline our software development cycle.
This is a great product. - The support you offered has been magnificent, far
better than I have seen from your competitors. I
have been thoroughly impressed. - AP Test Manager is a good product and I base this
opinion on my 20 plus years in RD, test
management and testing. - I've gotten good responses from the users - they
really like the tool.