Organizational Level
Test Policy
Programme Level
Test Strategy
Project Level
Test Plan
Test Procedures & Test Cases
Test Reports, Issue Reports
Other Test Work Products
Testing involves the creation of a number of other work
products and most of these work products are produced by
Test Analysts and Technical Test Analysts:
defect reports
test case specifications
test logs
The Test Manager should ensure consistency and quality
of these work products through the following activities:
Establishing and monitoring metrics for the quality of
these work products (percentage of rejected defect
reports, etc.)
Working with the Test Analysts and Technical Test
Analysts to:
select and customize appropriate templates for the
work products
establish standards for these work products (degree
of detail necessary in tests, logs, and reports)
Reviewing testing work products using the appropriate
techniques and by the appropriate participants and
stakeholders
Testing also involves the creation of test results reports,
which are typically produced by the Test Manager and
are described later in this book.
The extent, type, and specificity of test docs can be
influenced by:
the chosen software development lifecycle
applicable standards and regulations
the product quality
project risks associated with the particular system being
developed
There are various sources of templates for testing work
products such as IEEE 829 [IEEE829]:
designed for use in any industry
contain a high level of detail that may or may not be
applicable to a particular organization
It is a best practice to tailor the IEEE 829 documents to
create standard templates for use in a particular
organization. The consistent application of the templates
reduces training requirements and helps to unify processes
across an organization.
Example - When and What to use:
Acceptance
System of Systems
System Integration
System
Component Integration
Component
g
n
tr
c
tr
o
r
e
e
a
o
e
o
p
p
lP
p
S
S
S
e
ts
e
ts
R
e
R
e
n
sa
ru
e
T
g
tn
T
y
i
d
s
ra
e
e
e
e
tI
d
ts
m
D
i
o
c
e
m
se
rP
n
ts
u
e
S
ts
t
T
s
e
ts
T
e
T
Example - Test Design
Shall have the following structure:
Identifier
Features to be tested
Approach refinements
Test Identification
Features pass/fail criteria
Example - Test Case
Shall have the following structure:
Test Case Spec Identifier
Test item
Input specification
Output specification
Environmental needs
Special procedural requirements
Intercase dependencies
Example - Test Item
Shall have the following structure:
Transmittal report identifier
Transmitted items
Location
Status
Approvals
Example - Test Log
Shall have the following structure:
Test Log identifier
Description
Activity and event entries
Example - Test Incident Report
Shall have the following structure:
Test Incident Identifier
Summary
Incident Description
Impact
Inputs
Expected results
Actual Results
Anomalies
Date and Time
Procedure Step
Environment
Attempts to repeat
Testers
Observations
Example - Test Summary Report
Shall have the following structure:
Test Summary Report Id
Summary
Variances
Comprehensive assessment
Summary of results
Evaluation
Summary of activities
Approvals