Evaluating
Designs detailed and relevant testing methods, which generate data, to measure the success of the solution
Tests that could be tried include:
Expert Appraisal – Field Trial – Performance Tests – User observation – User Trials
Qualitative tests can include: Quantitative tests can include:
• using a questionnaire to find out if the target audience likes • timing users who are tasked with finding a particular piece
the look of a product of information on a website
• surveying students to find out which parts of a video game • measuring a product to ensure it is the correct size and
they found too easy and which were too difficult within weight limits
• working with a taste panel to find out if a target audience • beta-testing interactive media to find bugs
likes a food product • running performance tests to determine the strength of a
• interviewing an expert after he or she has interacted with a product
solution • checking the capacity of a storage device
• performing a user trial by giving a toy to children to play • counting the number of hits on a website over a set period
with and observing reactions. of time.
Specification Testing Method Evidence from Test
EXAMPLES of Testing Methods
Expert appraisal
A person considered an expert in the use of similar products is presented with the solution, given time to interact with the solution
and then interviewed on aspects of its success. The expert has particular knowledge and skills that allow him or her to make
judgments on the success of the solution. The expert may be the client.
Field trial
A field trial is a test of the performance of a solution under the conditions and situation in which it will be used. For example, an
interactive information point (developed in HTML) for a museum exhibit may be tested by the exhibit visitors in the museum,
structured as a user trial or user observation.
Performance testing
The performance of a solution is tested under the conditions in which it would normally be used. Quantitative data is collected
through a variety of tests such as:
• destructive tests assessing impact strength or flammability
• cyclic tests
• measurement of physical properties such as weight and size
• timed tests for web pages to load
• ease of navigation through an interactive story, game or website.
User observation
The user is presented with the solution and is set a task to achieve with little or no guidance. The user’s interaction with the solution
is observed and recorded.
User trials
The user is presented with the solution and guided on how to use it. The user is asked questions as he or she interacts with the
solution or is given a survey to complete. User trials may include focus groups.
The design of interview or survey questions needs to be targeted to draw out responses that assess the solution against the
specification.
EXAMPLE - Comparing the Product Against Existing Products in the
Marketplace and Noting Strengths and Weaknesses
EXAMPLE - Feedback from Users