IE Report 2.1
IE Report 2.1
It ma
as sa
ing p
u
38
include institutional as well as individual employee's
problems. It may be desirable to locate problems in the
organization, such as safety problems and discipline
problems, and develop training programs with a view of
equipping the concerned employees with the knowledge,
skills, attitudes, and habits necessary to successfully meet
the problem situations.
1. Organizational plans
Looking into projected changes in mission,
structure, personnel, or procedures
2. Employee records
Looking into turnover rates,
absenteeism rates; sick leave notes,
accident severity and frequency ratios,
tardiness rates, grievances, composition of
supervisory force
7. Communication failures
8. Morale indicators such as complaints, buck passing
39
Tools Used in the Assessment of Training and
Development Needs
A. Interview
An interview reveals feelings, causes, and
possible solutions of problems as well as
facts. It extends maximum opportunity for
the expression of opinion and giving of
suggestions. Interviews are a must for the
training officer who would keep a finger on
the pulse of his company. They help him
understand how people feel and why. They
also manifest, in a personalized way, sincere
interest in what people in the organization
think.
Interviews can be informal such as merienda-time
discussion of office problems, or formal encugh to involve a
form on which a training officer writes. c.
B. Questionnaires
Written questionnaires are also useful
tools for gathering information from which
training needs may be derived. They give
employees an opportunity to express their
feelings anonymously, without any of the
embarrassment or anxiety which can
accompany the more personal techniques.
Well-designed, they yield data that can be
processed quickly.
Any questionnaire should be pre-tested
and revised as necessary for clarity,
adequacy of coverage, etc. Anonymity must
be safeguarded — and participants must be
confident that it will be safeguarded.
The Employee Attitude Survey is an
example of the questionnaire technique. Such
surveys usually include some questions
bearing directly on training, and answers to
other questions frequently produce
additional clues on training needs.
The Supervisory Improvement Needs
Survey technique appeals to many because
of its positive and constructive emphasis,
which gets the potential trainee thinking in
terms of what he wants to help him do a
better
40
job, faster or easier. Potential trainees are given a list of
possible training subjects, with a brief description of
content, and asked to indicate their top preferences.
The Slip Survey Technique is an interesting
questionnaire device in which potential trainees are
called together in groups, given cards or slips of paper,
and asked to record, as fast as the thoughts occur to
them, what they consider to be their greatest difficulty
on the job -— one difficulty per slip, expressed in "how
to" form, i.e. "how to discipline," "how to write a
report," etc. The slips are then collected, sorted, and
analyzed for training needs.
c. Tests
Tests are useful as diagnostic tools to identify
specific areas of deficiencies. They are also useful in
selecting from among potential trainees those who can
profit best from training. Tests of various kinds may be
used in determining training needs and once an area of
need has been found, in selecting the employees to be
trained. They can be especially helpful in determining
whether the cause of a recognized problem is a
deficiency in knowledge or skill or attitude.
Performance or achievement tests are essentially a
means of sampling what employees know or can do,
and can, therefore, help to locate areas in which more
information or more skill training is needed.
Aptitude tests indicate potential to learn or acquire
information or skills in a particular area, and so are
useful in selecting from among a group of employees
those who can most profitably be trained.
Practical tests in typing and stenography can
quickly establish an employee's need or lack of need
for training in those skills.
Trade information tests are used to determine levels
of knowledge and skill in a variety of occupations.
41
Group Problem Analysis
An excellent means of determining training
needs is the group problem analysis, wherein
supervisors, managers or executives analyze together the
problems of their organizations. Groups of managers in a
given department get together to discuss their problems
and to decide what changes are necessary to solve the
problem. Some of these changes may be accomplished
through training, others through other management
action.
42
duties. Locate significant areas which can be improved by
training.
The Critical Incident Technique is a job analysis and
performance evaluation device that places special emphasis
on kinds of behaviors that distinguish effective from
ineffective performance. The steps are as follows: First, list
only the major requirernents of the job, those that make the
difference between success and failure. Second, under each
of these write brief descriptions, usually in checklist form,
of observable onthe-job behavior. Third, let the supervisor
check the forms to record his observations of each
employee's behavior, adding whatever explanatory note he
feels necessary.
The Appraisal Panel Method is essentially a process of
supervisory obserVation and evaluation, supplemented by
the observations and evaluations of others who personally
know the appraisee and his work.
43
3. The nature of individual company operations.
The complexity of a company's operations has
a direct bearing on its training and development
programs. Bank institutions, automotive
manufacturing COm_ panics, service
organizations all have varied train_ ing
problenus. Training and development programs
have to be planned with this fact in mind.
4. Education patterns. The education patterns of a
country have a bearing on the design of a training
and development program. Due to a poor college
background of some employees, many companies
in the Philippines offer training seminars such as
technical report and business letter writing and
filing and records management. Another
interesting educational aspect in the Philippines is
the inclusion of new noncollege graduate workers
in the working force of many Philippine
companies who are desirous to finish their college
studies. A training and development program
which will facilitate for these employees the
acquisition of a college education is most
welcome.
44
9. Choice of programs. The design of training and
development programs should consider the choice
of programs if it is to be integrated with other
company activities and plans. These plans have a
direct bearing on the type of training that a business
firm will find necessary to undertake. Training
programs should be carefully planned and closely
related to company needs.
45
The design of a training program involves the
fol. lowing steps:
46
2. Determine a time factor for each subject, having
in mind the time which a person of average
intelligence would require to master the subject.
3. Give the initial training in fundamentals so
that the trainees' ability to complete the
program may be assessed.
4. Provide ample time for revision to consolidate
knowledge and tests to assess progress.
5. Link theory with practice. Follow explanation of the
necessary theory by immediate practical
application.
Step 5. Selecting and Preparing Instructional
Materials and Resource Speakers
Select and prepare training aids, textbooks,
manuals, and alle other instructional materials based
on decisions on course content and methods.
Instructional materials must be consistent with
trainees' ability, must emphasize the key elements of
the courSe, and must be effective in presenting
information and concepts.
Decide range of operations — what tools,
machines, and equipment are necessary. Design
progressive exercises making use of tools and
machines in the order of difficulty. Later exercises
should build on previous work and introduce use of
additional tools. Decide what, how, and when
workshop demonstrations are to be used. Drawings
should adhere to the accepted drawing conventions
used in the film.
Close liaison is necessary between the training
people and departmental supervision not only at the
planning stage but also in the implementation and
evaluation stages.
Step 6. Planning 'he
Lesson
Planning the lesson is actually putting down on
paper the things to teach and how to teach it.
47
Evaluating Training Programs
People in a company are very much aware that the co
of training and development programs, including direct, indi rect,
and hidden costs, represen ts a substantial monetary outla in the
firrn. Top management may ask: Do training and development
prograrns pay 011? Are they producing the intended results? How
do they show in the profit statement? What are their implications
in the indexes ofprofitability such as return on investment,
production, and sales volume? These questions are leads to the
importance of evaluating training and development programs.
B. Importance of Evaluation
In the Philippine setting, evaluation ofa training
and development program is of utmost importance in
order to attain top management's support. Evaluation
ensures that training and development programs
contribute to the fulfillment of organizational goals and
objectives. Furthermore, evaluation is important to
training directors and staff because it collects the data
needed to improve the effectiveness and efficiency of
every aspect of the
+raining and development system — personnel, facilities,
—a;cies, programme, and procedures. A well-
controlled training program is one in which weaknesses
and factors are identified and corrected by means of
negative feedback, and 8trengths and guccegses are
amplified by tnenns of positive feedback.
49
SPECIFIC:
D. Forms of Evaluation
Evaluation can take three forms which are as fol
lows:
1. Immediate form of evaluation measures, analyzes,
and interprets changes in job related knowledge,
skills, and attitudes of trainees.
50
3. Ultimate form of evaluation measures and analyzes
changes in results achieved by the trainees when
they return to their jobs.
E. Levels of Evaluation
There are five levels of training effects, which are also the
five levels of objective setting and evaluation. Total
evaluation of training involves these five levels:
Level I. Reactions
Reaction may best be defined as how well the
trainees liked a particular training and development
program. Evaluating in terms of reaction is the same
as measuring the feelings of the trainee.
The measurement of reactions to training
programs is the first step in the evaluation process. It is
important to determine how participants feel about
the program they attend because of these two reasons:
1. It is an accepted fact that trainees who enjoy a
training program/course are most likely to obtain
maximum benefit from it.
2. Management support to training is often dependent on
the feedback gathered from the trainees.
Level 11. Learning
The second level in the evaluation process involves
the measurement of the principles, facts, and techniques
which were understood and absorbed by the trainees.
61
Level V. Ultimate Value
Evaluation at this level attempts to relate the
ganizational evaluation to the ultimate criteria by which
the organization judges its efficiency and its success or
failure.
In business firtns, we call this as the cost-efficiency
level: "Are the financial benefits resulting from the train
ing greater than the financial cost of training?"
F. Methods of Evaluation
There are two broad systems of evaluation:
continuous and terminal evaluation. In continuous
evaluation, tests are applied throughout the whole
training process and are designed to measure
developing performance, over the whole period of
training. Terminal evaluation is assessing the
effectiveness of training at the end of the program.
Objective methods of evaluation are to be preferred.
However, they cannot be used unless they are
scientifically sound, administratively convenient, and
acceptable to management. Administrative convenience
and acceptability to management will often dictate
continuous evaluation rather than terminal evaluation
methods. Tests given as part of the training process can
be fitted into the programme. When objective
knowledge tests, tests of skills, and attitude scales
cannot be used, subjective methods should be ma'de as
objective as possible. Here are some guidelines when
using subjective methods:
1. The observer or interviewer must be well-trained;
2. His subjective judgments must be based on as much
factual material as he can collect; and
3. Whenever possible, his findings are compared with
those obtained by another skilled and independent
observer.
Specifically, we wish to present and elaborate on the
training evaluation method based on the five levels of
evaluation.
52
1. Reaction—level evaluation. Reactions are measured by a
seminar/course evaluation questionnaire designed to
obtain honest reactions to specific aspects of the training
progratn. The questionnaire should be 80 designed that
the reactions could be tabulated and quantified for easier
evaluation.
2. Learning—level evaluation. Evaluation in this level is
generally done through paper and pencil tests given prior
to training and after the training. This method makes use
of true or false, multiple choice exams, matching items,
or •sentence completion tests. Scores garnered before the
training are compared with those obtained after the
training. Statistical analysis is then used to find out if
there is a significant increase in the trainee's knowledge,
skill or if there is a significant positive change in their
attitudes.
Another commonly used method of evaluating
learning makes use of a questionnaire or attitude/opinion
survey wherein trainees appraise the learning they
obtained from the training. Using scales, trainees are
asked to indicate the amount of learning they had before
and after the training. Data are then treated statistically
to determine whether a significant change in the amount
of knowledge, skill, and proper attitude occurred as a
result of the training or not.
53
Observation can be done externally or internally.
Ex_ ternal observation tna.y be achieved through activity
sampling or through the use of observer diaries. Internal
observation can be obtained by self-observation making
use of self diaries.
Questionnaires or interviews are widely used as a job
behavior evaluation tool. Attitude change can be
measured in a training program by questionnaires and
attitude surveys before and after the training and by
discussion with the trainees who reflect their attitudes
directly in the trainer and in their supervisors.
Another source of job behavior evaluation data are
records and reports of production, performance
appraisal, accident, etc.
4. Organizational—level evaluation. Many
organizational effects can be evaluated by techniques
similar to those used at the job behavior level.
Organizational evaluation is often concerned with the
effect of the trainees' changes in job behavior on the
attitudes and job behavior of other employees who
have not themselves been formally trained.
As in the job behavior level, evaluation in the
organizational level may be achieved through
observation or making use of questionnaire/interview.
5. Ultimate value—level evaluation. Ultimate value
evaluation is usually concerned with financial and
economic evaluation. In this level, the cost of training
is compared with the financial gain resulting from the
training costbenefit analysis of training. This
comparison can be achieved in training courses
wherein financial benefits have been operationally
defined in the objective setting phage.
Using results achieved by managers, supervisors,
and workers is a strong basis for evaluating the
effectiveness and efficiency of training and
development pro-
54
grammes. However, there are so many variables
involved that fair appraisal solely on the basis of
analysis of productivity indexes is difficult. Evaluation
in the ultimate value level is concerned with two
questions:
I. How well did our training and development perform in
meeting its objectives?
2. Is the result attributable in fact to the training and
development program?