Unit 13
Unit 13
DATA COLLECTION
Structure
1 3.1 Introduction
13.2 Objectives
13.3 Tools of Data Collection
13.3.1 Questionnaire
13.3.2 Rating Scale
13.3.3 Attitude Scales
13.3.4 Check List
13.3.5 Tests
13.3.6 Inventory
13.4 Techniques of Data Collection
13.4.1 Interview
13.4.2 Observation
13.5 Documents
13.6 Characteristics and Criteria for Selection of a Good Tool
13.6.1 Validity
13.6.2 Reliability
13.6.3 Objectivity
13.6.4 Adequacy
13.65 Usability
13.6.6 Discriminating Power
13.6.7 Interest
13.7 Let Us Sum Up
13.8 Unit-end Activities
13.9 Point for Discussion
13.10 Suggested Readings
13.1 1 Answers to Check Your Progress
13.1 2 Glossary
13.1 INTRODUCTION
In order to get relevant and adequate data it is necessary to use appropriate data
collection device(s). The data-gathering devices that have proven useful in educational
research include tools e.g. psychological tests and inventories, questionnaires,
opinionnaires, checklists, rating scales and techniques, namely, observation, interview,
sociogram, content analysis and guess-who techn.+e. A researcher dspending upon
the nature of the research may select one of these devices or may e~hploya number
of them in combination. But before selecting the devices, it is also necessary for a
researcher to develop skill in constructing the required devices and using them
effectively.
In this Unit we have made an effort to familiarize you with some of the datacollection
devices.
43
Research Design
On the completion of the study of this Unit, it is expected that you will be able to:
state the meaning of a Questionnaire;
describe the types of a Questionnaire;
explain the characteristics of a good questionnaire;
identify the advantages and limitations of a questionnaire;
state the meaning of a Rating Scale;
describe the types of a rating scale;
explain the requirements of a good rating scale;
identify the advantages and limitations of a rating scale;
define an Attitude scale;
describe the types of attitude scale;
explain the characteristics of a good attitude scale;
identify uses and limitations of an attitude scale;
, state the meaning of a Check List;
describe types of check list;
identify uses and limitations of a check list;
define a test;
describe various types of a test;
explain basic characteristics of a standardized test;
state the meaning of Interview technique;
explain the types of interview;
describe the process of interview;
identify the advantages and limitations of interview;
state the meaning of Observation technique;
explain the types of observation;
describe the process of observation;
identify the advantages and limitations of observation; and
decide the criteria for selection of a good tool of data collection.
133.1 Questionnaire
A questionnaire is an important instrmnent in normative-sorvey research, being used
to gather information from widely scattered sources and also used when factual
i n f o d m is desired,
Meaning -1s mnd Techniques
of Data Collection
Barr, et.al(1953), define questionnaire as "a systematic compilation of questions that
are submitted to a sampling of population from which information is desired". Its
scope is very vast. It has been used for studying a wide range of problems.
Limitations
1. Its reliability and validity is low. It seeks secondary information concerning facts
when primary evidence is not at hand.
2. Frequently questionnaireresearch constitutes simply a pooling of ignorance. It is
compilation of the opinions of many persons who may not know the answer.
3. It gives a biased sample. The matter of non-response is always a big question
mark.
4. The respondents who return the questionnaires may not constitute a representative
section of the entire group.
5. If the subject misinterprets a question or gives an incomplete or indefinite response,
nothing can be done.
6. A questionnaire is more or less rigid in its structure about complex emotional
subjects.
7. Some respondents may not like to put their views on controversial issues in writing.
8. The behaviours, gestures, reactions, emotions of the respondent remain unnoticed.
9. Some of the research areas are so delicate, sensitive and confidential in nature
that it becomes difficult to frame questions on them.
10. The questionnaire cannot be used with illiterate subjects and children.
Meaning
"Rating is a term applied to expression of opinion or judgement regarding some situation,
object or character. Opinions are usually expressed on a scale of values. Rating
techniques are devices by which such judgements may be quantified - Barr, et. al
(1953), Rating scale is a device for obtaining judgements of the degree to which an
individual posseses certain behaviour traits and attributes not readily detectable by
46
objective tests. A rating scale consists of a set of characteristics or qualities to be Tools and Techniques
of Data Collection
judged and some type of scale for indicating the degree to which each attribute is
present. Descriptions of different degrees of quality are arranged along a line from
high to low and this line is the scale.
47
Researcl~Design 2. Number of divisions on the scale should be neither too numerous nor too few.
Optimum number of divisions is perhaps five to seven.
3. The rater may be asked to quote instances in support of his judgement.
4. Rater should be instructed to omit ratings of characteristics, if he had no
opportunity to observe the traits.
5. The rater should be instructed to avoid the generosity and the logical error and
the error due to halo effect.
6. Rating from several observers should be combined wherever possible.
7. The directions should be clear and comprehensive.
8. Items may be arranged in ascending or descending order from left to right.
9. Well informed and experienced persons should be selected for rating.
10. The number of characteristics to be rated should be limited.
I 1. In the rating scale card, some space may be provided for the rater to write some
supplementary material.
49
Hesearch Design
2. State different types of a questionnaire and a rating scale.
................................................................................................................
................................................................................................................
................................................................................................................
3. In case of a questionnaire and a rating scale mention one major advantage and
one limitation.
................................................................................................................
................................................................................................................
................................................................................................................
Meaning
Allport attempted to glean from the various definitions and arrived at three common
features -
a) preparation or readiness for favourable or unfavourable responses.
b) which is activated in the presence of all objects and situations with which the
attitude is related.
As per Barr, et. a1 (1953) - "An attitude may be defined as a learned emotional
response set for or against something".
Thrustone (1929) defines attitude as the degree of positive or negative affect associated
with some psychological objects. By a psychological object, he means any
institution,ideal, symbol, phrase, slogan, job or idea towards which people can differ .
with respect to positive or negative affect. The attitude is a personal disposition which
impels an individual to react to an object, situation or proposition in favourable or
unfavourable ways. For an attitude, there is continuous extending from favourableness
through neutral to unfavourableness.
1) Likert Scale
Likert scale consists of a series of statements all of which are related to a person's
attitude towards a single object (e.g. -attitude toward school). Two types of statements
appear on Likert scales.
50
The first type of statements whose endorsement indicates a positive or favourable Tools and Techniques
I
i) of Data Collectiun
attitude toward the object under consideration (called as favourable statements).
ii) The second type includes statements whose endorsement indicates a negative or
unfavourable attitude toward the object (called as unfavourable statements).
Equal number of favourable and unfavourable statements are included in a Likert
scale.
3) Thurstone Scale
Thurstone's technique is also known as the technique of equal appearing intervals. If
attitude is accepted as a uni-dimensional linear continuum, then Thurstone's proposal
to measure it by statements scaled by the method of equal-appearing intervals would
apply.
13.3.5 Tests
With the help of tests we can collect quantitative data in research. There are different
type of tests. It was the English biologist, Sir Francis Galton, who was primarily
responsible for launching the testing movement. In an article written by Cattell in 1890
,the term 'mental test' was used for the f m t time. Psychologicaltesting is arelatively
young bfanch of one of the youngest of the sciences.
What is a Test ?
A Test is a systematic procedure for observing a per~on'sbehaviour and describing it
with aid of a numerical scale or a category system. A PsychologicalTest is essentially
an objective and standardized measure of a sample of behaviour.
'Qpes of Tests
Tests are classified in different ways.
Classificationof Tests
I I
By function By nature BY
Procedure of
Administration
i)
I
Group tests
(achievement & ii) Power tests ii) Individual tests
diagnostic) iii) Verbal tests
ii) Personality tests iv) Non-verbal tests
iii) Aptitude tests v) Performance tests
vi) Standardized tests
vii) Criterion-referenced tests
viii) Culture fair tests
ix) Adapted tests
55
Research Design Let us now understand the meaning of this classification. We will also get information
about various tests in details.
1. Classification of the Tests as per their Nature
Depending upon what a test aims to measure the tests are classified into one group.
(i) Educational Tests - Certain types of tests are developed for use in educational
context. They include achievement tests and diagnostic tests.
Achievement tests are designed to measure the effects of a specific programme
of instruction or training. An achievement test measures the effects of relatively
standardized sets of learning experiences. It generally represents a terminal
evaluation of the individual's status on the completion of an instructional programme
or training. An achievement test measures developed abilities/skills.
Diagnostic tests are designed to analyze individual specific strengths and
weaknesses in a subject and to suggest causes of hislher difficulties.
In connection with the use of all diagnostic tests , one point deserves special
emphasis . The diagnosis of the learning disabilities is the prerequisite for a
programme of remedial teaching.
(ii) Personality Tests -These most often refer to measures of affective aspects of
behaviours such as emotional states, interpersonal relations, motivation, interests
and attitudes. A personality test could be a self report inventory, a situational test
or the third approach could be the application of projective technique.
(iii) Aptitude Tests -These measure the effects of learning under relatively (in
comparison with achievement tests) uncontrolled and unknown conditions. They
include general intelligence tests, multiple aptitude batteries, special aptitude tests
(e.g. creativity tests) etc.
Intelligence tests are designed to measure the intelligence of an individual. Here, we
must bear in mind that intelligence is not a single, unitary ability but a composite of
several abilities. The term is commonly used to cover a combination of abilities required
for survival and advancement within a peculiar culture. (e.g. Stanford Binet test of
intelligence)
Multiple Aptitude batteries yield a profile of test scores in set of relatively independent
abilities identified through factor-analysis. One of the most widely used multiple Aptitude
batteries is Differential Aptitude Test. This DAT yields scores on eight abilities -
Verbal reasoning, Numerical ability, Abstract reasoning, Clerical speed and accuracy,
Mechanical Reasoning, Space relations, Spelling and language Usage.
Creative Aptitude Batteries have been produced at University of Southern California
by J.P. Guilford & his colleagues, and 'Tests of Creative Thinking' by Paul Torrance.
2. Classification of the Tests as per their Nature
(i) Speed Tests are those tests which contain such items which are of somewhat
equal difficulty value. To solve the tests the time limits are very much fixed. e.g.
our usual school/college tests.
(ii) Power tests are those tests which contain items of different difficulty value
arranged in increasing order of difficulty value . For such tests time limit is not
fixed, it is flexible.
(iu) Verbal Tests include question answer pattern in the form of 'words'. Such verbal
tests can be either paper pencil (written) tests or oral tests.
(iv) Non-verbal Tests necessarily contain items in the figural or symbolic form i.e.
other than 'words'. Raven's Progressive Matrices Test is a non-verbal test.
(v) Performance Tests require some action on part of the respondent as histher
response. Bhatia's Intelligence test is a performance test.
56
Tools and Tkchniqucs
(vi) Standardized Tests imply uniformity of procedure in administering and scoring of Data Collection
the tests. Another important aspect of standardized tests is the establishment of
norms, reliability and the validity of the tests.
I (vii) Criterion referenced Tests have been contrasted with the usual norm-referenced
t tests in which an individual's score is interpreted by comparing it with the scores
I obtained by others in the group on the same test. Unlike in a norm-referenced
test, in a criterion referenced test an individual's score is interpreted by comparing
it with an external criterion e.g. '80x80 mastery level'.
(viii) Culture fair Tests presuppose only such experiences that are common to different
cultures. The terms 'culture-fair', 'culture-common', and 'cross-cultural' are
used synonymously and have replaced the term 'culture-free'.
(ix) Adapted Tests are the versions of the tests standardized in other countries in
dissimilar cultures and modified to suit the culture under consideration.
..............................................................................................................
..............................................................................................................
..............................................................................................................
13.3.6 Inventory
An inventory is a kind of self-report instrument. The individual checks responses to
certain questions or statements. Inventories yield scores which are assumed or have
been shown to measure certain tendencies or traits.
Interest inventories attempt to yield a measure of the types of activities that an individual
has a tendency to like and to choose. In 1907, Hall, a psychologist, standardized
Recreational Interest Inventory and in 1934, Kuder, another psychologist, standardized
Occupational Interest Inventory.
Q p e s of Interest Measurement
1. Direct Questioning - It presents questions like - 'Do you like to play cricket?'
2. Direct Observation - Behaviour of the individual is observed and it is found out
in which activities the individual is more interested.
3. Tested Interest - The individual is exposed to various experiences related to
different types of interests and it is observed in which area the individual is
showing more interest.
4. Interest Inventory - This is most preferred way of measuring interest. It consists
of various statements and the individual is asked to arrange them in order of
preference. Mostly interest inventories are of verbal type.
5. A Personality Inventory attempts to measure certain personality traits such as
individual need, adjustment, etc. It consists of questions of 'Yes /No' type.
Advantages
1) Interest inventories are useful in educational and vocational guidance.
2) They are helpful to the teachers to provide educational facilities to the students
as per their interests. ,-
Types of Interviews
1) In structured interviews the same questions are presented in the same manner
and order to each subject and the choice of alternative answers is restricted to a
predetermined list. These interviews are rigidly standardized and formal, but they
are more scientific in nature than unstructured ones.
2) unstructured interviews are flexible, few restrictions are placed in respondent's
answers. In this interview, one can penetrate behind initial answers, follow up
unexpected clues.
Procedure of Interview
As a technique of data collection good interview requires
i) Preparing for interview -
The following factors need to be determined in advance of the actual interview.
clear conception of the purpose and of what information is needed.
e kind of interview - individual or group.
A clear outline or schedule of the best sequence of questions.
A well thought plan for recording responses.
ii) Conduct of interview (execution) -
The initial task of securing the confidence and co-operation of the subject what
is called - rapport -requires an expertness and sensitivity almost amounting to
art.
securing desired information through asking questionsin the planned sequence
should be done in not too rigid a manner but with stimulatingand encouraging
comments and necessary explanations and recordings.
The recording device selected should be used without distracting the
interviewee.
Before an interview study is undertaken, the interviewer should undergo
rigorous training.
iii) Recording and Interpreting Responses -
it is best to employ, if possible, a device of recording which would retain the
actual wording of the responses. Tape-recording is convenient and not too
expensive if tape-recorder is available.
If the responses to questions in the interview have to be noted down, it can
be done either simultaneously with the interview or immediately after it.
Sometimes, instead of recording responses, the interviewers tend to record
their evaluations of them as the interview goes on.
Advantages of Interview
i) The interview, with skillful interviewers, is much superior to other data gathering
devices.
ii) It is specially appropriate when dealing with young children, illiterates and in an
abnormal state of mind.
60
iii) It is used for practical purposes rather than for gathering data for research. It is Tooh and TKbniques
of Data Collection
used for student counseling, selection of candidates for education etc.
iv) In interview the investigatorcan create a right type of friendly atmosphere which
is very conducive for obtaining desired data.
V) If necessary the interviewer can give assurance to the interviewee that the facts
wi 11 be properly used.
vi) It permits even exchange of ideas and information. It provides opportunity for
give and take.
i The respondent's difficultieslike bad handwriting, poor expression are also avoided
as every schedule is filled by the interviewer.
viii) The personal contact with the respondent enables the interviewer to probe more
deeply into the character of the respondent.
ix) The data gathefed through interviews have been found to be fairly reliable.
X) There is possibility of crossquestioning and putting supplementary questions.
Litations of Interview
i) This technique is time-consuming and one of the most difficult ones to employ
successfuIly.
ii) There is constant danger of interviewer bias.
iio The objectivity, sensitivity and insight of the interviewer is crucial. This pmcedum
requires a level of expertness not ordinarily possessed by an average research
worker.
iv) A busy person may prefer to fill out a questionnaireat leisure rather than submit
to a long interview.
V) The respondent suffers from four limitations-
a) his experience as an interviewee.
b) his judgement about himself.
C) his accessibility and readiness to divulge the information.
d) his ability to express himself clearly.
vi) The recording of data from an interview is full of dficulties.
vii) Tape recording of the entire interview is likely to be expensive of time and
money.
viii) It does not work well with infants, shy people, deaf people and mad people.
13.4.2 Observation
Observation is a more natural way of gathering data. It seeks to ascertain what people
think and do. By watching them in action as they express themselves in various situations
and activities.
'Qpes of Observation
1. Participant and Non-participant Observation - In participant observation; the
observer becomes more or less one of the group under observation. In such situations,
the observer will be in sight of the person being observed and may actually take part
in some activity with the individual or group. The observer may play as one of several
roles in observation, with varying degree of participation, as a visiting stranger, an
attentive listener, an eager learner, or a more complete role as participant observer.
In Non-participant observation, the observer remains aloof from the group. He keeps
his observation as inconspicuous as possible. It is used with such groups as those of
infants, children or abnormal persons. 61
Research Design 2. Structured and Non-structured Observation - In structured observation the
investigator must be ready to shift from his original plans to the study of aspects which
he sees as more significant.
The observation is wide and unstructured in the early stages, it gets restricted and
structured as the investigation proceeds.
2. Execution of Observation
An expert execution demands :
Proper arrangement of special conditions for the subjects.
Assuming the proper physical position for observing.
Focusing attention on the specificactivitiesor units of behaviour under observation.
a Observing directly, the length and number of periods and intervals decided upon. '
Advantages of Observ'ation
1. Observation as a research technique is being refined and made exact to an extent
that it is likely to make an important contribution in descriptive research.
2. Significant aspects of personality which express themselves in behaviour can be
best studied directly through observation rather than indirectly through
questionnaire and interview.
3. Simple observation of physical aspects of school buildings or students and teachers, Tools and Techniques
of Data Collection
etc. is made through physical examination, measurement, assessment and
comparison with fixed standards.
4. Observation of physical activities as in games and in the workshop is made directly
very often for coaching purposes.
. 5. Observation in the classroom is made to analyse learning behaviour which is a
more complex phenomenon, and to improve classroom performance.
Limitations of Observation
1. Establishing the validity of observation is always difficult. Many of the items of
observation cannot be defined with sufficient precision.
2. 'The problem of subjectivity is also involved. A person tends to see what he
knows.
3. There is also the danger of concentrating in an observation on the aspects of
limited significance simply because they can be recorded objectively and
accurately.
4. There is the possibility of distortion of the phenomena through the very act of
observing.
5. Also the observer tends to see only those things which he wants to see.
6. Usually when an observer goes to the scene, the situation is new to him.
7. The incidents described may be samples of rarely occurring behaviour. The
observer fails to obtain an adequate sample of data on the basis of which
conclusions can be drawn.
8. The lack of competence of the'observer may hamper validity and reliability of
observation.
9. The people being observed become conscious and begin to behave in an unnatural
manner.
10. It is a slow and laborious process. A particular-situation which is desired to be
observed might not occur for a very long time.
11. The data may be unmanageable. It would be difficult to arrange the behaviours
along a continuum.
12. It is going to be a costly affair. It involves expenses on traveling, staying at the
place of phenomena.
13.5 DOCUMENTS
Documents are the ready-made records which provide data to the researcher in
. relation to the research problem under consideration .They contain the dataof remote
periods and places for scientific analysis. Since the content of the document is itself
the data, it does not depend upon a specific investigator. The system of recording the
data is already determined by the person(s) other than the researcher .
Types of Documents - Documents are categorized in three ways
1. Expressive Documents
These specify the process of social interaction and include personal letters ,diaries ,
biographies, autobiographies . Such types of documents are more used and useful for
data collection in historical researches and in case studies .
2. Official Records
These documents provide useful information about the time and frequency of the
occurrence of an event. Such data cover a wide range of events e.g. birthdate, 63
Research Design attendance and progress records of the students; data related to particular courses,
result sheet etc. They also include the records of the minutes of the school committee
meetings, minutes of various university meetings such as the meetings of academic
council, board of studies etc. The annual reports, budgets and the pictorial records
(e.g. photographs, videos) also comprise the official records.
The official records are useful in knowing and understanding past events and trends
so as to gain perspective on the present and the future. They are helpful in studying
the administrative pattern of the institution. They yield the data useful in historical and
survey type researches and also in case studies .
13.6.2 Reliability
The second important quality of a measuring instrument is its reliability or consistency.
A reliable test is one which measures accurately and consistently. If a reliable test is
given two or three times to the same group, each person in the group should ge't
approximately the same score on all occasions. Reliability is a statistical concept. To
determine the reliability of a test, it must be administered to a group of individuals
under appropriate circumstances. Reliability can be expressed by a correlation
coefficient.
13.6.3 Objectivity
A test is objective when the examiner's personal judgement does not affect the scoring.
An objective test is one for which the items can readily be scored as right or wrong.
Such item types as multiple choice, matching, true-false are objective. Objectivity is a
prerequisite to reliability in a test. Objective judgements are accurate and hence tend
to be reliable. Hence data collection tool must be objective.
13.6.4 Adequacy
The careful test maker never assumes that the instrument he has constructed is capable
of measuring all of the factual knowledge or skills that apupil has acquired in a school
course .Adequacy is a prerequisite to the reliability as well as to validity of a test.
Hence the data collection tool must be adequate.
13.6.5 Usability
The most valid test in the world will do nothing to improve the school programme if it
is not used. Usability or practicality is an important criterion for assessing the value of
a test. Usability of a test depends upon a number of factors.
i) Ease of Administration - Directions for administering the test should be simple
and clear, and the timing of the test should not be too difficult for adjustment.
ii) Ease of Scoring - If algebraic manipulations are required to get the scores or if
the original raw scores require to be converted into complicated derived scores,
teachers will avoid to use such a test.
iii) Ease of Interpretation - In the final analysis, the success or failure of a testing Tobh and Techniques
of Data Coiieetion
programme is determined by the use made of test results.
iv) Economy - Economy is certainly one of the major criteria of a good test. Real
economy in testing will not be achieved by the indiscriminateuse of cheap tests,
but it is equally true that users will avoid buying costly instruments and tests.
Economy also refers to the time required for administering and scoring the test.
i
V) Availability of Equivalent Forms - Equivalent forms of a test measure the same
I aspects of behaviour by using test items which are alike in content, level of
difficulty and other characteristics. Thus one form of the test can substitute the
I other. Equivalent forms are especially valuable when these are used for research
purposes.
The data collection tool must be a usable one.
13.6.7 Interest
Tests that are interesting and enjoyable help to gain the cooperation of the subject.
Under unfavourable conditions, the test is not likely to yield useful results. Hence,
from amongst the available the one satisfying all other criteria, the interesting tool
should be selected for data collection.
13.8 UNIT-ENDACTIVITIES
- --- - - - -
13.12 GLOSSARY
Attitude A moderately intense emotion that prepares or
predisposes, an individual to respond consistently
in a favourable or unfavourable manner when
confronted with a particular psychological object.
Attitude Scale It is the most prevalent means of measuring attitude
which provides individuals with a list of statements
and asks them to respond to each statement in
accordance with their true feelings.
Observation A technique of collecting data by directly examining
the activities of an individual in different settings.
Qualitative Data Descriptive narrations, responses to open ended
questions, quotations, field notes etc are qualitative
data.
Quantitative Data Numerical figures or ratings are quantitative data.
Questionnaire A set of questions dealing with psychological, social,
educational or any other topic sent to an individual
or a group with the purpose of obtaining factual
information with regard to the topic under study.
Rating Scale It is the qualitative description of a limited number
of aspects of a thing or of traits of a person. The
classifications may be set up in five to seven
categories.
Reliability It is the extent to which a tool is consistent in
measuring whatever it may measure.
Test A psychological test is an instrument designed to
describe and measure a sample of certain aspects
of human behaviour.
Check List A Check List is a prepared list of behaviours or
items to indicate the presence or absence of the
bahaviours or the item.
Data All relevant materials, past and present, serving as
basis for research study and analysis is the data.
Interview It is a technique of asking questions and getting
responses orally in face-to-face situation.
Validity The extent to which adevice does the job for which
it is designed is its validity.
69
NOTES