Stages in the
Development &
Validation of an
Assessment
Instrument
Stages in the Development & Validation of
an Assessment Instrument
Phase 1 Phase 2 Phase 3 Phase 4
Planning Stage Test Construction Test Administration Evaluation Stage
Stage Stage
(Writing Stage) (Try Out Stage)
1. Specify the 1. Writing of test 1. First Trial Run 1. Administration of the
objectives/skills items based on the 2. Scoring final form of the test
and content TOS 3. First Item Analysis 2. Establish test validity
areas to be 4. First Option Analysis 3. Estimate test
measured 2. Consultation with 5. Revision of the Test reliability
experts – subject Items
2. Prepare the TOS teacher / test 6. Second Trial Run /
expert for Field Testing
3. Decide on the validation (content) 7. Second Item Analysis
item format and editing 8. Second Option
Analysis
9. Writing the final form of
the test
Item analysis will expose the technicaldefe
constructing the questions, poorquality qu
Learning Outcomes questions
thatwere too difficult for the students. Thu
a basis for remedial work as it bringsto ligh
weakness of studentsrequiring more exten
➢ Explain the meaning of item analysis, item validity,
reliability, item difficulty, discrimination index
➢ Determine the validity and reliability of given test items
➢ Determine the quality of a test item by its difficulty
index, discrimination index and plausibility of options
(for a selected – response test)
Test Item Analysis
Test Item Analysis
Types of Test Item Analysis
Types of Test Item Analysis
Types of Test Item Analysis
Types of Test Item Analysis
Purposes of Test Item Analysis
➢ To obtain information about the level of difficulty of all
items and to determine the effectiveness of individual test
items
➢ To identify structural or content defects in the items
➢ To detect learning difficulties of the class as whole
➢ To determine whether the item is of appropriate level of
difficulty for the students tested
Purposes of Test Item Analysis
➢ To determine whether the item is capable of discriminating
between the knowledgeable and less knowledgeable
students
➢ To identify the areas of weaknesses of students in need of
remediation
➢ To select the best items for the final form of the test,
modify/revise some of the items, and reject poor items .
Test Item Analysis
BENEFITS
Data from Item Analysis provide a basis for:
➢ gives useful information for class discussion of the test
➢ gives data for helping the students to improve their
learning method
➢ gives insights to construct better items for future tests
CREDITS: This presentation template was created by Slidesgo, and includes icons by Flaticon,
infographics & images by Freepik and content by Swetha Tandri
➢ provides avenue for improvement of class instruction
Test Item Analysis
LIMITATIONS
➢ has a maximum application on tests that measure
essentially same level of mental function
➢ item formats, reading level and other factors affecting
item difficulty
➢ cannot be used as diagnostic assessment scheme for
CREDITS: This presentation template was created by Slidesgo, and includes icons by Flaticon,
infographics & images by Freepik and content by Swetha Tandri
student performance
PARAMETERS
for ITEM ANALYSIS
1. Item Difficulty Index
2. Discrimination Index
3. Distracters’ Effectiveness
Two Most Important
Characteristics
of an Item to be
Considered by the Teacher
Two Most Important Characteristics of an Item
❖ Item Difficulty Index
❖ Discrimination Index
Item Difficulty
is the number of students who are able to answer the
item correctly divided by the total number of students.
number of students with correct answer
in the upper and lower group
Item Difficulty = 2
Item Difficulty = UG + LG
2
No. of Students in the UG who got correct answers
Upper Group =
Total No. of Students in the UG
Item Difficulty
No. of Students in the UG who got correct answers
Upper Group =
Total No. of Students in the UG
No. of Students in the UG who got correct answers
Upper Group = Total No. of Students in the UG
4
UG =
4
UG = 1
No. of Students in the LG who got correct answers
Lower Group = Total No. of Students in the LG
LG = 1
4
LG = 0.25
Item Difficulty
number of students with correct answer
in the upper and lower group
Item Difficulty =
2
Item Difficulty = UG + LG
2
= 1 + 0.25
2
= 1.25
2
= 0.625
Item Difficulty
The following arbitrary rule is often used in the literature:
Range of Difficult Index Interpretation Action/Decision
0 – 0.10 Too Difficult Item Reject
0.11 – 0.25 Difficult Item Revise
0.26 – 0.75 Average Item Retain
0.76 – 0.90 Easy Item Revise
0.91 - 1 Too Easy Item Reject
Item Difficulty
An item is difficult if majority of students are unable to provide the
correct answer.
The item is easy if majority of the students are able to answer correctly.
An item can discriminate if the examinees who score high in the test can
answer more the items correctly than examinees who got low scores.
Discrimination Index
Example
Obtain the index of discrimination of an item if the
upper 27% of the class had a difficulty index of 0.60
(i.e. 60% of the upper 27% got the correct answer) while
the lower 27% of the class had difficulty index of 0.20.
Discrimination
Index = UG - LG
No.of No.of
Students in upper 27% Students in lower 27%
with with
correct response________ correct response________
No. of students in the No. of students in the
upper 27% upper 27%
Discrimination Index
Example
Obtain the index of discrimination of an item if the
upper 27% of the class had a difficulty index of 0.60
(i.e. 60% of the upper 27% got the correct answer) while
the lower 27% of the class had difficulty index of 0.20.
Discrimination
Index = UG - LG
= 1 - 0.25
= 0.75
Item Difficulty
The following arbitrary rule is often used in the literature:
Range of Difficult Index Interpretation Action/Decision
0 – 0.10 Too Difficult Item Reject
0.11 – 0.25 Difficult Item Revise
0.26 – 0.75 Average Item Retain
0.76 – 0.90 Easy Item Revise
0.91 - 1 Too Easy Item Reject
Discrimination Index
The value is interpreted using the table:
Range of Discrimination Index Remarks Action/Decision
0.40 and above Very Discriminating/ Very Good Item High Acceptance
0.30 – 0.39 Discriminating/ Good Item
Possibilities for
enhancement
0.20 – 0.29 Moderately
Discriminating/Reasonably Good Item Need to verify/review
0.10 – 0.19 Not Discriminating/ Marginal Item Review in depth
Poor/Questionable Item Reject
Below 0.10
Thanks!
CREDITS: This presentation template was created by Slidesgo, and includes icons by Flaticon,
infographics & images by Freepik and content by Swetha Tandri
