One-Way ANOVA Module for Teachers
One-Way ANOVA Module for Teachers
Upon completion of this module, you should be able to execute appropriate statistical
methods and tools in managing, organizing, presenting, and interpreting numerical
output.
The t-test and ANOVA examine whether group means differ from one another. The t-
test compares two groups, while ANOVA can do more than two groups.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.139
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
1.1 The significance of differences between more than two sample means can
be checked SIMULTANEOUSLY. This means an economy in terms of time and
effort. Indeed, if a t-test would be assigned to do the statistical analysis, the
number of t-test needed to pair off all the means would be:
n(n – 1)
2
For example, to pair off 5 sample means, this would amount to
5 (5 – 1) = 10 t-tests
2
With ANOVA, a single operation does the job.
1.2 With ANOVA, we have a high number of df notwithstanding the fact that
there are few subjects involved in the different experimental conditions
Example: 5 experimental conditions with N=10 per experimental condition. With
a t-test, pairing off the conditions, the df = N1 – 1 + N2 – 1 =10 -1 + 10 -1 =
18 df. With ANOVA, the df = N -1 = 50 – 1 = 49 df.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.140
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Since the df is much larger, the statistical analysis is more reliable and the “0”
can be rejected more easily.
ü The first component is the variance which exists within the groups. This
variance is caused by pre-existing individual differences and fluctuations
taking place at the time of gathering the data.
ü The second component is the variance which exists between the groups.
This variance is caused by the experimental conditions.
* If the different samples (with their respective sample means) originate from
the same population (i.e., there is no significant difference between the different
sample means), the estimate of the population variance on basis of the variance
between the groups will be essentially the same as the estimate of the population
variance on basis of the variance within the groups.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.141
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
* If the different samples (with their respective sample means) do not come
from the same population (i.e., there is a significant difference between the different
sample means, a difference caused by an experimental factor), the estimate of the
population variance on basis of the variance between the groups will be larger than
the estimate of the population variance on basis of the variance within the groups.
A Single Factor ANOVA or One-Way ANOVA has only one independent variable, which
can have more than two levels. Each group in the study/experiment represents a
different level of the independent variable.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.142
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
of teaching. The scores are the result of a test after the students were taught with
method A, B or C.
Data:
Method A Method B Method C
12 11 7
10 9 6
9 8 3
8 7 2
6 5 2
Step 1 Computations:
12 11 7
10 9 6
9 8 3
8 7 2
6 5 2
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.143
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
I (; = 45 I (" = 40 I (A = 20 I ( = 105
SOURCE Computational SS df L) F
Formula
5.>; is 6.93.
Degrees of Freedom:
BETWEEN: k–1
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.144
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
The obtained F value of 6.77 falls beyond critical value 3.88, and is significant at @
.05. Hence, the “0” which says that there is no difference in the effectiveness among
3 methods of teaching has to be rejected.
In order to situate exactly where the significant differences are, the different
means have to be paired off. This can be done by, among, others, the TUKEY
METHOD. In this method, q-values are computed.
For k/N-k df, i.e. 3/15-3 df, the critical value (see APPENDIX G- Tukey Table)) at 5.>! is 3.77,
at 5.>; is 5.05.
The sample means are ranked from the highest to the lowest. Insignificant q-values
determine the sample means which belong to the same cluster, i.e. to the same
population.
A=9
B=8
C=4
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.145
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Sample Problem: An experiment is carried out to study the influence of the modality of
the stimulus on the Reaction Time (RT). Ten subjects were each exposed to the different
stimuli: visual, auditory, olfactory, taste and touch. The reaction time (RT) is expressed in
hundredths of a second.
Null Hypothesis: There is no difference between the reaction times (RT’s) towards
five different stimuli.
Step 1: Computations
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.146
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
"
1. (∑ () / (n) (k) = 1569" / (10) (5) = 49235.22
2. ∑ (" = 54163
"
3. ∑(∑ (N ) / n = ∑(251" + 190" + 433" + 416" + 433" + 279" / 10
= 53748.70
= 49353.80
SOURCE Computational SS df L) F
Formula
TOTAL 2- 1 4927.78 49
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.147
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
For 4/36 df, the critical value at 5.>! is 2.63, 5.>; is 3.89.
Degrees of Freedom:
BETWEEN: k -1
Between Subjects: n -1
Residual: (n – 1) (k – 1)
The obtained F value of 137. 36 falls beyond critical value 2.63, and is significant at
α .05. Hence, the “0” which says that that there is no difference between the reaction
times (RT’s) towards five different stimuli has to be rejected.
Step 5. In order to situate exactly where the significant differences are, the sample
means have to be pained off by means of the Tukey method.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.148
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
For k/N-k, i.e., 5/50-5 df, 5/40 df, the critical value at 5.>; is 4.04 and at 5.>; is 4.93.
The sample means are ranked from shortest to longest reaction time (RT) and insignificant
q-values are clustered together.
Aud = 19.0
Vis = 25.1
Taste = 41.6
Olf = 43.3
The reaction time (RT) of the Auditory stimulus is significantly shorter than reaction times
(RT’s) of all other stimuli. The RT’s of the Visual and the Touch stimuli are not significantly
different from each other. But both are significantly longer than the RT of the Auditory
stimulus and significantly shorter than the RT’s on the Taste and Olfactory stimuli. These
latter ones are insignificantly different from each other and have significantly longer RT’s
as compared to the other three stimuli.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.149
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Step 1. For this problem, we carry out an Anova: Single Factor since there is
only ONE Independent variable.
In MS Excel: Type in your Data. Go to TOOLS /DATA, then click on DATA ANALYSIS.
Select Anova: Single Factor
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.150
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Step 2. a) Present your Results. Interpret the statistics. IF the F-value is significant,
proceed to b.
b) generate your conclusions
For Step 2.a.) The obtained F value of ________ falls ___________ critical value ________,
and is (significant/ not significant) at α .05. Hence, the “0” which says that
_______________________________________________________ _________________is
(rejected/accepted).
*With the significant F-value, a post-hoc test (e.g. Tukey Method for ANOVA) is needed in
order indicate the direction of the difference between the means and be able to
generate conclusions.
Note: MS Excel does not a perform post-hoc tests. In order to investigate into the
direction of difference between the means, we carry out a t-test on the means (one
pair at a time).
To do this:
1. Rank the means from best to worst. (in this example, highest to lowest).
2. Perform a t-test on the first PAIR of means. Then on the second pair, third
pair, etc…
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.151
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Clusters:
A= 9
B=8
C=4
For Step 2.b.) Method A (Mean = 9) and Method B (Mean = 8) yield the same test
results, hence, both are equally effective. Additionally, both methods A & B yield
significantly better results than Method C (Mean = 4). Methods A and B are
significantly more effective than Method C.
Sample Problem:
An experiment is carried out to study the influence of modality of the stimulus on the
Reaction Time. Eight subjects were exposed to five different stimuli: visual, auditory,
olfactory, taste, and touch. They were told to press a lever if they perceive the
stimulus. The reaction time (RT) is expressed in hundredths of a second.
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.152
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Data:
Step 2
Interpret the statistics and generate your conclusions (Note the F-value against the F crit
value)
Anova: Two-Factor Without
Replication
SUMMARY Count Sum Average Variance
1 5 150 30 88.5
2 5 159 31.8 84.7
3 5 152 30.4 94.8
4 5 146 29.2 105.7
5 5 149 29.8 105.2
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.153
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
ANOVA
Source of Variation SS df MS F P-value F crit
Rows 21.775 7 3.1107143 0.5474544 0.7911066 2.35925985
COLUMNS 3138.9 4 784.725 138.1037 5.296E-18 2.714076
Error 159.1 28 5.6821429
Total 3319.775 39
**As we are dealing with ONLY ONE INDEPENDENT VARIABLE and with CORRELATED MEANS, we only
pay attention and interpret the F-value for COLUMNS (Between Subjects).
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.154
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Mean 24.5 25.75 Mean 25.75 40.375 means lies. Without the ANOVA,
t Stat -1.2127 t Stat -15.497 we would have to carry out a total
tCrit two-tail 2.36462 tCrit two-tail 2.36462 of 10 t tests.
Interpretation:
The Reaction Time of VISUAL Stimulus (Mean = 19.25) is significantly the shortest, therefore
fastest among the different stimuli. The reaction times for Auditory (Mean = 24.50) and
Touch (Mean = 25.75) do not differ significantly from one another, but are both significantly
longer than the Visual Stimulus, and significantly shorter than that of the Olfactory (Mean
= 40.38) and Taste Stimuli (Mean = 41.00). The latter two modalities of stimuli are not
significantly different from one another, and yield significantly longer Reaction Times
compared to the three other stimuli. The Modality of a stimulus indeed influences Reaction
Time.
References
Main Reference
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.155
Document Code FM-STL-013
Saint Louis University
Revision No. 01
School of Teacher Education and Liberal Arts
Effectivity June 07, 2021
Books
Bluman, A.G. (2014). Elementary Statistics: A Step by Step Approach (9th Ed.). New York:
McGraw Hill - Education
Narag, E.R. (2018). Basic Statistics. Manila: Rex Publishing
Cohen, B.H. (2013). Explaining Psychological Statistics (4th Ed.). Hokoben, New Jersey:
John Wiley & Sons, Inc.
Gravetter, F. & Wallnau L. (2019). Statistics for the Behavioral Sciences (10th Ed.).
Philippines: Cengage Learning
Electronic References
http://www.socialresearchmethods.net
http://www.thomsonedu.com/psychology/pagano
http://www.sdecnet.com/psychology/stathelp.htm
http://www.wpcmath.com
http://www.psychnet.apa.org
http://www.allpsych.com/researchmethods/inferentialstatistics.html
http://www. statanalytica.com/blog/uses-of-statistics
Property of and for the exclusive use of SLU. Reproduction, storing in a retrieval system, distributing, uploading or posting online, or transmitting in any form or by any
means, electronic, mechanical, photocopying, recording, or otherwise of any part of this document, without the prior written permission of SLU, is strictly prohibited.156