Thanks to visit codestin.com
Credit goes to www.scribd.com

Scribd
Upload
24 views3 pages

Reliability: Notes

The document reports the results of a reliability analysis of ratings from 5 raters (Rater1-Rater5) on 7 cases. It finds very good reliability between the raters, with Cronbach's alpha of .922 and average measures ICC of .911, indicating high agreement between the raters. The ICC analysis also confirms high reliability, with a single rater ICC of .671 and average measures ICC of .911, and all ICCs are statistically significant at p<.001.

Uploaded by

Evanda Manggani
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
24 views3 pages

Reliability: Notes

The document reports the results of a reliability analysis of ratings from 5 raters (Rater1-Rater5) on 7 cases. It finds very good reliability between the raters, with Cronbach's alpha of .922 and average measures ICC of .911, indicating high agreement between the raters. The ICC analysis also confirms high reliability, with a single rater ICC of .671 and average measures ICC of .911, and all ICCs are statistically significant at p<.001.

Uploaded by

Evanda Manggani
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

RELIABILITY

/VARIABLES=Rater1 Rater2 Rater3 Rater4 Rater5


/SCALE('ALL VARIABLES') ALL
/MODEL=ALPHA
/STATISTICS=DESCRIPTIVE SCALE
/SUMMARY=MEANS
/ICC=MODEL(MIXED) TYPE(ABSOLUTE) CIN=95 TESTVAL=0.

Reliability

Notes

Output Created 09-Sep-2023 14:55:43


Comments
Input Active Dataset DataSet0
Filter <none>
Weight <none>
Split File <none>
N of Rows in Working Data File 7
Matrix Input
Missing Value Handling Definition of Missing User-defined missing values are treated as
missing.
Cases Used Statistics are based on all cases with valid
data for all variables in the procedure.
Syntax RELIABILITY
/VARIABLES=Rater1 Rater2 Rater3 Rater4
Rater5
/SCALE('ALL VARIABLES') ALL
/MODEL=ALPHA
/STATISTICS=DESCRIPTIVE SCALE
/SUMMARY=MEANS
/ICC=MODEL(MIXED) TYPE(ABSOLUTE)
CIN=95 TESTVAL=0.

Resources Processor Time 00:00:00.078

Elapsed Time 00:00:00.069

[DataSet0]
Scale: ALL VARIABLES

Case Processing Summary

N %

Cases Valid 7 100.0

Excludeda 0 .0

Total 7 100.0

a. Listwise deletion based on all variables in the


procedure.

Reliability Statistics

Cronbach's Alpha
Based on
Cronbach's Alpha Standardized Items N of Items

.922 .927 5

Item Statistics

Mean Std. Deviation N

Rater1 2.71 .951 7


Rater2 2.86 1.069 7
Rater3 3.14 .690 7
Rater4 3.43 .787 7
Rater5 3.00 1.000 7

Summary Item Statistics

Maximum /
Mean Minimum Maximum Range Minimum Variance N of Items

Item Means 3.029 2.714 3.429 .714 1.263 .076 5

Scale Statistics

Mean Variance Std. Deviation N of Items

15.14 15.810 3.976 5


Intraclass Correlation Coefficient

Intraclass 95% Confidence Interval F Test with True Value 0


a
Correlation Lower Bound Upper Bound Value df1 df2 Sig

Single Measures .671b .367 .917 12.893 6 24 .000


c
Average Measures .911 .743 .982 12.893 6 24 .000

Two-way mixed effects model where people effects are random and measures effects are fixed.
a. Type A intraclass correlation coefficients using an absolute agreement definition.
b. The estimator is the same, whether the interaction effect is present or not.
c. This estimate is computed assuming the interaction effect is absent, because it is not estimable otherwise.

You might also like