Basic Analyses

ICC calculations

Phase 0

Arizona

ICC table (version 1) for Arizona
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.2792165 0.1117216 0.7142218 117 8 1 1 936 0.1324786
ICC table (version 2) for Arizona
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.6891583 16.51950 116 702 0 0.6358499 0.7418046
Single_random_raters ICC2 0.6895069 16.94796 116 696 0 0.6360338 0.7422252
Single_fixed_raters ICC3 0.6949620 16.94796 116 696 0 0.6421928 0.7469405
Average_raters_absolute ICC1k 0.9394655 16.51950 116 702 0 0.9243733 0.9526319
Average_random_raters ICC2k 0.9395580 16.94796 116 696 0 0.9244288 0.9527309
Average_fixed_raters ICC3k 0.9409959 16.94796 116 696 0 0.9262733 0.9538351

Denver

ICC table (version 1) for Denver
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.0478256 0.0689866 0.4094232 117 8 1 1 936 0.0576923
ICC table (version 2) for Denver
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.4862556 7.625453 116 702 0 0.4216647 0.5554150
Single_random_raters ICC2 0.4868274 7.743013 116 696 0 0.4222964 0.5559101
Single_fixed_raters ICC3 0.4906503 7.743013 116 696 0 0.4260791 0.5596509
Average_raters_absolute ICC1k 0.8688602 7.625453 116 702 0 0.8361651 0.8973835
Average_random_raters ICC2k 0.8691208 7.743013 116 696 0 0.8365196 0.8975680
Average_fixed_raters ICC3k 0.8708513 7.743013 116 696 0 0.8386265 0.8989539

Duke

ICC table (version 1) for Duke
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.4556644 0.1630037 0.7365248 117 8 1 1 936 0.2136752
ICC table (version 2) for Duke
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.8316836 35.58835 116 702 0 0.7970208 0.8640261
Single_random_raters ICC2 0.8317034 35.76341 116 696 0 0.7970421 0.8640431
Single_fixed_raters ICC3 0.8323892 35.76341 116 696 0 0.7978151 0.8646292
Average_raters_absolute ICC1k 0.9719009 35.58835 116 702 0 0.9648954 0.9780125
Average_random_raters ICC2k 0.9719048 35.76341 116 696 0 0.9648999 0.9780156
Average_fixed_raters ICC3k 0.9720385 35.76341 116 696 0 0.9650616 0.9781229

Kentucky

ICC table (version 1) for Kentucky
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.5069014 0.348138 0.5928398 117 8 1 1 936 0.2596154
ICC table (version 2) for Kentucky
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.6571090 14.41465 116 702 0 0.6008677 0.7133655
Single_random_raters ICC2 0.6574641 14.72629 116 696 0 0.6011399 0.7137446
Single_fixed_raters ICC3 0.6622647 14.72629 116 696 0 0.6064228 0.7179912
Average_raters_absolute ICC1k 0.9306261 14.41465 116 702 0 0.9133302 0.9457151
Average_random_raters ICC2k 0.9307278 14.72629 116 696 0 0.9134200 0.9458103
Average_fixed_raters ICC3k 0.9320942 14.72629 116 696 0 0.9151506 0.9468705

MassAmherst

ICC table (version 1) for MassAmherst
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.3597319 0.3482906 0.5080798 117 8 1 1 936 0.2457265
ICC table (version 2) for MassAmherst
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.5613218 9.957027 116 702 0 0.4989258 0.6261618
Single_random_raters ICC2 0.5619586 10.193486 116 696 0 0.4995067 0.6267935
Single_fixed_raters ICC3 0.5677274 10.193486 116 696 0 0.5055777 0.6321301
Average_raters_absolute ICC1k 0.8995684 9.957027 116 702 0 0.8745293 0.9214126
Average_random_raters ICC2k 0.8998019 10.193486 116 696 0 0.8747840 0.9216078
Average_fixed_raters ICC3k 0.9018981 10.193486 116 696 0 0.8774200 0.9232450

Virginia

ICC table (version 1) for Virginia
sig2s sig2e icc1a n r max.rep min.rep Mtot ov.mean
0.9147059 0.226801 0.8013144 117 8 1 1 936 0.3119658
ICC table (version 2) for Virginia
type ICC F df1 df2 p lower bound upper bound
Single_raters_absolute ICC1 0.8056751 30.02215 116 702 0 0.7669067 0.8422254
Single_random_raters ICC2 0.8056751 30.02215 116 696 0 0.7669066 0.8422254
Single_fixed_raters ICC3 0.8056751 30.02215 116 696 0 0.7668765 0.8422422
Average_raters_absolute ICC1k 0.9666913 30.02215 116 702 0 0.9583869 0.9739360
Average_random_raters ICC2k 0.9666913 30.02215 116 696 0 0.9583869 0.9739360
Average_fixed_raters ICC3k 0.9666913 30.02215 116 696 0 0.9583802 0.9739392

Phase 1

Phase 2