Problem: three measurements, do they agree?

When the variable is continuous, the intraclass correlation coefficient should be computed.

Package required: irr

library("irr")
Loading required package: lpSolve

Dataset

Calculation

Assumptions

  1. the cases are considered as random effects (oneway)
  2. the outcome of interest is the differences in mean ratings

Results

icc(df, model="oneway", type="agreement")
 Single Score Intraclass Correlation

   Model: oneway 
   Type : agreement 

   Subjects = 9 
     Raters = 4 
     ICC(1) = 0.565

 F-Test, H0: r0 = 0 ; H1: r0 > 0 
    F(8,27) = 6.19 , p = 0.000146 

 95%-Confidence Interval for ICC Population Values:
  0.243 < ICC < 0.853

References

Shrout and Fleiss. Intraclass correlations: uses in assessing rater reliability.

citation()

To cite R in publications use:

  R Core Team (2017). R: A language and environment for
  statistical computing. R Foundation for Statistical Computing,
  Vienna, Austria. URL https://www.R-project.org/.

A BibTeX entry for LaTeX users is

  @Manual{,
    title = {R: A Language and Environment for Statistical Computing},
    author = {{R Core Team}},
    organization = {R Foundation for Statistical Computing},
    address = {Vienna, Austria},
    year = {2017},
    url = {https://www.R-project.org/},
  }

We have invested a lot of time and effort in creating R, please
cite it when using it for data analysis. See also
‘citation("pkgname")’ for citing R packages.
citation(package = "irr")

To cite package ‘irr’ in publications use:

  Matthias Gamer, Jim Lemon and Ian Fellows Puspendra Singh
  <puspendra.pusp22@gmail.com> (2012). irr: Various Coefficients
  of Interrater Reliability and Agreement. R package version 0.84.
  https://CRAN.R-project.org/package=irr

A BibTeX entry for LaTeX users is

  @Manual{,
    title = {irr: Various Coefficients of Interrater Reliability and Agreement},
    author = {Matthias Gamer and Jim Lemon and Ian Fellows Puspendra Singh <puspendra.pusp22@gmail.com>},
    year = {2012},
    note = {R package version 0.84},
    url = {https://CRAN.R-project.org/package=irr},
  }

ATTENTION: This citation information has been auto-generated from
the package DESCRIPTION file and may need manual editing, see
‘help("citation")’.
LS0tCnRpdGxlOiAiQWdyZWVtZW50IgpvdXRwdXQ6IGh0bWxfbm90ZWJvb2sKLS0tCioqUHJvYmxlbSoqOiB0aHJlZSBtZWFzdXJlbWVudHMsIGRvIHRoZXkgYWdyZWU/CgpXaGVuIHRoZSB2YXJpYWJsZSBpcyBjb250aW51b3VzLCB0aGUgaW50cmFjbGFzcyBjb3JyZWxhdGlvbiBjb2VmZmljaWVudCBzaG91bGQgYmUgY29tcHV0ZWQuIAoKUGFja2FnZSByZXF1aXJlZDogaXJyCgpgYGB7cn0KbGlicmFyeSgiaXJyIikKYGBgCiMjIERhdGFzZXQKYGBge3J9CnJlYWQuY3N2KCJhZ3JlZW1lbnQuY3N2IiwgaGVhZGVyID0gVCkKYGBgCgpgYGB7cn0KZGYgPC0gcmVhZC5jc3YoImFncmVlbWVudC5jc3YiLCBoZWFkZXIgPSBUKQpgYGAKIyMgQ2FsY3VsYXRpb24KCiMjIyBBc3N1bXB0aW9ucwogMS4gdGhlIGNhc2VzIGFyZSBjb25zaWRlcmVkIGFzIHJhbmRvbSBlZmZlY3RzIChvbmV3YXkpCiAxLiB0aGUgb3V0Y29tZSBvZiBpbnRlcmVzdCBpcyB0aGUgZGlmZmVyZW5jZXMgaW4gbWVhbiByYXRpbmdzIAoKIyMjIFJlc3VsdHMKYGBge3J9CmljYyhkZiwgbW9kZWw9Im9uZXdheSIsIHR5cGU9ImFncmVlbWVudCIpCmBgYAoKIyMgUmVmZXJlbmNlcwoKW1Nocm91dCBhbmQgRmxlaXNzLiBJbnRyYWNsYXNzIGNvcnJlbGF0aW9uczogdXNlcyBpbiBhc3Nlc3NpbmcgcmF0ZXIgcmVsaWFiaWxpdHkuXShodHRwOi8vd3d3LmFsaXF1b3RlLm9yZy9jb3Vycy8yMDEyX2Jpb21lZC9iaWJsaW8vU2hyb3V0MTk3OS5wZGYpCgpgYGB7cn0KY2l0YXRpb24oKQpgYGAKCmBgYHtyfQpjaXRhdGlvbihwYWNrYWdlID0gImlyciIpCmBgYAoK