Reliability analysis

Analysis

Comments were coded by two raters, with two codes being given for each. The number of possible agreements was calculated based on whether two or one codes were given and comments were assigned to:

• Agreement. All non missing codes agree
• Some agreement. At least two codes agree
• No agreement. No codes agreed.

The results for all for each comment type follow.

All

agreement	n
Agreement	150
Some agreement	136
No agreement	23

What was the best thing?

agreement	n
Agreement	73
Some agreement	86
No agreement	15

What can be improved?

agreement	n
Agreement	77
Some agreement	50
No agreement	8