Table 2 The criterion validity (ICC) comparing the expert rating with each CTSR-4 coder and the coder mean

Structure

.86 (.77–.92)

.74 (.59–.85)

.75 (.42–.88)

.71 (.24–.88)

.91 (.82–.96)

Relation

.85 (.75–.91)

.71 (.54–.82)

.81 (.69–.89)

.75 (.54–.87)

.89 (.81–.94)

Concept

.88 (.80–.93)

.79 (.64–.88)

.83 (.72–.90)

.82 (.66–.91)

.90 (.83–.95)

Change

.86 (.77–.92)

.75 (.60–.85)

.80 (.67–.88)

.75 (.53–.87)

.90 (.83–.94)

Total score

.93 (.88–.96)

.83 (.72–.90)

.86 (.76–.92)

.83 (.67–.91)

.96 (.92–.98)