Table 6 The confusion matrix used to calculate kappa coefficient.

0

288,419

25,126

8,136

3,568

1,734

1,771

328,754

87.7

1

5,614

2,262

1,490

1,172

1,218

1,254

13,010

17.4

2

14,881

7,047

5,216

5,054

5,087

4,293

41,578

12.5

3

28,492

13,206

10,081

9,563

9,596

9,847

80,785

11.8

4

28,128

14,531

10,867

9,290

9,680

10,701

83,197

11.6

5

10,597

6,975

5,595

4,884

5,786

5,868

39,705

14.8

Total

376,131

69,147

41,385

33,531

33,101

33,734

587,029

% Agree

76.7

3.3

12.6

28.5

29.2

17.4

Kappa = 0.262