Number of items | Inter-rater reliability between on-site ratings | Inter-rater reliability between online ratings | |||||
---|---|---|---|---|---|---|---|
ICC/kappa range | Moderate-to-perfect agreement n (%) | Fair/poor agreement n (%) | ICC/kappa range n (%) | Moderate-to-perfect agreement n (%) | Fair/poor agreement n (%) | ||
All | 119 | 0.03–1.00 | 81 (67.5) | 10 (8.3) | −0.03–1.00 | 72 (60.0) | 21 (17.5) |
ROUTE (n = 65) | 61 | 0.03–1.00 | 41 (67.2) | 5 (8.2) | −0.03–0.97 | 33 (54.1) | 12 (19.7) |
Land use/destinations | 31 | 0.03–1.00 | 22 (71.0) | 2 (6.5) | −0.03–0.97 | 19 (61.3) | 6 (19.4) |
Residential density | 4 | 0.66–0.80 | 4 (100) | – | 0.47–0.78 | 4 (100) | – |
Shops | 8 | 0.92–1.00 | 5 (62.5) | – | 0.51–0.97 | 5 (62.5) | – |
Restaurant and entertainment | 4 | 0.03–0.93 | 2 (50.0) | 2 (50.0) | −0.03–0.93 | 2 (50.0) | 2 (50.0) |
Institutional/Services | 3 | 0.90–0.98 | 3 (100) | – | 0.30–0.93 | 2 (66.7) | 1 (33.3) |
Public recreation | 4 | 0.66–0.80 | 3 (75.0) | – | 0.33–0.59 | 2 (50.0) | 1 (25.0) |
private recreation | 2 | 0.80 | 1 (50.0) | – | 0.32 | – | 1 (50.0) |
Worship land usesa | 1 | 0.96 | 1 | – | 0.77 | 1 | – |
School land usesa | 1 | 0.85 | 1 | – | 0.79 | 1 | – |
Pedestrian zone land usesa | 1 | 0.47 | 1 | – | 0.64 | 1 | – |
Age restricted land usesa | 1 | 1.00 | 1 | – | 0.66 | 1 | – |
Liquor related land usesa | 1 | N/A | – | – | 0.58 | 1 | – |
Industrial land usesa | 1 | N/A | – | – | 0.33 | – | 1 |
Streetscape | 19 | 0.48–0.98 | 11 (57.9) | – | 0.42–0.82 | 9 (47.4) | – |
Aesthetics and Social | 11 | 0.13–0.91 | 8 (72.7) | 3 (27.3) | −0.02–0.87 | 5 (45.5) | 6 (54.5) |
Segment (n = 220) | 29 | 0.23–0.97 | 26 (89.7) | 2 (6.9) | −0.01–0.95 | 21 (72.4) | 7 (24.1) |
Setback and building height | 4b | 0.71–0.83 | 4 (100) | – | 0.48–0.67 | 4 (100) | – |
Building height to road width ratio | 5 | 0.71–0.83 | 5 (100) | – | 0.48–0.89 | 5 (100) | – |
Sidewalk | 8 | 0.23–0.97 | 6 (75.0) | 2 (25.0) | −0.01–0.67 | 5 (62.5) | 3 (37.5) |
Buffer | 2 | 0.69–0.89 | 2 (100) | – | 0.45–0.55 | 2 (100) | – |
Bike infrastructure | 3 | 0.51–0.89 | 3 (100) | – | 0.38–0.95 | 2 (66.7) | 1 (33.3) |
Building surveillancea | 1 | 0.48 | 1 | – | 0.81 | 1 | – |
Shade | 3 | 0.61–0.87 | 3 (100) | – | 0.55–0.67 | 3 (100) | – |
Pedestrian connectivity | 3 | 0.85 | 2 (66.7) | – | 0.30–0.33 | – | 2 (66.7) |
Informal patha | 1 | 0.77 | 1 | – | 0.84 | 1 | – |
Hawkers/Shopsa | 1 | 0.95 | 1 | – | 0.04 | – | 1 |
High (car) street lightsa | 1 | 0.61 | 1 | – | 0.55 | 1 | – |
Low (pedestrian) street lightsa | 1 | 0.75 | 1 | – | 0.65 | 1 | – |
Crossing (n = 124) | 23 | −0.01 to 1.00 | 12 (50.0) | 3 (12.5) | 0.27–0.95 | 16 (66.6) | 2 (8.3) |
Crosswalk amenities | 7 | 0.34–1.00 | 2 (28.6) | 1 (14.3) | 0.38–0.94 | 4 (57.1) | 1 (14.3) |
Curb quality/presence | 3 | 0.71–0.88 | 3 (100) | – | 0.69–0.94 | 3 (100) | – |
Intersection control and signage | 7 | −0.01–1.00 | 4 (57.1) | 1 (14.3) | 0.66–1.00 | 6 (85.7) | – |
Bike | 3 | 0.80–0.90 | 2 (66.7) | – | 0.66–0.76 | 2 (66.7) | – |
Overpassa | 1 | N/A | – | – | N/A | – | – |
Road widtha | 1 | 0.90 | 1 | – | 0.78 | 1 | – |
Visibilitya | 1 | 0.38 | – | 1 | 0.27 | – | 1 |
CUL-DE-SAC (n = 6) | 6 | 0.67–0.76 | 2 (33.3) | – | 0.76–1.00 | 2 (33.3) | – |