- Methodology
- Open Access

# Evaluating the effect of neighbourhood weight matrices on smoothing properties of Conditional Autoregressive (CAR) models

- Arul Earnest
^{1}Email author, - Geoff Morgan
^{1, 2}, - Kerrie Mengersen
^{3}, - Louise Ryan
^{4}, - Richard Summerhayes
^{1, 5}and - John Beard
^{1, 5, 6}

**6**:54

https://doi.org/10.1186/1476-072X-6-54

© Earnest et al; licensee BioMed Central Ltd. 2007

**Received:**29 August 2007**Accepted:**29 November 2007**Published:**29 November 2007

## Abstract

### Background

The Conditional Autoregressive (CAR) model is widely used in many small-area ecological studies to analyse outcomes measured at an areal level. There has been little evaluation of the influence of different neighbourhood weight matrix structures on the amount of smoothing performed by the CAR model. We examined this issue in detail.

### Methods

We created several neighbourhood weight matrices and applied them to a large dataset of births and birth defects in New South Wales (NSW), Australia within 198 Statistical Local Areas. Between the years 1995–2003, there were 17,595 geocoded birth defects and 770,638 geocoded birth records with available data. Spatio-temporal models were developed with data from 1995–2000 and their fit evaluated within the following time period: 2001–2003.

### Results

We were able to create four adjacency-based weight matrices, seven distance-based weight matrices and one matrix based on similarity in terms of a key covariate (i.e. maternal age). In terms of agreement between observed and predicted relative risks, categorised in epidemiologically relevant groups, generally the distance-based matrices performed better than the adjacency-based neighbourhoods. In terms of recovering the underlying risk structure, the weight-7 model (smoothing by maternal-age 'Covariate model') was able to correctly classify 35/47 high-risk areas (sensitivity 74%) with a specificity of 47%, and the 'Gravity' model had sensitivity and specificity values of 74% and 39% respectively.

### Conclusion

We found considerable differences in the smoothing properties of the CAR model, depending on the type of neighbours specified. This in turn had an effect on the models' ability to recover the observed risk in an area. Prior to risk mapping or ecological modelling, an exploratory analysis of the neighbourhood weight matrix to guide the choice of a suitable weight matrix is recommended. Alternatively, the weight matrix can be chosen a priori based on decision-theoretic considerations including loss, cost and inferential aims.

## Keywords

- Deviance Information Criterion
- Relative Risk Estimate
- Statistical Local Area
- Neighbourhood Weight
- Area Health Service

## Background

The Conditional Autoregressive (CAR) model is widely used in small-area ecological studies to map outcomes measured at some areal level and to examine associations with covariates. Most of these applications are in the field of disease mapping (See Elliott for a list of studies [1]). The advantages of using the CAR model instead of presenting crude relative risks are well-described in the literature. One component of the CAR analysis is the use of a Bayesian model to include spatial association between observations. This approach offers a trade off between bias and variance reduction of the estimates, and has been shown to produce a set of point estimates that have improved properties in terms of minimising squared error loss, particularly in cases where the sample size is small [2].

When there is geographical correlation inherent in the data, ignoring such correlation can also lead to biased and inefficient inference, as the observations are strictly not independent. Elliott provides a summary of the various applications in disease mapping studies and some current methodological issues [1]. Lawson also highlights some of the applications of CAR models in disease mapping studies [3].

The CAR model was originally suggested by Besag [4] in the context of image analysis and is also known as the intrinsic CAR model with a convolution prior, or the Besag, York and Mollie (BYM) model. The original BYM model applied to continuous data that could be assumed to be normally distribution. In disease mapping studies, this has been adapted to incorporate normally distributed spatially correlated random effects into Poisson models for disease counts. The BYM model allows for the smoothing of relative risk estimate in each region towards the mean risk in the neighbouring areas. This provides for a more precise or reliable estimate of both mean and variance compared to using the crude rate. This is especially so, as the variance for the estimate of the raw rate with a small expected count can be large and unreliable. Risks are also smoothed towards the global mean to account for overdispersion. This 'shrinkage' of estimates towards the mean can be shown mathematically to be optimal if the aim is to minimise the squared-error loss, in a decision theory framework [5].

When undertaking CAR modelling of data at an areal level, it is necessary to define a, so-called, adjacency matrix that characterizes the neighbourhood structure of the data being analysed. There are several approaches to doing this, including defining neighbours according to the distances between centroids, declaring two regions to be neighbours if they share a boundary, and so on. It may also be necessary to specify the level of aggregation of data if small area data is available. Other influences include the choice of hyperprior distribution used for the precision estimates (e.g. gamma versus uniform), and the nature and sparseness of data. In this analysis, we are primarily concerned with the influence of different neighbourhood weight matrices on the amount of smoothing.

The CAR model has been used in many published studies, but only a few have provided justification on the choice of neighbourhood weight matrix structure. One exception is an ecological study to investigate the relationship between benzene emissions and the incidence of childhood leukaemia in Greater London, in which the authors considered three alternative levels of data aggregation in their analysis, and examined adjacency versus distance-based neighbourhood spatial weights for each of analysis [6]. For both the grid-level and ward-level analyses, they found that the adjacency based neighbourhood structure provided a better fit of the data, based on DIC (Deviance Information Criteria) comparisons. They also found a significant difference in the estimates of the spatially structured random effects between the distance-based and adjacency-based neighbourhood structures for the ward-level analysis for the model without any covariates. In another paper looking at the issue of spatial priors and single versus joint-disease models, the authors concluded that sensitivity to structural assumptions as well as hyperprior specification should be explored as part of any disease-mapping study [7].

A recent study of prostate cancer incidence in New York, recently published in the International Journal of Health Geographics, applied the CAR spatial model to obtain smoothed risk estimates at the ZIP-code level, and highlighted the use of distance-based weight functions in the model formulation [8]. While this paper included some sensitivity analysis on the choice of hyperpriors, the issue of neighbourhood weights was not addressed.

Other authors have used various specifications of the neighbourhood weight matrix. Wall [9] looked at spatial structure in the US SAT college entry exam results by state, having from one neighbour up to eight neighbours. A similar approached was used by Rasmussen [10] with Scottish lip cancer data and by MacNab [11] with chronic lung disease in neonatal intensive care units. Bell [12] used first-order neighbours for a spatial neighbour matrix in a CAR model describing the association of intrauterine growth restriction and area level covariates. English [13] mapped low birth weight to 0.5 km grids and used a CAR model to assess and adjust for residual spatial correlation using four neighbours for each cell (north, south, east and west) to describe spatial dependence. Kousa [14] geocoded acute myocardial infarctions in Finland to 10 km grids to examine spatial variation associated with geochemistry of ground water. The neighbours were defined using eight neighbours (side and corner) for each cell.

Abrial [15] used 23 km hexagonal grids to map cases of Bovine spongiform encephalopathy (BSE) Johnson [16] used adjacent zipcodes in a study on prostate cancer as the basis for geographical weighting. Other methods to define neighbours have included Euclidean distance [17], geographic distance and population size in prostate cancer [18].

In Australia, New South Wales (NSW) Health [19] recently used CAR models to produce smoothed maps of selected health indicators from 1999/2000 to 2003/2004 for 166 Local Government Areas in NSW. Similarly, the Cancer Council of NSW has provided on its website [20] maps of cancer incidence and mortality across New South Wales by Local Government Area (LGA) for the period 1998 to 2002. They used Bayesian methodology to smooth the maps of standardised incidence and mortality ratios.

The overall crude birth defect rate in NSW has decreased from 22.7/1,000 births in 1998 to 20.5 per 1,000 births in 2003 [21]. The only increases over this period were cases of chromosomal abnormalities which increased from 4.2 to 5.3, Cleft Palate (from 0.8 to 1.0 per 1000 births) and Down Syndrome which increased from 2.2 to 2.6 per 1,000 births. The spatial distribution of birth defects in NSW has only been published by very large spatial units (8 Area Health Services (AHS)) standardised for maternal age in the NSW population. The same report found that the Greater Southern AHS had the lowest rate of birth defects (15.7 per 1,000 births) and Hunter New England AHS had the highest (24.2 per 1,000 births) across the period 1998–2004. Spatial analysis at a smaller spatial unit than the 8 AHS within NSW will provide more information about the geographical distribution of the birth defects, and allow the development of hypotheses to explain this spatial variation.

More extensive assessment of the strengths and weaknesses of these, and other, possible approaches to neighbourhood weighting is urgently needed, since the results of analysis may vary substantially depending on the model chosen. Lawson [22] talks briefly about possible weighting schemes in the context of edge effects, including distance functions and surrogate measures derived from the perimeter of shared borders between neighbours. He also mentions the need to conduct sensitivity analysis on the choice of weights. However, no quantitative case-studies are shown to highlight this point. Best and colleagues [23], looked at the use of adjacency versus distance-based weights to define the neighbourhood structure for the residuals. However, their study examined just two specific weights (the rook adjacency and a distance decay function) and their results were based on a small dataset which included simulated risk structures. Model comparison was also done on the same data.

In another related study, Conlon [24] et al examined the effect of three different neighbourhood weight structures (namely fixed weights based on adjacency, parametric distance-based weights and distance-based covariances). For the limited data (again the Scottish lip cancer data) that they worked on, they found that the adjacency and variable covariance models seemed to provide better fit as compared to the variable distance model. In other words, they found differences according to the type of neighbours defined. Our study aims to look at a more comprehensive list of weight matrices, and the use of innovative measures to compare competing models.

## Aims

The main aims of our study were two-fold. Firstly, to explore any differences in the smoothing properties between the contiguity (adjacency) and distance-based methods of defining spatial weights. We also studied whether there were differences between the type and order of neighbours included within the contiguity method of neighbourhood definition. Secondly, for the distance-based method, we assessed the impact of including various formulations of the weight matrix. We performed external validation of the models by applying them to birth defects data in New South Wales.

## Methods

We obtained data on birth defects from the NSW Midwives Data Collection (MDC) and Birth Defects Register (BDR) databases from 1995 to 2003. We calculated standardised expected counts of total birth defects. For instance, the expected count of birth defects in each areal unit at a particular time period was defined as E_{i} = (Births_{i}/Totalbirths)*Totalbirthdefects, where Births_{i} refers to total births in the _{i}th SLA, and Totalbirths and Totalbirthdefects refer to the overall number of births and birth defects in the NSW study region for that particular time-period. Analyses were carried out at the SLA level, for which there were 198 SLAs defined within the NSW study area. These represent administrative districts that relate to local government jurisdictions. Statistical Local Area (SLA)-specific relative risk estimates were calculated as the ratio of the observed and expected counts for each area. Because a few of the SLA had no births recorded during a particular study period, we added a small constant (10^{-5}) to both the numerator and denominator to ensure that the relative risks were well-defined. This constant is absorbed by the smoothing of these extreme relative risk estimates in the subsequent analysis. The data were grouped into 3 equal three-year long time periods: 1995–1997, 1998–2000 and 2001–2003. After confirming that these three time periods were similar with respect to relevant measures, we used the first two time-periods to build the model coefficients and then assessed model fit using data from 2001–2003. We excluded cases that had missing data for year of birth and maternal age. Year of birth was needed to assign the cases to each of the three time-periods, whereas maternal age was required to create one of the weight matrices. Also, to ensure that only good quality geocoded addresses was used, we excluded indeterminate geocodes, geocodes resulting in many addresses, many streets, many localities and those without any matches.

The New South Wales (NSW) Midwives Data Collection is a population-based surveillance system covering all births in NSW public and private hospitals, as well as home births. The information for each birth is recorded by either the attending midwife or medical practitioner. It encompasses all live births and stillbirths of at least 20 weeks gestation or at least 400 grams birth weight. The MDC receives notifications of women whose usual place of residence is outside NSW but who give birth in NSW. However, the MDC does not receive notifications of births outside NSW to women usually resident in NSW [21].

The New South Wales BDR is a population-based surveillance system established to monitor birth defects detected during pregnancy or at birth, or diagnosed in infants up to one year of age. The BDR was established in 1990 and, under the NSW Public Health Act 1991, from 1 January 1998 doctors, hospitals, and laboratories have been required to notify birth defects detected during pregnancy, at birth, or up to one year of life [21]. For the purposes of this statistical methodological study we considered all birth defects together.

The MDC and BDR data for 1990 to 2003 have recently been geocoded using software developed by NSW Health and the Australian National University and the geocoding process is described in detail elsewhere [25].

Ethical approval was obtained for the use of the NSW Midwives Data Collection and the NSW Births Defects Registry data from the NSW Department of Health Ethics Committee, and for the study itself from the University of Sydney Ethics Committee.

_{ik}and E

_{ik}are the observed and expected birth defects for a SLA in the

*i*th region and

*j*th time period, u

_{i}is a spatially structured random effect and v

_{i}is a spatially unstructured random effect. We also added a quadratic temporal random effect term to capture time trends. This model is an amended version from Bernardinelli [26]. The main difference lies in the exclusion of the space-time interaction random effect term; because the main focus of this paper is a comparison of the prior imposed on the spatial random effect, the inclusion of an interaction term would potentially blur this comparison and increase the computational cost substantially. Possible spatial correlation was accommodated in the model by introducing a conditional autoregressive (CAR) prior for the spatial random effects, as shown below (from Lawson AB 2003: Disease Mapping with WinBUGS and MLwiN).

As we can see from the above equations, estimation of the risk in any area is conditional on risks in neighbouring areas. Subscripts i and j refer to an SLA and it's neighbour respectively, and j ε Ni where Ni represents the set of neighbours of region i. Besides the identification of neighbours, the assigned weights also affect the risk estimation. The weights for the adjacency and distance models are given by weights_{ij} (w_{ij}) = 1 if i,j are adjacent, and 0 otherwise. For the other distance-based models, various formulations of the weights (described in detail below) were used.

We also computed seven distance-based matrices. The simple distance-based matrix included all SLAs as neighbours and assigned them equal weights. Matrices Weight-1 to Weight-7 also include all SLAs as neighbours, but the weights were assigned differently. For Weights 1–3, the following formulations were used: w_{ij} = 1/dist_{ij}, w_{ij} = 1/dist^{2} _{ij} and w_{ij} = 1/dist^{3} _{ij} respectively. The weight matrix for the "Gravity" model was defined by w_{ij} = e_{i}e_{j}/dist_{ij}. The corresponding weight matrix for the "Entropy" model was defined by w_{ij} = exp(-10*dist_{ij}), and for the "Density" model: w_{ij} = (1/dist_{ij})*density_{i}*density_{j}, with dist_{ij} being the distance (decimal degrees) between the two SLAs, e_{i} and e_{j} being the standardised counts of births for an SLA and its respective neighbour, and density_{i} and density_{j} being the respective standardised birth population densities. A distance decay parameter of 10 was chosen, based on a preliminary exploratory examination of the correlogram of the relative risks over distance.

The weights for the "Gravity" and "Density" models were standardised against their mean and standard deviation for the purpose of comparability. Finally, for the Weight-7 model, the weights were w_{ij} = 1/(dist_{ij}*absolute(maternalage_{i}-maternalage_{j} +0.0001)), with maternalage_{i} and maternalage_{j} being the mean maternal ages in SLAs i and its neighbour j respectively. A small constant was needed to ensure that weights were defined for those pairs with identical values.

Our selection of the 7 distance-based models provides a variety of scenarios whereby the relative risks, in reality, are spatially correlated. The first three models (Weights 1–3) consider only distance in the weight function, placing greater weights on SLAs that are closer together. The "Gravity" model was used to examine whether placing greater weights on neighbours which themselves were relatively more populated, made a difference in smoothing. This was to examine the hypothesis that sparsely populated neighbours provide little information. The "Entropy" model was designed to provide a scenario whereby immediate neighbours were assigned most of the weights, and the weights were reduced drastically for those that were further away. This was done to exemplify a situation where one could expect localised environmental hazards to be present. The "Density" model was similar to the "Gravity" model, except that we weighted the neighbours according to the population density, instead of just the population.

For the covariate model, we chose maternal age mainly because this has been previously reported to be associated with birth defects in our study population (i.e. incidence of birth defects found to be increasing with maternal age in NSW [21]), and also because maternal age was less likely to be subject to recall bias as compared with other covariates, such as smoking.

The priors for the means were set to a normal distribution, with standard deviation set to cover a wide range of values, whereas the priors for the standard deviations of the precision estimates were set to a uniform distribution [27] with a wide yet plausible interval (i.e. range from 0.00001 to 20). This range was selected from initial exploratory analysis of the data.

We ran 12 different CAR models for the various adjacencies described above, using WinBUGS (version 1.4.1, Imperial College and Medical Research Council, UK). The models were run through Stata using a customised ado program file (written by Dr John Thompson, Department of Health Sciences, University of Leicester 2006). We discarded the first 40,000 samples as burn-in and ran a further 20,000 iterations which were used in the calculation of the posterior estimates. We ran two different chains, starting from diverse initial values and convergence was assessed using the Gelman-Rubin convergence statistic, as modified by Brooks and Gelman [28].

u_{i} is a spatially structured random effect and v_{i} is a spatially unstructured random effect, with i ranging from 1 to n = 198.

with *D* and p_{D} being the sum of the posterior mean deviance and estimate of the effective number of parameters.

Generally, smaller values of DIC are preferred. We used the model-selection decision criteria suggested by Best [7], to suggest that models with DIC values within 1 or 2 of the 'best' model are also strongly supported, values within 3 and 7, weakly supported, and models with a DIC greater than 7 are substantially inferior.

with O_{i} and ${\widehat{\theta}}_{i}$ being the observed and estimated number of birth defects respectively.

^{th}and 75

^{th}percentiles (Low: RR<0.65, Neutral: 0.65<RR<1.15, High: RR>1.15) and cross tabulated the observed with the predicted relative risk estimates. Using percentiles was a reasonable way to ensure enough numbers in each group to access sensitivity and specificity. To quantify the extent of change, we calculated the Kappa statistic [30], as a means to compare across models.

with *p*_{
o
}and *p*_{
e
}being the observed and expected proportion of agreement respectively.

In addition, we computed and mapped the probability of a relative risk (RR) more than one. Although a cut-off of 0.7 has been shown to provide reasonable sensitivity to detect areas with an elevated risk [31] for a range of scenarios having moderate expected counts and excess risks of about 1.5, we estimated our own optimal cut-offs using the receiver-operating characteristic (ROC) curve.

Data extraction, management, analysis and diagnostics were done in Stata (version 9.2, Stata Corp, College Station, USA) and the maps were produced in Stata as well as ArcMap version 9.0 (ESRI, USA). All the weight matrices were created using the GeoDA software (version 0.9.5-I, University of Illinois, USA) and Stata.

## Results

Characteristics of neighbourhood weight matrices

Neighbourhood Type | Mean | Median | Min | Max | SD | Sum |
---|---|---|---|---|---|---|

Queen-1 | 5 | 5 | 1 | 12 | 2 | 960 |

Queen-2 | 15 | 15 | 3 | 29 | 6 | 3018 |

Rook-1 | 5 | 5 | 1 | 11 | 2 | 956 |

Rook-2 | 15 | 15 | 3 | 29 | 6 | 3010 |

Distance | 197 | 197 | 197 | 197 | NA | 39006 |

Comparison of model fit and sensitivity of detecting areas with an elevated risk

Neighbourhood type | Kappa | Fraction | DIC | AUC* | Sensitivity of detecting SLAs with elevated risks (PP cut-off = 0.33) | Specificity |
---|---|---|---|---|---|---|

Queen-1 | 0.05 | 22% | 2283 | 0.61 | 77% | 41% |

Queen-2 | 0.05 | 51% | 2282 | 0.62 | 78% | 43% |

Rook-1 | 0.05 | 14% | 2282 | 0.62 | 76% | 41% |

Rook-2 | 0.05 | 41% | 2282 | 0.62 | 78% | 39% |

Distance | 0.07 | 41% | 2274 | 0.62 | 80% | 30% |

Weight-1 (1/distance) | 0.07 | 41% | 2213 | 0.62 | 80% | 30% |

Weight-2 (1/distance | 0.12 | 98% | 2204 | 0.61 | 75% | 44% |

Weight-3 (1/distance | 0.08 | 93% | 2218 | 0.59 | 75% | 46% |

Weight 4 (Gravity) | 0.15 | 99% | 2202 | 0.60 | 74% | 39% |

Weight 5 (Entropy) | 0.08 | 91% | 2227 | 0.60 | 74% | 47% |

Weight 6 (Density) | 0.14 | 97% | 2208 | 0.60 | 74% | 37% |

Weight 7 (Covariate) | 0.10 | 95% | 2210 | 0.62 | 74% | 47% |

In terms of fraction of random effect due to 'spatially structured random effects', the adjacency-based models, generally, had lower values as compared with the distance-based models. For instance, when we used the Queen-1 matrix, only 22% of the variation in the relative risks could be attributed to spatial effects. Among the distance-based models, the 'Gravity' model had the highest value (fraction = 99%), followed by Weight-2 (fraction = 98%) and 'Density' models (fraction = 97%).

When we examined the DIC as a basis of model-selection, we found that the 'Gravity' model had the lowest DIC of 2202, followed by Weight-2 (DIC = 2204) and 'Density' model (DIC = 2208). Generally, the adjacency-based matrices had higher DICs.

Using the decision tool suggested by Richardson *et al.*[31], we also compared the models in terms of their ability to detect areas with an elevated risk (i.e. RR>1.15). When we used the cut-off of 0.7 as suggested by their study, we found that all the models performed well in terms of specificity, but poorly in terms of sensitivity (data not shown).

The ROC analysis indicated that the posterior probabilities from the distance-based models had a similar discriminatory ability (i.e. same area under the curve) compared to the adjacency-based models (Table 2). However, the sensitivities can be improved by choosing a different threshold. When we used a threshold of 0.33 as determined by our ROC analysis to optimise sensitivity, we found some improvements in the models. For instance, the Queen-1 model was now able to correctly classify 36/47 high-risk areas (sensitivity 77%) with a specificity of 44%. The distance-based neighbourhood matrices had similar ranges of sensitivities and specificities. As with all such models, the choice of threshold depends on the inferential aims of the analysis, including the loss or cost associated with making a wrong positive or negative decision.

Comparison of amount of smoothing performed, stratified by size of population

Neighbourhood type | RSS | RSS (Areas with low expected count)* | RSS (Areas with high expected count) |
---|---|---|---|

Queen-1 | 91427 | 91254 | 173 |

Queen-2 | 91349 | 91176 | 174 |

Rook-1 | 91150 | 90976 | 174 |

Rook-2 | 90975 | 90802 | 173 |

Distance | 88987 | 88816 | 171 |

Weight-1 (1/distance) | 88987 | 88816 | 171 |

Weight-2 (1/distance | 89612 | 89436 | 176 |

Weight-3 (1/distance | 92666 | 92490 | 176 |

Weight 4 (Gravity) | 87510 | 87330 | 179 |

Weight 5 (Entropy) | 90550 | 90378 | 172 |

Weight 6 (Density) | 87336 | 87162 | 174 |

Weight 7 (Covariate) | 79478 | 79292 | 185 |

In terms of diagnostics, the Gelman and Rubin plots indicated convergence after about 20,000 iterations for the posterior estimates of the regression coefficients, 3 randomly selected relative risk estimates and 3 randomly selected posterior probability estimates. The 'fraction' parameters took a longer time to converge (around 40,000 iterations); thus for consistency, we discarded the first 40,000 iterations for all the parameters. Due to the complex weight structures, the models were computationally intensive, and a further 20,000 iterations provided us with a reasonable Monte Carlo standard error (less than 1% of the standard deviation) for the estimates.

## Discussion

We found considerable differences in the smoothing properties of the CAR model, depending on the type of neighbours specified. This in turn had an effect on the models' ability to predict the observed risk in an area. These results have significant implications for all researchers using CAR models, since the neighbourhood weight matrices chosen may markedly influence a study's findings.

For instance, if one were primarily concerned with classifying areas into low/high risk of birth defects, the distance-based models appear to perform better than the adjacency-based ones. These models also have a higher Kappa, indicating low levels of changes in relative risk estimates across epidemiologically relevant thresholds. While we used Kappa with equal weights for the different categories, it is possible to use a weighted Kappa instead and assign higher weights for more important categories (e.g. smoothing a high relative risk).

If the aim were to explain away the spatial relationship in the relative risk estimates, then again distance-based models, such as 'Gravity' or Weight-2 models might be useful. Conversely, if one wants to preserve the spatial structure of the relative risks and examine the relationship between covariates that were spatial in nature, then one might prefer a model that has a low fraction of random effect due to spatially structured random effects to begin with.

The DIC appears to reflect the choice of models based on the level and nature of smoothing performed. For instance, the model with the lowest DIC, 'Gravity', had a high fraction (99%) and a high Kappa (0.15) as well. The Weight-2 model also seems to be 'strongly supported'. However, reliance on just the DIC alone fails to account for the nature of spatial relationship inherent in the model.

In terms of detecting areas with an elevated risk, we found that using information from the posterior probability had a higher sensitivity than looking at the smoothed relative risks alone. For instance, in the 'Covariate' model, using the smoothed (predicted) relative risk allowed us to detect 11 (22%) of the 50 SLAs with an elevated risk, as compared to 74% if we used information from the posterior probability instead.

As illustrated by the ROC analysis, the choice of threshold in the posterior probabilities involves a trade-off between sensitivity and specificity. Depending on the aims of the study, one should choose an appropriate cut-off point, using the ROC analysis. If for instance, one were to undertake exploratory spatial analysis to generate hypothesis on possible explanatory factors of elevated birth defect rates at an areal level, one could choose a low sensitivity but with a high specificity, so that the false negatives are minimised.

Our finding that distance-based neighbourhood models perform better than adjacency models is not surprising. This can be attributed to the highly irregular shapes and sizes of the SLAs (see Figure 1). The adjacency models can be expected to perform better with regular shaped areas such as grids.

The Kappa values in our study ranged from 0.05 to 0.14. While these may seem to afford modest values of agreement, we do note that these were ecological models and the models were evaluated on an 'external' time-period.

It is also worth mentioning the relatively good performance of the 'Gravity' model, which had the highest Kappa, the highest fraction of random effect due to spatially structured random effects and the lowest DIC. One current limitation of the CAR model is that it 'borrows strength' from neighbours even if they themselves are sparsely populated. The 'Gravity' model weighs neighbours according to the size of their population, and we have shown that this improves precision. The importance will be more marked for sparsely populated maps.

In our analysis, we used the simple spatial formulation of the CAR model comprising of spatially structured and spatially unstructured random effects and a temporal term. The purpose was not to make comparisons with the other formulations of the CAR model (e.g. mixture model, spatio-temporal interaction models, multivariate CAR models, etc), but further research might examine if these results reported here can be replicated in those models as well. This is also not the first time this particular space-time model has been applied to study epidemiological data. Assuncao and colleagues have used a similar model to map and project the rates of visceral Leishmaniasis in Belo Horizonte, Brazil across 117 study areas and 3 time points [32]. For our CAR models, we also used the Uniform priors on the standard deviations, instead of a Gamma prior on the precision estimates, as recent research has identified problems associated with the Inverse-Gamma prior [27], in particular the poor performance of the prior in terms of being non-informative.

The thresholds used in our definition of epidemiologically relevant cut-offs for the relative risks in our study may seem arbitrarily selected (based on the 25^{th} and 75^{th} percentiles). However, the same thresholds were used for all models, thus ensuring comparability, and we do not believe that the choice of alternative cut-offs would affect inferences.

It was also not the aim of this paper to undertake studies of association or ecological regression models, although covariates and interactions can easily be included in the existing models. Our research group is currently undertaking work to examine the impact of socio-economic status, demographic and environmental risk factors of adverse birth outcomes at an areal-level. A complete understanding of the structural form of CAR models is needed before this process of ecological modelling is pursued. Future work on incorporating landscape features and spatial smoothing based on additional covariates (e.g. multivariate similarity index) may improve the performance of the CAR models in disease mapping studies.

## Conclusion

Disease mapping studies that make use of the CAR model to smooth relative risks at some areal level need to take into account structural forms of the model specified. Depending on the aims of the study, various forms of the neighbourhood weight matrices provide differential levels of smoothing. Prior to risk mapping or ecological modelling, the weight matrix should be chosen according to the inferential and decision-theoretic aims of the study or through an exploratory analysis of the nature and degree of spatial correlation. In addition, a sensitivity analysis on the choice of neighbourhood weight matrix should be performed.

## Declarations

### Acknowledgements

The authors acknowledge thesupport of the Australian Research Council Linkage GrantLP0348628, the North Coast Area Health Service, the NSW Department of Health, the Commonwealth Department of Health and Ageing, Dr Lee Taylor (NSW Health), Douglas Lincoln, Paul Houlder, Therese Dunn and Danielle Taylor.

## Authors’ Affiliations

## References

- Elliott P, Wartenberg D: Spatial epidemiology: current approaches and future challenges. Environmental Health Perspectives. 2004, 112 (9): 998-1006.PubMedPubMed CentralView ArticleGoogle Scholar
- Carlin BP, Louis TA: Bayes and empirical Bayes methods for data analysis. 2000, New York, USA: Chapman & Hall/CRCView ArticleGoogle Scholar
- Lawson AB, Biggeri AB, Boehning D, Lesaffre E, Viel JF, Clark A, Schlattmann P, Divino F: Disease mapping models: an empirical evaluation. Disease Mapping Collaborative Group. Stat Med. 2000, 19 (17–18): 2217-2241.PubMedGoogle Scholar
- Besag J, York J, Mollie A: Bayesian image restoration with application in spatial statistics. Ann Inst Math Stat. 1991, 43: 1-59. 10.1007/BF00116466.View ArticleGoogle Scholar
- Gelman A, Carlin JB, Stren HS, Rubin DB: Bayesian Data Analysis. 2003, Chapman & Hall, CRC Press, SecondGoogle Scholar
- Best N, Cockings S, Bennett J, Wakefield J, Elliott P: Ecological regression analysis of environmental benzene exposure and childhood leukaemia: sensitivity to data inaccuracies, geographical scale and ecological bias. J R Statist Soc A. 2001, 164: 155-174. 10.1111/1467-985X.00194.View ArticleGoogle Scholar
- Best N, Richardson S, Thomson A: A comparison of Bayesian spatial models for disease mapping. Stat Methods Med Res. 2005, 14 (1): 48-10.1191/0962280205sm388oa.View ArticleGoogle Scholar
- Johnson GD: Small area mapping of prostate cancer incidence in New York State (USA) using fully Bayesian hierarchical modelling. Int J Health Geogr. 2004, 8:3 (1): 29-10.1186/1476-072X-3-29.View ArticleGoogle Scholar
- Wall MM: A close look at the spatial structure implied by the CAR and SAR models. Journal of Statistical Planning and Inference. 2004, 121: 311-324. 10.1016/S0378-3758(03)00111-3.View ArticleGoogle Scholar
- Rasmussen S: Modelling of discrete spatial variation in epidemiology with SAS using GLIMMIX. Computer Methods & Programs in Biomedicine. 2004, 76: 83-89. 10.1016/j.cmpb.2004.03.003.View ArticleGoogle Scholar
- MacNab YC: Hierarchical Bayesian spatial modelling of small-area rates of non-rare disease. Statistics in Medicine. 2003, 22: 1761-1773. 10.1002/sim.1463.PubMedView ArticleGoogle Scholar
- Bell BS: Spatial analysis of disease – applications. Biostatistical Applications in Cancer Research. Edited by: Beam C. 2002, Kluwer Academic Publishers: Boston, 151-182.View ArticleGoogle Scholar
- English PB, Kharrazi M, Davies S, Scalf R, Waller L, Neutra R: Changes in the spatial pattern of low birth weight in a southern California county: the role of indivdual and neighbourhood level factors. Social Science & Medicine. 2003, 56 (10): 2073-2088. 10.1016/S0277-9536(02)00202-2.View ArticleGoogle Scholar
- Kousa A, Moltchanova E, Viik-Kajander M, Rytkonen M, Tuomilehto J, Tarvainen T, Karvonen M: Geochemistry of ground water and the incidence of acute myocardial infarction in Finland. J Epidemiol Community Health. 2004, 58: 136-139. 10.1136/jech.58.2.136.PubMedPubMed CentralView ArticleGoogle Scholar
- Abrial D, Calavas D, Jarrige N, Ducrot C: Spatial heterogeneity of the risk of BSE in France following the ban of meat and bone meal in cattle feed. Preventive Veterinary Medicine. 2005, 67: 69-82. 10.1016/j.prevetmed.2004.10.004.PubMedView ArticleGoogle Scholar
- Johnson GD: Small area mapping of prostate cancer incidence in New York State (USA) using fully Bayesian hierarchical modelling. International Journal of Health Geographics. 2004, 3 (1): 29-10.1186/1476-072X-3-29.PubMedPubMed CentralView ArticleGoogle Scholar
- Cressie N, Chan NH: Spatial modelling of regional variables. Journal of the American Statistical Association. 1989, 84: 393-401. 10.2307/2289922.View ArticleGoogle Scholar
- Lopez FJA, Sanmartin P: Spatial regression models in epidemiological studies. Disease mapping and risk assessment in public health. Edited by: Lawson AB, et al. 1999, Wiley: ChichesterGoogle Scholar
- Public Health Division: The health of the people of New South Wales – Report of the Chief Health Officer. Sydney. NSW Department of Health. Accessed 22 March 2007, [http://www.health.nsw.gov.au/public-health/chorep/toc/choindex.htm]
- Bois JP, Clements MS, Yu XQ, Supramaniam R, Smith DP, Bovaird S, O'Connell DL: Cancer Maps for New South Wales 1998 to 2002. 2007, Sydney: The Cancer Council NSW, Accessed 13 August 2007, [http://www.cancercouncil.com.au/editorial.asp?pageid=2297]Google Scholar
- Centre for Epidemiology and Research, NSW Department of Health: New South Wales Mothers and Babies 2004. N S W Public Health Bull. 2005, 16 (Suppl S4):Google Scholar
- Lawson AB: Statistical Methods in Spatial Epidemiology. 2006, John Wiley & Sons, SecondView ArticleGoogle Scholar
- Best NG, Arnold RA, Thomas A, Waller LA, Conlon EM: Bayesian models for spatially correlated disease and exposure data (with discussion). In Proceedings of the 6th Valencia International Meetings on Bayesian Statistic. Bayesian Statistics 6. Edited by: Bernardo JM, Berger JO, David AP, Smith. 1999, Oxford: Oxford University Press, 131-156.Google Scholar
- Conlon EM, Waller LA: Flexible spatial hierarchical models for mapping disease rates. In Proceedings of A.S.A. Section on Statistics and the Environment: Washington, DC. 1999, American Statistical Association, 82-87.Google Scholar
- Summerhayes R, Holder P, Beard J, Morgan G, Christen P, Willmore A, Churches T: Automated geocoding of routinely collected health data in New South Wales. N S W Public Health Bull. 2006, 17 (3–4): 33-8.PubMedGoogle Scholar
- Bernardinelli L, Clayton D, Pascutto C, Montomoli C, Ghislandi M, Songini M: Bayesian analysis of space-time variation in disease risk. Statistics in Medicine. 1995, 14: 2433-2443. 10.1002/sim.4780142112.PubMedView ArticleGoogle Scholar
- Gelman A: Prior distributions for variance parameters in hierarchical models. Bayesian Analysis. 2005, 1 (2): 1-19.Google Scholar
- Brooks SP, Gelman A: Alternative methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics. 1998, 7: 434-455. 10.2307/1390675.Google Scholar
- Spiegelhalter DJ, Best NG, Carlin BP, Van der Linde A: Bayesian measures of model complexity and fit (with discussion). J Roy Statist Soc B. 2002, 64: 583-640. 10.1111/1467-9868.00353.View ArticleGoogle Scholar
- Cohen J: A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960, 20: 37-46. 10.1177/001316446002000104.View ArticleGoogle Scholar
- Richardson S, Thomson A, Best N, Elliott P: Interpreting posterior relative risk estimates in disease-mapping studies. Environ Health Perspect. 2004, 112 (9): 1016-1025.PubMedPubMed CentralView ArticleGoogle Scholar
- Assunção RM, Reis IA, Oliveira CD: Diffusion and prediction of Leishmaniasis in a large metropolitan area in Brazil with a Bayesian space-time model. Stat Med. 2001, 20 (15): 2319-2335. 10.1002/sim.844.PubMedView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.