Effects of study area size on geographic characterizations of health events: Prostate cancer incidence in Southern New England, USA, 1994–1998
© Gregorio et al; licensee BioMed Central Ltd. 2006
Received: 28 November 2005
Accepted: 15 February 2006
Published: 15 February 2006
We consider how representations of geographic variation in prostate cancer incidence across Southern New England, USA may be affected by selection of study area and/or properties of the statistical analysis.
A spatial scan statistic was used to monitor geographic variation among 35,167 incident prostate cancer cases diagnosed in Massachusetts, Connecticut and Rhode Island from 1994 to 1998, in relation to the 1990 populations of men 20+ years of age living in that region. Results from the combined-states analysis were compared to those from single-states. Impact of scanning procedures set to examine up to 50% or no more than10% of at-risk populations also was evaluated.
With scanning set to 50%, 5 locations in the combined-states analysis were identified with markedly distinct incidence rates. Fewer than expected cases were estimated for nearly all Connecticut, Rhode Island and West Central Massachusetts, whereas census tracts on and around Cape Cod, and areas of Southwestern Connecticut and adjacent to greater Boston were estimated to have yielded more than expected incidence. Results of single-state analyses exhibited several discrepancies from the combined-states analysis. More conservative scanning found many more locations with varying incidence, but discrepancies between the combined- and single-state analysis were fewer.
It is important to acknowledge the conditional nature of spatial analyses and carefully consider whether a true cluster of events is identified or artifact stemming from selection of study area size and/or scanning properties.
Spatial analyses of health events can provide helpful information that informs our understanding of the determinants and control of diseases within populations. Geographic studies have discerned the non-random nature of health hazards , at-risk populations , disease occurrence [3, 4], progression , screening , treatment [7, 8], and end results [9, 10].
By their nature, spatial analyses of health events are zero sum problems wherein overall rates (cases per 100,000 persons), proportions (deaths among diagnosed cases) or case counts (birds carrying West Nile virus) applicable to a defined study area (nation, region, state) are disaggregated to measure relative differences across smaller analytic units (counties, census tracts, exact coordinates). Changing event counts and/or underlying populations by expanding or contracting study area size and/or modifying properties of the spatial statistic can affect estimates of spatial variation therein. Similarly, the sensitivity of the spatial statistic to identify event clusters specific to any given location is known to vary by changing the proximity of that location to a study area's boundaries . As such, findings for any given spatial analysis are best considered as conditional and modifiable as a consequence of study area size and/or properties of statistical procedures.
Nationwide efforts to foster regional health information networks/organizations (RHINs/RHIOs) that span traditional geo-political boundaries demand greater understanding of how aggregating health and population data may affect analysis and interpretation of disease patterns. To date, there are few opportunities to evaluate consequences of study area size selection. Sharing health related data across states or regions is uncommon, if not restricted, in the interest of protecting individual privacy and confidentiality of information. Moreover, inconsistencies across states regarding their use of geocoding references, statistical and mapping software further limit possibilities to pool/combine data for multi-state studies. Hence, researchers have limited guidance as to how (and to what extent) findings may change by modification of the study area.
We previously described provisional qualities of spatial analyses related to geocoding , choice of statistical methods [13, 14]; surveillance period , covariate adjustment , and spatial units chosen for analysis . Here, we consider the conditional effect of study area size on the representation of health events. The situation is illustrated using data on prostate cancer incidence in Southern New England, USA. The data reported here are unusual regarding both their level of detail (census tract for cases and population) and coverage (3 contiguous jurisdictions – states). Discerning the potentials and pitfalls of spatial analytic methods will facilitate the dissemination of methods among researchers and practitioners focused on health surveillance and health system evaluation.
Prostate cancer incidence (1994–1998) and population (1990) for Southern New England and single states, USA.
Coded Cases (%)
Avg. Annual incidence2
Rhode Island (RI)
Combined-states study area
Geographic variation of prostate cancer incidence using the default (50%) scanning window according to selected study areas across Southern New England, USA, 1994–1998.
Size (sq km)
CT, MA & RI
Rhode Island (RI)
When data regarding Connecticut, Rhode Island and Massachusetts were examined simultaneously, 5 locations were identified as having incidence rates likely to differ significantly (p < 0.05) from elsewhere across the combined-states study area. For most of Rhode Island, Connecticut and West Central Massachusetts (Area 1) the age-adjusted average annual incidence rate was estimated to be 91% of expectation relative to the rate among men living elsewhere within the Southern New England region. For a considerably more circumscribed location north of Greater Boston (Area 4), the incidence rate was estimated to be only 49% of the rate observed elsewhere around the combined-states study area.
By comparison, census tracts on and around Cape Cod (Area 2) were estimated to have had an incidence rate 27% greater than other locations within the combined-states study area. Tracts in Southwestern Connecticut (Area 3) and those to the immediate southwest of Greater Boston (Area 5) were observed to have rates estimated to be 33% and 26% higher, respectively, than rates found elsewhere within the study area.
Single-state study areas
While much consistency between the combined and single-state analyses was evident, several important differences were evident. When considering Massachusetts by itself, for example, 6 locations were identified with rates that differed markedly from elsewhere around the State. Consistent with earlier results, census tracts in the western half of the State (Area 6) yielded an age-adjusted average annual incidence rate 81% of that observed outside that location. Additional locations with markedly low incidence again were found along the Massachusetts borders with Rhode Island (Area 9) and New Hampshire (Area 10).
As in the combined-states analysis, the most likely location of elevated cancer incidence specific to Massachusetts was found among census tracts on and around Cape Cod (Area 7) where the incidence rate was estimated to be 1.26-times greater than expectation. Census tracts around greater Boston (Area 8) revealed a significantly high rate of disease (1.15-times greater than expectation) that spatially encompassed considerably more area, cases and persons at-risk than previously detected within Area 5. Equally noteworthy, the state-specific analysis yielded a location north east of the city (Area 11), with a significantly elevated incidence rate (RR = 1.20) that previously was not identified by the combined-states analysis. Whether this location merits specific attention for disease control efforts depends on which study area is selected for analysis.
Rates specific to Connecticut includes 4 locations that differed from the statewide pattern and finding based on the combined-states study area. Census tracts of Southwestern Connecticut (Area 12) were found, as in Area 3, to have greater than expected incidence (RR = 1.28 in relation, this time, to the rate elsewhere around Connecticut). Whereas the combined-states analysis found the bulk of census tracts across the state to have a lower than expected incidence rate (Area 1), the single-state analysis identified much of the state as having had rates that were not remarkably different from the statewide experience. Here, lower than expected rates were limited to at-risk persons living around West Central Connecticut (Area 13) and the eastern most portions of the State (Area 14). A potential concentration of greater than expected incidence that went unrecognized in the combined-states analysis was a location in North Central Connecticut (Area 15) that included more than 116,000 at-risk men to have had an incidence rate 1.22-times greater than expectation.
The most noticeable disparity between analysis of combined and single-state study areas pertained to Rhode Island where the combined-states analysis suggested nearly all at-risk men were at lower than expected risk of disease. Subsequently in the single-state analysis, however, incidence rates across much of the state appear to have been at or above the overall statewide rate of disease. Here, only among at-risk men living within census tracts along the State's northern border (Area 17) was it estimated that prostate cancer occurred at a rate below that (87%) of what occurred elsewhere around the Rhode Island. In the single-state analysis, men living in South Central census tracts situated around Narragansett Bay (Area 16) were found to have experienced an average annual age-adjusted incidence rate 1.39-times greater than expectation.
Use of a more restrictive scanning setting
The problem of edge effects and selection of study area can be overcome, to a degree, by modifying properties of the spatial statistic. By rejecting the default SaTScan settings and limiting the spatial scan procedure to include a smaller portion of a study area's at-risk population it is possible to reduce the likelihood that identified clusters will reach or span single-state boundaries. To illustrate, we compared results of combined and single-state analyses when the size of the spatial scan was limited to include no more than 10% of a study area's at-risk population (361 K for the combined-states analysis, 116 K within Connecticut, 35 K within Rhode Island and 210 K within Massachusetts).
Geographic variation of prostate cancer incidence using of a restrictive (10%) scanning window according to selected study areas across Southern New England, USA, 1994–1998.
Size (sq km)
CT, MA & RI
Rhode Island (RI)
Patterns observed in the combined-states analysis generally hold for analyses specific to Massachusetts and Connecticut, but as before, the story regarding Rhode Island changes more notable depending on the study area examined. The combine-state analysis yielded evidence of a localized area along the eastern shore of Narragansett Bay with greater than expected incidence, while the northern portion of the state revealed a lower than expected rate of disease. Analysis specific to Rhode Island, however, identified a larger area presumed to have elevated disease rates, while the remainder of the state (with exception of 2 small pockets of low incidence) exhibited rates consistent with the statewide pattern.
This paper examined prostate cancer incidence in Southern New England, 1994–1998, in order to describe whether and how selection of study areas and/or properties of the statistical method could affect estimates of geographic variation among health events. We found combined- and single-state analyses to share much in common, but several discrepancies were noted between approaches. Our analysis also discerned that the extent of discrepancies between combined- and single-state analyses could be reduced by modifying properties of the statistical analysis; limiting the capacity to scan at-risk population for potential disease clusters, reduced the likelihood that identified clusters would span area boundaries.
In essence, 'artifact' resulting from study area size and selection of scanning properties is inevitable in spatial analysis of health events. Understanding the origins of such 'error' is an important step in effectively utilizing available technologies for better disease control. Data analysts must balance a desire for specificity of location of possible event clusters (using a restrictive scanning window) with practical considerations of needing to draw valid generalizations about patterns across large populations or study areas (using a less restrictive scanning window). Studies suspecting focused clusters and those involving limited geographic area may be suitable for more restrictive scanning windows, whereas exploratory analyses and those involving large geographies (regions, nations) may find such restriction impractical (given the likelihood of identifying a large number of clusters) or ill-advised (given the greater potential for Type II error). The volume and severity of edge effects produced necessarily will vary by such decisions.
It could be that when the reference rate for pooled data exceeded the rate of an individual state, the higher expected rate for the expanded study area reduced the likelihood that particular places would exhibit rates that were significantly higher than that new expectation, whereas the likelihood observing places where rates were significantly below that expectation would have been somewhat greater. In most but not all findings reported in Tables 2 and 3, the changes in estimated ratios of observed-to-expected incidence for specific locales were consistent with the modification of the baseline rates from the combined to the single-state study areas. Most illustrative of were changes related to Rhode Island data.
Here, we considered geographic variation in cancer incidence across three jurisdictions (states) that are distinguishable regarding their respective social, political, economic, health care and environmental systems and for which data furnished from three independent registries that may have differed regarding definitions, techniques and standards for reporting cancer incidence. Hopefully, the analysis, unusual for its detail (census tract data) and coverage (3 states), will foster greater appreciation of the opportunities and challenges of pooling health data from contiguous jurisdictions.
Fully distinguishing 'real' variation due to the geographic distribution of risk, rather than artifact attributable to study area, statistical procedures and/or data systems may not be possible. How particular findings might differ by adding/deleting adjacent areal units to a study area is not typically considered by investigators. Consequently, spatial analysis results may be rightfully considered conditional upon the particular geography selected for study. Unlike epidemiology studies of disease etiology or clinical effect where sampling assures cases are representative of an underlying population, geographic studies of health events do not similarly sample locations within a 'population' of possible places for study, but rather, rely on contiguous areas often aggregated by administrative/political reasons. Short of analyzing entire geographies, there are no a priori ways to distinguish the appropriate size or location of study area. Decisions typically rest on suspicion/anecdote regarding the uniqueness of settings and/or the availability of data for study. Hence, these findings underscore the conditional nature of spatial analyses and call for careful consideration before asserting 'true' clusters of events are present.
For the future, states and similar jurisdictions must pursue strategies that maximize potential for data to be pooled and analyzed across conventional geopolitical boundaries. Investment in geocoding, reference street files, data systems and GIS software should commit to principles of data sharing at the same time that procedures are implemented to maintain privacy of personal and group information.
Southern New England states of Connecticut, Massachusetts and Rhode Island consist of 17,644 square miles spatially organized within 3 States, 27 counties, 559 towns and 2,400 census tracts. It is home to approximately 3.6 million men 20 years of age and older. The geography of cancer incidence during this period was examined in relation to the populations-at risk within census tracts as enumerated by the 1990 U.S. Decennial Census of the Population, broken down according to ten-year age categories (i.e., 20–29 years, 30–39, 40–49, 50–59, 60–69, 70–79, 80+) . Between 1994 and 1998, a total of 38,956 incident invasive prostate cancers (ICD-9-CM code # 185) were recorded by statewide tumor registries in Massachusetts, Connecticut and Rhode Island. For 35,167 records (90%), the census tract of residence at the time of diagnosis was known and successfully assigned geographic coordinates for analysis; 3,789 records lacked sufficient information to assign a census tract and therefore were excluded from further analysis. The proportion of records assigned census tract locations was substantially greater for Connecticut (94%) and Massachusetts (90%) than Rhode Island (81%). Excluded records typically contained no, incomplete or ambiguous street addresses or addresses that cited P.O. Boxes in place of street addresses. Reason for differences across states was not readily discerned. Previous work suggests that failure to geocode cancer events somewhat under-represented cases among urban dwellers .
Based on records available for study, variation in average annual age-adjusted incidence rates across census tracts was evaluated using a spatial scan statistic . The procedure utilizes a large number of scanning circles (>100 K) of varying size and location to search for places (1 or more census tracts independent of conventional geo-political boundaries) where the number of observed cases deviated from a null hypothesis that incidence was proportional to population density (random). Age-adjusted case counts and disease rates within and outside particular circles were determined by SaTScan 5.1software .
The spatial scan statistic is well suited for disease surveillance, as it does not require a priori assumptions about the number, place or size of locations or direction of effect that may be identified. It takes into account the uneven geographic distribution of the population at risk and, as required, accounts for any number of possible confounding variables. The significance of identified clusters is evaluated using Monte Carlo procedures, with adjusted p-values for multiple testing, to designate locations (clusters of census tracts) where incidence varied from the null. Results of the spatial scan statistic are considered to be conservative estimates of the likelihood of observing events within given locations, relative to places elsewhere around the study area .
Spatial analyses of prostate cancer incidence were completed for the 3 state study area of Southern New England, along with analyses specific to Connecticut, Rhode Island or Massachusetts. Findings of significantly high or low concentrations of incident cases are reported in Tables 2 and 3 and illustrated, using Maptitude® software , in Figures 1 and 2.
This publication/project was made possible through a Cooperative Agreement between the Centers for Disease Control and Prevention (CDC) and the Association of Teachers of Preventive Medicine (ATPM), award number U50/CCU300860 project number TS-0431; its contents are the responsibility of the authors and do not necessarily reflect the official views of the CDC or ATPM.
- Colwell R: Infectious disease and environment: Cholera as a paradigm for waterborne disease. International Microbiology. 2004, 7: 285-289.PubMedGoogle Scholar
- Iceland J, Weinberg DH, Steinmetz E: U.S. Census Bureau, Series CENSR-3, Racial and Ethnic Residential Segregation in the United States: 1980–2000. 2002, Washington, DC: U.S. Government Printing OfficeGoogle Scholar
- Chaput EK, Meek J, Heimer R: Spatial analysis of human granulocytic ehrlichiosis near Lyme Connecticut. Emerging Infectious Diseases. 2002, 8: 943-948.PubMedPubMed CentralView ArticleGoogle Scholar
- Klassen AC, Kulldorff M, Curriero F: Geographical clustering of prostate cancer grade and stage at diagnosis, before and after adjustment for risk factors. International Journal of Health Geographics. 2005, 4: 1-10.1186/1476-072X-4-1.PubMedPubMed CentralView ArticleGoogle Scholar
- Rushton G, Peleg I, Banerjee A, Smith G, West M: Analyzing geographic patterns of disease incidence: rates of late stage colorectal cancer in Iowa. Journal of Medical Systems. 2004, 28: 223-236. 10.1023/B:JOMS.0000032841.39701.36.PubMedView ArticleGoogle Scholar
- Legler J, Breen N, Meissner H, Malec D, Coyne C: Predicting patterns of mammography use: A geographic perspective on national needs for intervention research. Health Services Research. 2002, 37: 929-947. 10.1034/j.1600-0560.2002.59.x.PubMedPubMed CentralView ArticleGoogle Scholar
- Gregorio DI, Kulldorff M, Barry L, Samociuk H, Zarfos K: Geographical differences in primary therapy for early-stage breast cancer. Annals of Surgical Oncology. 2001, 8: 844-849.PubMedView ArticleGoogle Scholar
- Jack RH, Gulliford MC, Ferguson J, Moller H: Geographic inequalities in lung cancer management and survival in South East England: evidence of variation in access to oncology services?. British Journal of Cancer. 2003, 88: 1025-1031. 10.1038/sj.bjc.6600831.PubMedPubMed CentralView ArticleGoogle Scholar
- Kulldorff M, Feuer EJ, Miller BA, Freedman LS: Breast cancer clusters in the Northeast United States: A geographic analysis. American Journal of Epidemiology. 1997, 146: 1616-1620.View ArticleGoogle Scholar
- Lanska DJ, Kuller LH: The geography of stroke mortality in the United States and the concept of a stroke belt. Stroke. 1995, 26: 1145-1149.PubMedView ArticleGoogle Scholar
- Monmonier M: How to lie with Maps. 1996, Chicago: University of Chicago Press, 2View ArticleGoogle Scholar
- Gregorio DI, Cromley E, Tate JP, Mrozinski R, Walsh SJ, Flannery J: Subject loss in spatial analysis of breast cancer. Health and Place. 1997, 5: 173-177. 10.1016/S1353-8292(99)00004-0.View ArticleGoogle Scholar
- Kulldorff M, Song C, Gregorio DI, Samociuk H, DeChello L: Cancer map patterns: Are they random or not?. American Journal of Preventive Medicine (Forthcoming, 2006).
- Fang Z, Kulldorff M, Gregorio DI: Brain Cancer in the United States, 1986–95: A geographic analysis. Neuro-Oncology. 2004, 6: 78-82. 10.1215/S1152851703000450.View ArticleGoogle Scholar
- Gregorio DI, Kulldorff M, Sheehan TJ, Samociuk H: Geographic distribution of prostate cancer incidence in the era of PSA testing. Urology. 2004, 63: 78-82. 10.1016/j.urology.2003.08.008.PubMedView ArticleGoogle Scholar
- Sheehan TJ, DeChello L, Kulldorff M, Gregorio DI, Gershman S, Mroszczyk R: The geographic distribution of breast cancer incidence in Massachusetts 1988 to 1997, adjusted for covariates. International Journal of Health Geographics. 2004, 3: 17-28. 10.1186/1476-072X-3-17.View ArticleGoogle Scholar
- Gregorio DI, DeChello L, Samociuk H, Kulldorff M: Lumping or splitting: Can a standard areal unit for health geography studies be selected?. International Journal of Health Geographics. 2005, 4: 6-15. 10.1186/1476-072X-4-6.PubMedPubMed CentralView ArticleGoogle Scholar
- Census of Population and Housing (1990). [United States]: Summary Tape File 1, Connecticut. [http://www.census.gov]
- Kulldorff M: A spatial scan statistic. Communications in Statistics: Theory and Methods. 1997, 26: 1481-1496.View ArticleGoogle Scholar
- Kulldorff M, Information Management Services, Inc: SaTScan™ v. 5.1: Software for the spatial and space-time scan statistics. (12/30/2004), [http://www.satscan.org]
- Breslow NE, Day NE: Statistical Methods in Cancer Research, Volume II – The Design and Analysis of Cohort Studies. 1987, Lyon: International Agency for Research on CancerGoogle Scholar
- Caliper Corporation: Maptitude Geographic Information System for Windows. Version 4.5. Newton, MA. 2001Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.