- Methodology
- Open Access
Assessing the effects of variables and background selection on the capture of the tick climate niche
- Agustín Estrada-Peña†1Email author,
- Adrián Estrada-Sánchez†2,
- David Estrada-Sánchez†1 and
- José de la Fuente†3, 4
https://doi.org/10.1186/1476-072X-12-43
© Estrada-Peña et al.; licensee BioMed Central Ltd. 2013
- Received: 30 June 2013
- Accepted: 24 September 2013
- Published: 26 September 2013
Abstract
Background
Modelling the environmental niche and spatial distribution of pathogen-transmitting arthropods involves various quality and methodological concerns related to using climate data to capture the environmental niche. This study tested the potential of MODIS remotely sensed and interpolated gridded covariates to estimate the climate niche of the medically important ticks Ixodes ricinus and Hyalomma marginatum. We also assessed model inflation resulting from spatial autocorrelation (SA) and collinearity (CO) of covariates used as time series of data (monthly values of variables), principal components analysis (PCA), and a discrete Fourier transformation. Performance of the models was measured using area under the curve (AUC), autocorrelation by Moran’s I, and collinearity by the variance inflation factor (VIF).
Results
The covariate spatial resolution slightly affected the final AUC. Consistently, models for H. marginatum performed better than models for I. ricinus, likely because of a species-derived rather than covariate effect because the former occupies a more limited niche. Monthly series of interpolated climate always better captured the climate niche of the ticks, but the SA was around 2 times higher and the maximum VIF between covariates around 30 times higher in interpolated than in MODIS-derived covariates. Interpolated or remotely sensed monthly series of covariates always had higher SA and CO than their transformations by PCA or Fourier. Regarding the effects of background point selection on AUC, we found that selection based on a set of rules for the distance to the core distribution and the heterogeneity of the landscape influenced model outcomes. The best selection relied on a random selection of points as close as possible to the target organism area of distribution, but effects are variable according to the species modelled.
Conclusion
Testing for effects of SA and CO is necessary before incorporating these covariates into algorithms building a climate envelope. Results support a higher SA and CO in an interpolated climate dataset than in remotely sensed covariates. Satellite-derived information has fewer drawbacks compared to interpolated climate for modelling tick relationships with environmental niche. Removal of SA and CO by a harmonic regression seems most promising because it retains both biological and statistical meaning.
Keywords
- Ixodes ricinus
- Hyalomma marginatum
- Climate niche
- MODIS
- CliMond
- WorldClim
- Spatial autocorrelation
- Collinearity
Background
Ticks are important vectors of pathogens to humans [1, 2]. Most of the tick’s life cycle is spent in the environment, where ticks develop, moult, and quest actively for a host [3]. Temperature has a central role in the regulation of the tick life cycle, including the development of the moulting stages (or oviposited eggs) and the periods in which ticks quest for a host in the vegetation. During the winter, low temperatures prevent rapid development, so development progresses slowly until temperatures increase in spring. At northern latitudes, temperature is the main driving factor of the length of the tick life cycle by regulating the duration of developmental processes. The requirements of temperature for development are species-specific and commonly prevent the spread of ticks farther north, where total cumulative degrees in a year are too low to allow complete development. Mortality depends on water losses, which are regulated by the relative humidity and the air saturation deficit. During questing, ticks lose water that they normally regain by descending at intervals to the litter zone where they can reabsorb water vapour from the atmosphere [4, 5]. When the ticks are hydrated, they ascend to the vegetation. The seasonal activity of ticks is characterised by several cycles of ascending and descending movements in the vegetation, regulated by temperature and water loss. Therefore, the energy reserves of the tick plus its abilities to retain water, together with air water content and temperature, are the factors regulating the questing and survival of ticks in the field.
Such tight dependence of ticks on climate traits makes them susceptible to meteorological changes, which in turn affects their periods of activity, development, and mortality and expansion into new zones or retreat from colonised areas [6, 7]. Some of these shifts in distribution have been reported from field studies [8, 9]. In other cases, associations between climate and prevalence rates of tick-transmitted pathogens have been proposed based on empirical grounds [10] or meta-analyses of published data [11]. However, the effect of the projected climatic trends over the rather complex life cycle of ticks and the dynamics of tick-transmitted pathogens are still poorly understood and subject to debate. Although a change in climate might play an important role in certain geographic regions, for much of Europe, non-climatic factors, such as host population dynamics, are becoming increasingly important in the recorded spread of the tick Ixodes ricinus[7]. Similar explanations have been hypothesized for the increase in prevalence rates of other tick-transmitted pathogens, in particular those carried by the tick Hyalomma marginatum[12].
Methods of species distribution modelling have been applied to arthropods of medical importance to understand the factors limiting their distribution [13–15]. These quantitative tools combine observations of species occurrence with environmental features [15] and are increasingly applied to produce coherent estimates of distribution patterns of mosquitoes [2], sandflies [16], and ticks [7, 17]. The covariates of climate and vegetation with which these arthropods are associated can be used to gain information about the effects of future climate scenarios or even recent trends [18]. Because this information can be produced on a timely basis, with internally consistent data sources, it is a useful tool for resource managers, policy makers, and scientists interested in tracking recent changes across large administrative or environmental scales. These models are becoming increasingly popular in mapping the expected environmental variables that limit the physiological response of an arthropod vector [16].
Although some studies have emphasised the suitability of yearly averaged covariates involving temperature and rainfall, in the interpretation of the climate niche of the target arthropod [7, 14], others have used sets of variables at monthly intervals or the orthogonal transformation of a time series of covariates, via principal component analysis (PCA) or Fourier transformation [19, 20]. It has been explicitly indicated [21] that the set of covariates chosen to explain the abiotic habitat ought to have a clear biological meaning, describing adequately the biological and ecological constraints of the species in the spatial range to be modelled. Without this biological background, numerous variables can produce models with highly reliable matching distributions that are only statistically relevant. Although there is a tendency to consider that these potential distributions represent the probable geographical range, they must be regarded only as the characterization of the range of abiotic conditions (corresponding to non-living factors in the environment) under which the organism may survive [16]. These so-called “suitability maps” or “potential distribution species models” are interpretations of a similarity measure of the abiotic conditions at each pixel of the map with the conditions at the known range of the species. These maps are actually a projection into the spatial range of the inferences made on such a niche of the organism. Without a model aimed at describing every process of the life cycle of the target organism, it is necessary to carefully select the minimum set of covariates that adequately describe, without inflation, the variables driving the observed distribution.
A common problem in modelling the abiotic niche of arthropod vectors is the lack of assessment of the statistical issues derived from spatial autocorrelation (SA) and collinearity (CO) of the covariates. SA is the spatial co-variation of properties between records used for calibration of models [22] violating standard statistical techniques that assume independence among observations. SA thus arises from multiple points of “presence” for the organism to be modelled, not randomly distributed over the space [23]. Patterns of species distributions may be spatially autocorrelated because of population dynamics and historical factors, including closely clustered surveys that lead to the observed pattern of occurrence [24]. SA is thus a spatially related problem that leads to an overestimation of the sample size, inflating the statistical significance of the measured spatial relationships and increasing the likelihood of false positives (type I errors, [25]).
The problem of SA in the determination of the tick abiotic niche can be stated as follows. Consider a region of several square kilometres (i.e., representing a small fraction of its complete spatial range) where tick-transmitted pathogens are a concern and where active surveys for ticks are commonly carried out. The tick will be collected in such a range where the spatial variability of the climate covariates is low because it is a relatively small territory. These collections represent, however, a significant fraction of the complete distribution range of the tick, as reported, and contribute to populate the dataset of presences with closely located records having very similar abiotic “preferences”. This method biases the perceived niche of the tick because the tick has not been randomly collected in the context of the complete dataset. An additional problem is expected to arise when covariates are gridded interpolations of climate from recording stations. Consider the same territory for which only a few climate-recording stations exist. Even the best performing methods will interpolate a few points as a surface of data where large areas have almost the same values for the covariate. These surfaces are later used to know the niche at which ticks have been collected, which will result in a significant number of records in the tick presence dataset having similar values for the climate covariates and biasing our capture of its climate niche.
CO is a statistical phenomenon in which two or more covariates in a multiple regression model are highly correlated and presents a problem related to the internal structure of the covariates used to explain the distribution of the records. In our application, the typical situation involves the use of time series of covariates that are strongly correlated (e.g., the temperature in one month is expected to be very similar to the values of the following month). CO is thus a spatio-temporal problem originated in the structure of the covariates and not in the records used for calibration. A special situation exists when covariates are grid interpolations of climate point records. In this case, the problems are magnified because the interpolation algorithms use a set of discrete, irregularly spaced sites (the meteorological stations), and the temporal series of covariates will exhibit a high CO compared with the regularity and the continuity of remotely sensed measurements.
To take full advantage of the available resources, researchers need to know the extent to which different variables selected to drive the models may affect the final outcome. This study is aimed at identifying the optimal set of abiotic variables describing the environmental niche of the two prominent ticks Ixodes ricinus and Hyalomma marginatum. It was not a goal to evaluate the accuracy of different algorithms in producing different results or to produce ready-to-use maps. The overall aim rather was to gain a general knowledge of the main variables driving the distribution of these ticks and to identify some procedural gaps in the selection of the covariates because they are commonly targeted to sketch predictive maps applied to the improvement of human health. We explicitly sought to demonstrate that (i) no single method exists to produce the best map for ticks, (ii) covariates producing the best performing model have high colinearity and spatial autocorrelation, therefore rendering conclusions unreliable, and (iii) that the transformation of time series of covariates produce satisfactory results and remove most of the internal problems of covariates.
Results
Effects of data source
AUC values of the models for either Ixodes ricinus or Hyalomma marginatum . Models were built against a set of 10,000 random pseudo-absence records and trained with several sets of interpolated climate, using both temperature and saturation deficit (SD), temperature and relative humidity (RH), and temperature and rainfall in either the CliMond or WorldClim sets (rainfall) or the set of “Bio” variables derived from the WorldClim dataset (BIO). All the datasets were used at a spatial resolution of 0.1°.
Background selection
AUC values of the models for Ixodes ricinus . Pseudo-absence records were either a set of 10,000 random records, or selected at different membership values of the background or randomly distributed over the target territory. Models were trained with remotely sensed variables from MODIS imagery, at either 0.05° or 0.1° of spatial resolution. Covariates are the 12 monthly layers of surface temperatures and 12 other layers of NDVI (“Monthly”), the reduction of these monthly values by a principal components analysis (“PCA”) involving six covariates, and the coefficients of a harmonic regression (“Harmonic”) involving eight covariates.
AUC values of the models for Hyalomma marginatum . Pseudo-absence records were either a set of 10,000 random records, or selected at at different membership values of the background or randomly distributed over the target territory. Models were trained with remotely sensed variables from MODIS imagery, at either 0.05° or 0.1° of spatial resolution. Covariates are the 12 monthly layers of surface temperatures and 12 other layers of NDVI (“Monthly”), the reduction of these monthly values by a principal components analysis (“PCA”) involving six covariates, and the coefficients of a harmonic regression (“Harmonic”) involving eight covariates.
Spatial autocorrelation and collinearity
Moran’s I values for the sets of records of either Ixodes ricinus or Hyalomma marginatum .
Mean, minimum, and maximum values of the variance inflation factor (VIF) as a measure of the collinearity observed in the different sets of variables
Set | VIF: Average (Min/Max) |
---|---|
Harmonic regression MODIS 0.1° | 1.2 (1.0/3.3) |
Harmonic regression MODIS 0.05° | 1.1 (1.0/3.2) |
Monthly variables MODIS 0.1° | 8.2 (2.0/189.1) |
Monthly variables MODIS 0.05° | 8.3 (2.1/177.4) |
PCA MODIS 0.1° | 1.2 (1.1/2.2) |
PCA MODIS 0.05° | 1.1 (1.0/2.1) |
WorldClim | 12.2 (3.0/196.0) |
WorldClim (Bio) | 3.5 (1.0/125.4) |
CliMond (Temperature + Rainfall) | 12.1 (3.6/126.1) |
CliMond (Temperature + RH) | 12.4 (4.1/128.4) |
CliMond (Temperature + SD) | 13.5 (4.0/119.5) |
Discussion
This study evaluated the use of different sets of informative variables (covariates) to estimate the climate suitability for two tick species with relevance for human health. We sought to provide a comparison of the suitability of several sets of climate covariates regarding the statistical issues of CO and SA [26–32]. We did not consider land features that might affect the abundance of hosts, which are necessary for the tick’s blood meal [33], or climatic extremes (cold spells, heat waves) that could limit tick survival. We thus focused on the estimation of systematic errors rather than on producing the best map of the expected distribution of these ticks’ ranges, as a preliminary step to computing the probable distribution of these species.
Although correlative models capture the distribution of a given organism in the n-dimensional environmental niche, the production of a “risk map” is only a projection from the environmental space into the geographical one. Both remotely sensed and interpolated climate datasets have advantages and disadvantages in the capture of such a niche. The first category has a high temporal resolution but a relatively short running period (typically since the years 1983 or 2000, according to the sensor), but satellite data must be corrected to remove clouds, ice, or artifacts [34]. Moreover, estimators of the saturation deficit are not easily available in the satellite products, although reports estimated the humidity component from standard NDVI imagery [35, 36]. The interpolated climate datasets are easily available and free of contaminations like clouds or ice. These products are commonly available as the long-term average for the period 1960–1990 for the complete world, at different resolutions, and include estimations of water availability in the air, which are important for explaining tick activity and mortality rates [37]. A number of modellers have argued strongly for the use of predictors that are ecologically relevant to the target species [38–41]. It has been stated that the ‘use of automated solutions to predictor selection … should not be seen as a substitution for preselecting sound eco-physiological predictors based on deep knowledge of the bio-geographical and ecological theory’ [27], pp: 1681–1682]. In this context, the use of different variables describing the water content of the air (e.g., humidity or rainfall) has not affected the final outcome. However, these results have been obtained in the framework of a high CO of the covariates and are difficult to interpret.
It is important to mention that no single approach exists for the capture of climate niche of these species of ticks, at least with the two target species and the different sets of covariates used in this study. First, there is a clear effect derived from the species, which has been observed for remotely sensed information, but not for interpolated climate covariates. I. ricinus is a species colonizing a large area of the western Palearctic and thus reported under a large variety of environmental conditions [42]. A certain degree of adaptation of the tick populations to the regional climate conditions should therefore be expected, something that cannot be captured by the modelling algorithms because they work on the basis of the niche conservatism [43]. H. marginatum is a Mediterranean species, colonizing only the relatively warm and dry environments of the Mediterranean basin [17]. It is thus expected that adaptation to regional environmental conditions is lower than for I. ricinus because of the narrower region occupied in the environmental niche [17]. We ignore why this effect is not observed in the datasets of interpolated climate.
Studies simulating sets of pseudo-absences to train the models have tried to assess how the strategy of choice of background may influence the predictive abilities of models for organisms [43, 44]. A large experiment [45] showed that a potential drawback of models generated with random pseudo-absences is that they might coincide with locations where the species actually occurs. This coincidence would strongly affect the calculation of the probability of presence in the model. Consequently, the models generated with random pseudo-absences are expected to have poorer fit [46]. The selection of the background is different for each target species and may depend upon the biology of each organism and the abiotic features of the territory to be modelled. For I. ricinus, a species that occupies a large portion of the available climate niche in the target region, the choice of a background near the recorded distribution of the tick (low membership probability) produced always better models, with a difference of about 12–14% of AUC values over the random background. For H. marginatum, which is restricted to a smaller volume of the available climatic conditions, such a choice of background affected model reliability in only 2–4% of AUC values. The selection of the background points from the n-dimensional distribution of the organism in its climate niche, and not from the spatial structure of its distribution, might be an interesting method to improve our understanding of the factors driving such distribution [47], a method that has not been addressed here.
Some sets of covariates tested for this study yielded high values of both SA and CO (as the Moran’s I and VIF). It was expected that the sets of interpolated climate resulted in higher SA values because these data are gridded interpolations of climate stations, with effects that are greater in regions where a low density of points is available, introducing uncertainties into the predictions. CO was also expected to be higher in datasets involving monthly covariates because each variable is correlated with others. Some studies [26, 27, 48] have recommended incorporating a term for SA into the analysis. However, this method has been criticized [29] because models that incorporate a SA term reflecting environmental rather than biological spatial structure could not be applied to other situations. Other approaches have involved the detection of autocorrelation among covariates before the modelling exercises, dropping the highly correlated covariates from the final modelling approach [49]. This method, however, might remove the most biologically important covariates because it is an automated solution that disregards the a priori ecological significance of covariates.
It seems, thus, that a single solution for the capture of the environmental niche of ticks is not straightforward. Remotely sensed information should be preferred to interpolated climate. However, in situations of a large number of pixels contaminated by water vapour, the use of interpolated climate should be considered, together with an explicit assessment of the CO of the residuals to check for inflation of the models. Monthly covariates of satellite-derived information had the highest values of VIF, but these values were clearly lower than the interpolated climate, including the set of “Bio” variables. Nevertheless, the models built upon the transformation of the original time series either by the coefficients of a harmonic regression or a PCA produced the best removal of SA and CO, as already reported [20]. The preferred method to infer the abiotic niche of these arthropods should be ideally based on a transformation of the original time series, extracting the raw temporal values in a series of uncorrelated covariates. It has been reported, however, that the PCA reduction of a time series lacks its intuitive meaning [21]. In contrast, a harmonic regression retains the terms about the amplitude and seasonality of each time component and is therefore easier to interpret. We advocate the use of the coefficients of a harmonic regression, which represent a summarized description of the climate niche of the organism while retaining the ability to explain seasonal trends with a few parameters. Moreover, the selection of variables derived from purely physical traits, like elevation, will contribute to inflate the results of the model by further CO with the raw climate features like the temperature. The inclusion of elevation is a common procedure in the building of correlative models, which cannot help in the interpretation of the niche of the organisms and will falsely inflate the predictive abilities of models [50].
Conclusions
Several conclusions emerged from this study, and probably the most important is that no one method exists to elaborate maps of risk for arthropods of medical interest. Interpolated gridded climate covariates do not seem to be adequate tools for such a modelling exercise, even if they output high AUC values, because issues of SA and CO that may affect the reliability of the inference of the niche under some conditions. This also applies to time series of data (i.e. monthly intervals) that are obviously correlated, either for gridded or remotely sensed covariates. We might recommend the coefficients of a harmonic regression applied to the monthly series of remotely sensed information about LST and NDVI because they are uncorrelated covariates explaining the complete series. It is also important to investigate the effects of high-resolution features other than climate covariates (such as landscape composition or presence and abundance of suitable hosts) in the performance of the models. There is not a single method to select the background in presence-only models. There is an urgent need to adopt protocols to include real absence records of the ticks and to turn to statistical methods that can express the relationships of biological distributions with biologically meaningful climate covariates. It is concluded that procedures aimed to capture the distribution of arthropods with medical interest might be better focused on the inference about the climate niche, instead to simply project on the geographical distribution.
Methods
Explanatory variables and data preparation
The selection of the explanatory variables is a critical step in the inference and projection of the climate niche of an organism. In the case of ticks, additional complications arise because rain has little influence on the tick life cycle at large scales. The tendency is to correlate empirical observations on tick phenology with rainfall patterns; however, the factors affecting such phenology are temperature, relative humidity, and saturation deficit [4, 51], and rainfall probably is adequate only at regional scales but unreliable for large patterns of variation. In the case of remote sensing, the Normalized Derived Vegetation Index (NDVI) is a variable that better captures the reported distribution of some species of ticks [37, 52] because it is considered as a proxy for water availability.
List of the datasets used in this study and the transformations carried out and applied to modelling purposes
Set | Which variables | Resolution | Time | Covariates |
---|---|---|---|---|
MODIS | LST and NDVI | 0.05° and 0.1° | 2000–2011 | Monthly values: 24 variables |
MODIS | LST and NDVI | 0.05° and 0.1° | 2000–2011 | Principal components of the monthly datasets: 6 variables |
MODIS | LST and NDVI | 0.05° and 0.1° | 2000–2011 | Coefficients of harmonic regression of monthly values: 8 variables |
WorldClim | Temperature and rainfall | 10´ | 1960–1999 | Monthly values: 24 variables |
WorldClim | Temperature and rainfall | 10´ | 1960–1999 | Transformation of monthly values into “Bio variables”: 19 variables |
CliMond | Temperature and relative humidity | 10´ | 1960–1999 | Monthly values: 24 variables |
CliMond | Temperature and saturation deficit | 10´ | 1960–1999 | Monthly values: 24 variables |
LST/NDVI B is based on the MODIS product MOD11C2 and is available at http://neo.sci.gsfc.nasa.gov/Search.html (accessed December, 2011). This product has a smaller resolution than the original (0.1° instead of 0.05°) but is available as a ready-to-use set of monthly data, with the pixel contamination by water already removed by the MODIS team. The use of the data already processed by the MODIS processing team ensures its quality, significantly reduces the time for processing, and provides a clean set of data that can be directly used to feed the modelling chain of processes. We specifically tested it to check if its smaller resolution could affect the performance of the models.
These two products were used in three different ways: (1) averaged monthly values for the years 2001–2011 (12 variables for LST and 12 for NDVI); (2) the orthogonal transformations by PCA of the original series of data (the first 3 components for LST and the first 3 axes for NDVI, explaining 88.2% and 87.9% of the original variance, respectively); and (3) the coefficients of a harmonic regression of the series of data against time.
where Y is the value of LST or NDVI, B0 is the offset, c is the trend, Ai is the amplitude of the ith oscillation, ϕ is the phase component of the ith oscillation, s is the fundamental frequency, and T is the time-dependent variable. We performed both the PCA transformations and the harmonic regressions in R [54] and the package “raster” version 2.0-08 [55]. Four coefficients for LST and four for NDVI were used for model fitting because the addition of more terms did not significantly improve the fitting of the original series.
We also included monthly values of temperature and moisture obtained from two sets of interpolated gridded climate data, namely WorldClim [56] (available at http://www.worldclim.org) and CliMond [57] (http://www.climond.org). The former does not include data on the water content of the air but includes precipitation, and the latter includes both precipitation and relative humidity estimates. Although methods to interpolate the temperature are the same in both sets of data, the interpolation of the humidity features may differ. Therefore, we used both sets of data, namely temperature and precipitation, as available from WorldClim, and temperature and humidity, as available from CliMond. Details on the preparation of the datasets are available in references [56, 57], respectively. In short, they include averaged monthly values for temperature and moisture (either precipitation or relative humidity) for the period 1960–1990, obtained from ground climate stations and interpolated thin-plate smoothing splines, using elevation, latitude, and longitude as independent variables.
We further processed the values of relative humidity as available in CliMond to obtain estimates of the saturation deficit because of the importance of such a feature in the life cycle processes of the ticks [51]. Monthly features of both sets were downloaded and used at a spatial resolution of 0.1° from their respective web sites (accessed February, 2012). We also used a set of variables derived from the main WorldClim dataset, which are called “Bioclimatic” variables and include information derived from the main monthly dataset. The bioclimatic variables represent annual trends (e.g., mean annual temperature, annual precipitation), seasonality (e.g., annual range in temperature and precipitation), and extreme or limiting environmental factors (e.g., temperature of the coldest and warmest months and precipitation of the wet and dry quarters). Interpolated climate covariates were not processed for further orthogonal transformations.
Model building and comparison
For each species, models were developed with the sets of environmental covariates and a set of data point locations where the species has been observed in the western Palearctic. The ‘Maximum Entropy Approach’ using the MaxEnt computer program for modelling species geographic distributions (v.3.3.3k [58]) was employed to generate models for the species studied. The algorithm generates inferences from incomplete information, estimating a target probability distribution by finding the probability distribution of maximum entropy, subject to a set of constraints that represent the incomplete information about the reported distribution. This is a machine learning modelling method, which has recently gained attention for its favourable performance in comparison to other modelling methods [59]. We did not address a comparison of the reliability of the different modelling algorithms, and other methods using presence-only data are available [59].
The spatial distribution in the western Palearctic of the compiled records of the ticks Ixodes ricinus (black dots) and Hyalomma marginatum (blue dots) used to train the models.
For each species, models were developed with every set of environmental covariates together with the set of data point locations where the species had been observed. We used quadratic and product terms to handle the non-linear response of ticks to climate covariates and to allow relationships among covariates to be included [49]. We explored a range of regularization parameters according to published recommendations [59] to choose a final regularization parameter (2 for both species to be modelled). Sampling bias was not addressed because of the inherent difficulties in its calculation on a historical dataset of records where no sampling effort was specifically included. Models were trained with 70% of records and evaluated against the remaining 30%. The modelled distributions were evaluated for predictive performance using the area under the receiver operating characteristic (ROC) curve to assess the agreement between the presence–absence records and the model predictions [60]. Model reliability was determined by calculating the area under the curve (AUC) such that a curve that maximizes sensitivity for low values of the false-positive fraction is considered a good model. The AUC represents a reliable important metric for evaluating diagnostic procedures, providing a single measure of model reliability, independent of any particular choice of threshold value [60]. Since its first proposal as an appropriate method to estimate the accuracy of species distribution models, reports have described its use in this field of research [61–63]. However, other studies have criticised its indiscriminate application [45, 64]. We calculated and compared AUC using the R package pROC [65]. Additional file 1: Figure S1 and Additional file 2: Figure S2 include the ROC curves for the models. Additional file 3: Figure S3 and Additional file 4: Figure S4 include maps of the climate similarity for either Ixodes ricinus or Hyalomma marginatum in the target territory.
Selection of pseudo-absences
The lack of a set of negative (absence) records—a usual bias in surveillance information—makes it necessary to compute pseudo-absences, which are randomly selected over the background of the target territory. The modelling software selects a random set of background points; however, the wide range of environmental conditions under which pseudo-absences can be located might severely alter/bias the outputs of the calculations [66, 67]. We elaborated on a method to select a background, comparing the AUC values obtained by the default random selection of absences provided by MaxEnt software against those built employing a customized, ad-hoc approach that select negative records from the background on the basis of criteria with ecological meaning. To do so, a grid with cells at a resolution of 0.01 degrees was created for the study area, and the probability for each pixel to be selected as background was calculated on a cell-by-cell basis. The rationale is that each cell of the grid has a probability to be a “background site”, which depends on both the distance to the nearest record of the target organism and the terrain ruggedness. The terrain ruggedness is defined as the difference in elevation between adjacent cells in a digital elevation grid covering the area of study. This is a standard definition (Topographic ruggedness index [68]) aimed to produce an evaluation of how variable the terrain in the cell is. A digital elevation model at a resolution of 1 km (obtained from http://www.worldclim.org, accessed December 2011) was used to compute the landscape heterogeneity, using a script for ArcGIS Desktop (ESRI, Redlands, CA, USA) available at http://arcscripts.esri.com (Topographic ruggedness index, accessed January, 2012).
The membership function used to select the background to train the models for Ixodes ricinus (A) and Hyalomma marginatum (B). The tone from blue to red shows the degree of membership to the background (pseudo-absence) records and is based on the landscape heterogeneity and distance to known records of the target tick.
Assessing spatial autocorrelation and collinearity
We assessed the SA and CO of the sets of explanatory variables used in this study. The effect of SA on linear regression significance values has been tested using artificially generated variables with known spatial structures [69–71]. A common procedure to cancel the effect of the spatial structure of species occurrences is to incorporate a term for SA into the analysis [26, 27, 48], usually a measure of contagion that encompasses the effect of spatial neighbourhood in the statistical test. However, spatial patterns observed in the residuals could just as well result from failure to include an important autocorrelated predictor in the model [28] as much as from a real biological process. As a result, models that incorporate a SA term reflecting environmental rather than biological spatial structure will hardly be applicable to other situations [29].
On the other hand, it has been reported that CO does not affect MaxEnt performance (i.e., the predicted distribution range of the target species) but can hinder model interpretation (i.e., obstruct the decision about the covariates driving the distribution of the target species) [30]. The focus here is not the reliability of MaxEnt as affected by CO but to demonstrate that such a spatial effect exists in the sets of covariates most commonly used to map the distribution of arthropods that affect human health. In most cases, it is important to know how each variable influences the presence of the modelled species and, subsequently, which variables have the greatest influence on the model and in what manner these variables influence species occurrence [31]. Caution must be used when assessing this importance because a strong CO can influence results by implying greater importance for one of two or more highly correlated variables.
We used the Moran’s I for the model residuals to assess the SA of the covariates, separately for each set of covariates and respective transformations, the different spatial resolutions, and the two sets of tick records used to train the models [71]. We computed Moran’s I with the module “Autocorr” in Idrisi for Windows (V14) on the first lag only so that the algorithm scans through the whole image of model residuals and looks at each cell and its immediate neighbours. Moran’s I ranges between −1 and +1, where +1 means absolute and 0 no spatial autocorrelation. A negative index could indicate some kind of regular pattern. We assessed CO of the covariates with the variance inflation factor (VIF), which is a measure of correlation between pairs of variables [72]. Values of VIF > 10 denote a potentially problematic CO within the set of covariates, indicating that these covariates should be carefully evaluated in model development [32]. VIF was calculated for every combination of covariates and their orthogonal transformations and resolutions. Results are presented as the mean, minimum, and maximum values of VIF found in every pair combination of covariates among each set.
Notes
Declarations
Acknowledgements
This paper would not have been possible without environmental data from the European Environment and Epidemiology (E3) Network (http://E3geoportal.ecdc.europa.eu/) hosted at the European Centre for Disease Prevention and Control (ECDC) in Stockholm. We would like to acknowledge the contribution of ECDC staff for valuable assistance and feedback on the paper, specifically Bertrand Sudre, Jan C. Semenza, Massimiliano Rossi, Wim van Bortel, and Herve Zeller. Parts of this research were supported by the EU FP7 ANTIGONE project number 278976.
Authors’ Affiliations
References
- Wimberly MC, Baer AD, Yabsley MJ: Enhanced spatial models for predicting the geographic distributions of tick-borne pathogens. Int J Health Geogr. 2008, 7: 15-29. 10.1186/1476-072X-7-15.PubMedPubMed CentralView ArticleGoogle Scholar
- European Center for Disease Preventicon and Control: Development of Aedes albopictus Risk Maps, Technical Report 0905. 2009, See http://ecdc.europa.eu/en/publications/Publications/0905_TER_Development_of_Aedes_Albopictus_Risk_Maps.pdfGoogle Scholar
- Sonenshine DE: The biology of ticks. Volume 1. 1991, New York, USA: Oxford University Press, Inc, 447-Google Scholar
- Rudolph D, Knülle W: Site and mechanism of water vapour uptake from the atmosphere in ixodid ticks. Nature. 1977, 249: 84-85.View ArticleGoogle Scholar
- Kahl O, Alidousti I: Bodies of liquid water as a source of water gain for Ixodes ricinus ticks (Acari: Ixodidae). Exp Appl Acarol. 1997, 21: 731-746. 10.1023/A:1018469021161.View ArticleGoogle Scholar
- Jaenson TGT, Lindgren E: The range of Ixodes ricinus and the risk of contracting Lyme borreliosis will increase northwards when the vegetation period becomes longer. Ticks and Tick-borne Dis. 2011, 21: 44-49.View ArticleGoogle Scholar
- Medlock JM, Hansford KM, Bormane A, Derdakova M, Estrada-Peña A, George J-C: Driving forces for changes in geographical distribution of Ixodes ricinus ticks in Europe. Parasites Vectors. 2013, 6: 1-10.1186/1756-3305-6-1. doi:10.1186/1756-3305-6-1PubMedPubMed CentralView ArticleGoogle Scholar
- Jaenson TGT, Jaenson DGE, Eisen L, Petersson E, Lindgren E: Changes in the geographical distribution and abundance of the tick Ixodes ricinus during the past 30 years in Sweden. Parasites Vectors. 2012, 5:http://www.parasitesandvectors.com/content/5/1/8,Google Scholar
- Danielová V, Rudenko N, Daniel M, Holubová J: Extension of Ixodes ricinus ticks and agents of tick-borne diseases to mountain areas in the Czech Republic. Int J Med Microbiol. 2006, 296: 48-53.PubMedView ArticleGoogle Scholar
- Gatewood AG, Liebman KA, Vourc’h G, Bunikis J, Hamer SA, Cortinas R: Climate and tick seasonality are predictors of Borrelia burgdorferi genotype distribution. Appl Environ Microbiol. 2009, 75: 2476-2483. 10.1128/AEM.02633-08.PubMedPubMed CentralView ArticleGoogle Scholar
- Estrada-Peña A, Ortega C, Sánchez N, DeSimone L, Sudre B, Suk JE, Semenza JC: Correlation of Borrelia burgdorferi sensu lato prevalence in questing Ixodes ricinus ticks with specific abiotic traits in the western Palearctic. App Environ Microbiol. 2011, 77: 3838-3845. 10.1128/AEM.00067-11.View ArticleGoogle Scholar
- Estrada-Peña A, Vatansever Z, Gargili A, Ergonul O: The trend towards habitat fragmentation is the key factor driving the spread of Crimean-Congo haemorrhagic fever. Epidemiol Infect. 2010, 138: 1194-1203. 10.1017/S0950268809991026.PubMedView ArticleGoogle Scholar
- Randolph SE, Rogers DJ: Fragile transmission cycles of tick-borne encephalitis virus may be disrupted by predicted climate change. Proc R Soc Lond B. 2000, 267: 1741-1744. 10.1098/rspb.2000.1204.View ArticleGoogle Scholar
- Caminade C, Medlock JM, Ducheyne E, McIntyre KM, Leach S, Baylis S, Morse AP: Suitability of European climate for the Asian tiger mosquito Aedes albopictus: recent trends and future scenarios. J R Soc Interface. 2012, 9: 2708-2717. 10.1098/rsif.2012.0138.PubMedPubMed CentralView ArticleGoogle Scholar
- Yang G-J, Brook BW, Bradshaw CJA: Predicting the timing and magnitude of tropical mosquito population peaks for maximizing control efficiency. PLoS Negl Trop Dis. 2009, 3: e385-10.1371/journal.pntd.0000385. doi:10.1371/journal.pntd.0000385PubMedPubMed CentralView ArticleGoogle Scholar
- Hartemink N, Vanwambeke SO, Heesterbeek H, Rogers D, Morley D: Integrated mapping of establishment risk for emerging vector-borne infections: A case study of canine Leishmaniasis in southwest France. PLoS One. 2011, 6: e20817-10.1371/journal.pone.0020817. doi:10.1371/journal.pone.0020817PubMedPubMed CentralView ArticleGoogle Scholar
- Estrada-Peña A, Farkas R, Jaenson TGT, Koenen F, Madder M, Pascucci I: Association of environmental traits with the geographic ranges of ticks (Acari: Ixodidae) of medical and veterinary importance in the western Palearctic. A digital data set. Exp Appl Acarol. 2013, 59: 351-366. 10.1007/s10493-012-9600-7.PubMedPubMed CentralView ArticleGoogle Scholar
- Fisher D, Thomas SM, Niemitz F, Reineking B, Beierkuhnlein C: Projection of climate suitability for Aedes albopictus Skuse (Culicidae) in Europe under climate change conditions. Glob Planet Change. 2011, 78: 54-65. 10.1016/j.gloplacha.2011.05.008. doi:10.1016/j.gloplacha.2011.05.008View ArticleGoogle Scholar
- Estrada-Peña A, Thuiler W: An assessment of the effect of data partitioning on the performance of modelling algorithms for habitat suitability for ticks. Med Vet Entomol. 2008, 22: 248-257. 10.1111/j.1365-2915.2008.00745.x.PubMedView ArticleGoogle Scholar
- Scharlemann JPW, Benz D, Hay SI, Purse BV, Tatem AJ: Global data for ecology and epidemiology: A novel algorithm for temporal Fourier processing MODIS data. PLoS One. 2008, 3: e1408-10.1371/journal.pone.0001408. doi:10.1371/journal.pone.0001408PubMedPubMed CentralView ArticleGoogle Scholar
- Randolph SE, Green RM, Hoodless AN, Peacey MF: An empirical quantitative framework for the seasonal population dynamics of the tick Ixodes ricinus. Int J Parasitol. 2002, 32: 979-989. 10.1016/S0020-7519(02)00030-9.PubMedView ArticleGoogle Scholar
- Legendre P: Spatial autocorrelation: trouble or new paradigm?. Ecology. 1993, 74: 1659-1673. 10.2307/1939924.View ArticleGoogle Scholar
- Randin CF, Dirnböck T, Dullinger S, Zimmermann NE, Zappa M, Guisan A: Are niche-based species distribution models transferable in space?. J Biogeogr. 2006, 33: 1689-1703. 10.1111/j.1365-2699.2006.01466.x.View ArticleGoogle Scholar
- Storch D, Konvicka M, Benes J, Martinková J, Gaston KJ: Distribution patterns in butterflies and birds of the Czech Republic: separating effects of habitat and geographical position. J Biogeogr. 2003, 30: 1195-1205. 10.1046/j.1365-2699.2003.00917.x.View ArticleGoogle Scholar
- Segurado P, Araújo MB, Kunin WE: Consequences of spatial autocorrelation for niche-based models. J Appl Ecol. 2006, 43: 433-444. 10.1111/j.1365-2664.2006.01162.x.View ArticleGoogle Scholar
- Keitt TH, Bjørnstad ON, Dixon PM, Citron-Pousty S: Accounting for spatial pattern when modeling organism-environment interactions. Ecography. 2002, 25: 616-625. 10.1034/j.1600-0587.2002.250509.x.View ArticleGoogle Scholar
- Segurado P, Araujo MB: An evaluation of methods for modelling species distributions. J Biogeog. 2004, 31: 1555-1568. 10.1111/j.1365-2699.2004.01076.x.View ArticleGoogle Scholar
- Lichstein JW, Simons TR, Shriner SA, Franzreb KE: Spatial autocorrelation and autoregressive models in ecology. Ecol Monographs. 2002, 72: 445-463. 10.1890/0012-9615(2002)072[0445:SAAAMI]2.0.CO;2.View ArticleGoogle Scholar
- Guisan A, Thuiller W: Predicting species distribution: offering more than simple habitat models. Ecol Lett. 2005, 8: 993-1009. 10.1111/j.1461-0248.2005.00792.x.View ArticleGoogle Scholar
- Kuemmerle T, Perzanowski K, Chaskovskyy O, Ostapowicz K, Halada L, Bashta AT, Radeloff VC: European bison habitat in the Carpathian Mountains. Biol Conserv. 2010, 143: 908-916. 10.1016/j.biocon.2009.12.038.View ArticleGoogle Scholar
- Baldwin RA: Use of maximum entropy modeling in wildlife research. Entropy. 2009, 11: 854-866. 10.3390/e11040854.View ArticleGoogle Scholar
- Elith J, Burgman MA, Regan HM: Mapping epistemic uncertainties and vague concepts in predictions of species distributions. Ecol Modell. 2002, 157: 313-329. 10.1016/S0304-3800(02)00202-8.View ArticleGoogle Scholar
- Randolph SE: Ticks are not insects: consequences of contrasting vector biology for transmission potential. Parasitol Today. 2002, 14: 186-192.View ArticleGoogle Scholar
- King MD, Menzel WP, Kaufman YJ, Tanre D, Bo-Cai G, Platnick S, Ackerman SA, Remer LA, Pincus R, Hubanks PA: Cloud and aerosol properties, precipitable water, and profiles of temperature and water vapor from MODIS. IEEE Transactions Geoscience Remote Sens. 2003, 41: 442-458. 10.1109/TGRS.2002.808226.View ArticleGoogle Scholar
- Berger KA, Wang Y, Mather TN: MODIS-derived land surface moisture conditions for monitoring blacklegged tick habitat in southern New England. Int J Remote Sens. 2013, 34: 73-85. 10.1080/01431161.2012.705447.View ArticleGoogle Scholar
- Sandholt I, Rasmussen K, Andersen J: A simple interpretation of the surface temperature/vegetation index space for assessment of surface moisture status. Remote Sens Environ. 2002, 79: 213-224. 10.1016/S0034-4257(01)00274-7.View ArticleGoogle Scholar
- Randolph SE: Ticks and tick-borne disease systems in space and from space. Adv Parasitol. 2000, 47: 217-243.PubMedView ArticleGoogle Scholar
- Glass GE, Schwartz BS, Morgan JM, Johnson DT, Noy PM, Israel E: Environmental risk factors for Lyme disease identified with geographic information systems. Am J Public Hlth. 1995, 85: 944-948. 10.2105/AJPH.85.7.944.View ArticleGoogle Scholar
- Estrada-Peña A, Venzal JM: Climate niches of tick species in the Mediterranean region: modeling of occurrence data, distributional constraints, and impact of climate change. J Med Entomol. 2007, 44: 1130-1138. 10.1603/0022-2585(2007)44[1130:CNOTSI]2.0.CO;2.PubMedView ArticleGoogle Scholar
- Guerra M, Walker E, Jones C, Paskewitz S, Cortinas MR, Stancil A, Beck L, Bobo M, Kitron U: Predicting the risk of Lyme disease: habitat suitability for Ixodes scapularis in the north central United States. Emerg Infect Dis. 2002, 8: 289-297. 10.3201/eid0803.010166.PubMedPubMed CentralView ArticleGoogle Scholar
- Ogden NH, Barker IK, Beauchamp G, Brazeau S, Charron DF, Maarouf A, Morshed MG, O’Callaghan CJ, Thompson RA, Waltner-Toews D, Waltner-Toews M, Lindsay LR: Investigation of ground level and remote-sensed data for habitat classification and prediction of survival of Ixodes scapularis in habitats of southeastern Canada. J Med Entomol. 2009, 43: 403-414.View ArticleGoogle Scholar
- Estrada-Peña A, Martinez JM, Sanchez Acedo C, Quilez J, Del Cacho E: Phenology of the tick, Ixodes ricinus, in its southern distribution range (central Spain). Med Vet Entomol. 2004, 18: 387-397. 10.1111/j.0269-283X.2004.00523.x.PubMedView ArticleGoogle Scholar
- Wiens JJ: Speciation and ecology revisited: phylogenetic niche conservatism and the origin of species. Evolution. 2004, 58: 193-197.PubMedView ArticleGoogle Scholar
- Wisz M, Guisan A: Do pseudo-absence selection strategies influence species distribution models and their predictions? an information-theoretic approach based on simulated data. BMC Ecol. 2009, 9: 8-10.1186/1472-6785-9-8.PubMedPubMed CentralView ArticleGoogle Scholar
- Lobo JM, Jiménez-Valverde A, Real R: AUC: a misleading measure of the performance of predictive distribution models. Global Ecol Biogeog. 2008, 17: 145-151. 10.1111/j.1466-8238.2007.00358.x.View ArticleGoogle Scholar
- Anderson R, Dudík M, Ferrier S, Guisan AJ, Hijmans R, Huettmann F, Zimmermann N: Novel methods improve prediction of species’ distributions from occurrence data. Ecography. 2006, 29: 129-151. 10.1111/j.2006.0906-7590.04596.x.View ArticleGoogle Scholar
- Vanderwal J, Shoo LP, Graham C, Williams SE: Selecting pseudo-absence data for presence-only distribution modeling: how far should you stray from what you know?. Ecol Modell. 2009, 220: 589-594. 10.1016/j.ecolmodel.2008.11.010.View ArticleGoogle Scholar
- Araújo MB, Williams PH: Selecting areas for species persistence using occurrence data. Biological Conserv. 2000, 96: 331-345. 10.1016/S0006-3207(00)00074-4.View ArticleGoogle Scholar
- Merow C, Smith MJ, Silander JA: A practical guide to MaxEnt for modeling species’ distributions: what it does, and why inputs and settings matter. Ecography. 2013, 36: 1058-1069. published online doi: 10.1111/j.1600-0587.2013.07872.xView ArticleGoogle Scholar
- Diuk-Wasser MA, Gatewood AG, Cortinas MR, Yaremych-Hamer S, Tsao J, Kitron U, Hickling G, Brownstein JS, Walker E, Piesman J, Fish D: Spatiotemporal patterns of host-seeking Ixodes scapularis nymphs (Acari: Ixodidae) in the United States. J Med Entomol. 2006, 43: 166-176. 10.1603/0022-2585(2006)043[0166:SPOHIS]2.0.CO;2.PubMedView ArticleGoogle Scholar
- Perret JL, Guigoz E, Rais O, Gern L: Influence of saturation deficit and temperature on Ixodes ricinus tick questing activity in a Lyme borreliosis-endemic area (Switzerland). Parasitol Res. 2000, 86: 554-557. 10.1007/s004360000209.PubMedView ArticleGoogle Scholar
- Estrada-Peña A: Geostatistics as predictive tools to estimate Ixodes ricinus (Acari: Ixodidae) habitat suitability in the western Palearctic from AVHRR satellite imagery. Exp Appl Acarol. 1999, 23: 337-349. 10.1023/A:1006179318393.View ArticleGoogle Scholar
- Immerzel WW, Quiroz RA, De Jong SM: Understanding precipitation patterns and land use interaction in Tibet using harmonic analysis of SPOT VGT- S10 NDVI time series. Int J Rem Sens. 2005, 26: 2281-2296. 10.1080/01431160512331326611.View ArticleGoogle Scholar
- R Development Core Team: R: A language and environment for statistical computing. 2012, Vienna, Austria: R Foundation for Statistical Computing, ISBN 3-900051-07-0, URL http://www.R-project.org/Google Scholar
- Hijmans RJ, van Etten J: Raster: Geographic data analysis and modeling. R package version 2.0-41. 2012,http://CRAN.R-project.org/package=raster,Google Scholar
- Hijmans RJ, Cameron SE, Parra JL, Jones PG, Jarvis A: Very high resolution interpolated climate surfaces for global land areas. Int J Climatol. 2005, 25: 1965-1978. 10.1002/joc.1276.View ArticleGoogle Scholar
- Kriticos DJ, Webber BL, Leriche A, Ota N, Macadam I, Bathols J, Scott JK: CliMond: global high-resolution historical and future scenario climate surfaces for bioclimatic modelling. Methods Ecol Evol. 2012, 3: 53-64. 10.1111/j.2041-210X.2011.00134.x.View ArticleGoogle Scholar
- Philips SJ, Dudík M: Modeling of species distributions with Maxent: new extensions and a comprehensive evaluation. Ecography. 2008, 31: 161-175. 10.1111/j.0906-7590.2008.5203.x.View ArticleGoogle Scholar
- Elith J, Graham CH: Do they? How do they? WHY do they differ? On finding reasons for differing performances of species distribution models. Ecography. 2009, 32: 66-77. 10.1111/j.1600-0587.2008.05505.x.View ArticleGoogle Scholar
- Swets JA: Measuring the accuracy of diagnostic systems. Science. 1988, 240: 1285-1293. 10.1126/science.3287615.PubMedView ArticleGoogle Scholar
- Pearce J, Ferrier S: Evaluating the predictive performance of habitat models developed using logistic regression. Ecol Modell. 2000, 133: 225-245. 10.1016/S0304-3800(00)00322-7.View ArticleGoogle Scholar
- Manel S, Williams HC, Ormerod SJ: Evaluating presence–absence models in ecology: the need to account for prevalence. J Appl Ecol. 2001, 38: 921-931.View ArticleGoogle Scholar
- McPherson JANA, Jetz W, Rogers DJ: The effects of species’ range sizes on the accuracy of distribution models: ecological phenomenon or statistical artefact?. J Appl Ecol. 2004, 41: 811-823. 10.1111/j.0021-8901.2004.00943.x.View ArticleGoogle Scholar
- Peterson AT, Papeş M, Soberón J: Rethinking receiver operating characteristic analysis applications in ecological niche modeling. Ecol Modell. 2008, 213: 63-72. 10.1016/j.ecolmodel.2007.11.008.View ArticleGoogle Scholar
- Robin X, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, Müller M: pROC: an open-source package for R and S + to analyze and compare ROC curves. BMC Bioinformatics. 2001, 12: 77-doi: 10.1186/1471-2105-12-77 http://www.biomedcentral.com/1471-2105/12/77/View ArticleGoogle Scholar
- Liu C, Berry PM, Dawson TP, Pearson RG: Selecting thresholds of occurrence in the prediction of species distributions. Ecography. 2005, 28: 385-393. 10.1111/j.0906-7590.2005.03957.x.View ArticleGoogle Scholar
- Stockwell DRB, Peters DP: The GARP modelling system: Problems and solutions to automated spatial prediction. Int J Geogr Inform Syst. 1999, 13: 143-158. 10.1080/136588199241391.View ArticleGoogle Scholar
- Riley SJ, DeGloria SD, Elliot R: A terrain ruggedness index that quantifies topographic heterogeneity. Intermountain J Sci. 1999, 5: 1-4.Google Scholar
- Lennon JJ: Red-shifts and red herrings in geographical ecology. Ecography. 2000, 23: 101-113. 10.1111/j.1600-0587.2000.tb00265.x.View ArticleGoogle Scholar
- Rossi RE, Mulla DJ, Journel AG, Franz EH: Geostatistical tools for modeling and interpreting ecological spatial dependence. Ecol Monographs. 1992, 62: 277-314. 10.2307/2937096.View ArticleGoogle Scholar
- Dormann CF, McPherson JM, Araujo MB, Bivand R, Bolliger J: Methods to account for spatial autocorrelation in the analysis of species distributional data: a review. Ecography. 2007, 30: 609-628. 10.1111/j.2007.0906-7590.05171.x.View ArticleGoogle Scholar
- Cawsey EM, Austin MP, Baker BL: Regional vegetation mapping in Australia: a case study in the practical use of statistical modelling. Biodivers Conserv. 2002, 11: 2239-2274. 10.1023/A:1021350813586.View ArticleGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.