https://orcid.org/0000-0002-9507-9123
Figures
Abstract
Disaggregated population counts are needed to calculate health, economic, and development indicators in Low- and Middle-Income Countries (LMICs), especially in settings of rapid urbanisation. Censuses are often outdated and inaccurate in LMIC settings, and rarely disaggregated at fine geographic scale. Modelled gridded population datasets derived from census data have become widely used by development researchers and practitioners; however, accuracy in these datasets are evaluated at the spatial scale of model input data which is generally courser than the neighbourhood or cell-level scale of many applications. We simulate a realistic synthetic 2016 population in Khomas, Namibia, a majority urban region, and introduce several realistic levels of outdatedness (over 15 years) and inaccuracy in slum, non-slum, and rural areas. We aggregate the synthetic populations by census and administrative boundaries (to mimic census data), resulting in 32 gridded population datasets that are typical of LMIC settings using the WorldPop-Global-Unconstrained gridded population approach. We evaluate the cell-level accuracy of these gridded population datasets using the original synthetic population as a reference. In our simulation, we found large cell-level errors, particularly in slum cells. These were driven by the averaging of population densities in large areal units before model training. Age, accuracy, and aggregation of the input data also played a role in these errors. We suggest incorporating finer-scale training data into gridded population models generally, and WorldPop-Global-Unconstrained in particular (e.g., from routine household surveys or slum community population counts), and use of new building footprint datasets as a covariate to improve cell-level accuracy (as done in some new WorldPop-Global-Constrained datasets). It is important to measure accuracy of gridded population datasets at spatial scales more consistent with how the data are being applied, especially if they are to be used for monitoring key development indicators at neighbourhood scales within cities.
Citation: Thomson DR, Leasure DR, Bird T, Tzavidis N, Tatem AJ (2022) How accurate are WorldPop-Global-Unconstrained gridded population data at the cell-level?: A simulation analysis in urban Namibia. PLoS ONE 17(7): e0271504. https://doi.org/10.1371/journal.pone.0271504
Editor: Krishna Prasad Vadrevu, University of Maryland at College Park, UNITED STATES
Received: May 19, 2021; Accepted: July 4, 2022; Published: July 21, 2022
Copyright: © 2022 Thomson et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: Dana R. Thomson was funded by the Economic and Social Research Council (ESRC) grant number ES/5500161/1 (more information at https://esrc.ukri.org/). ESRC played no role in the design, analysis, decision to publish, or preparation of this manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Small area population counts, especially in low- and middle-income countries (LMICs), provide essential denominators for health, economic, and development indicators [1]. For example, small area population counts are used to calculate vaccination coverage rates [2], understand health service utilisation [3], and estimate infection rates of malaria, COVID-19, and many other health conditions [4]. Spatially-detailed and time-sensitive population counts are also essential to monitor and understand the accelerated pace of urbanisation in LMICs compared to HICs. Ninety percent of global population growth in the next 30 years is expected to occur in African and Asia cities alone [5], which means it is vital to monitor population trends across diverse LMIC cities with respect to economic development, human impacts on biodiversity and environment, and the changing climate [6,7]. Authoritative population data are traditionally collected via a national census. Censuses are generally collected every ten years, though one in ten LMICs has not held a census in the last 15 years [8], and some national censuses have poor data quality due to negligence (e.g., [9,10]) or deliberate mis-counting of sub-populations for political purposes (e.g., [11–13]). Due to increasing rates of mobility and urbanisation worldwide, the urban poorest–especially in LMIC cities–are increasingly difficult to count as more people take-up residence in informal settlements or atypical housing locations (e.g., shops) [14].
In the absence of updated, fine-scale census data, many policy-makers, urban planners, researchers, and service providers have turned to gridded population estimates as a source of population counts in their work. Gridded population data are viewed by data producers and users as meeting a global development challenge to “leave no one off the map” and thus leave no one behind [15]. However, performing accuracy assessments of gridded population datasets at the scale at which they are applied (e.g., neighbourhood, grid cell) poses a conundrum; reliable fine-scale population counts are generally not available where they are needed most [16], and users often turn to gridded population estimates when census counts are excessively outdated or untrustworthy [14]. Despite these challenges, it is imperative to understand if, and how, census inaccuracies propagate through gridded population datasets, especially with respect to vulnerable populations.
Briefly, gridded population data provide estimates of the total population in small grid cells, and are derived with geo-statistical methods using population counts and spatial datasets [16]. “Top-down” gridded population estimates have been available for roughly 15 years and disaggregate census or other complete population counts from areal units (e.g., 3rd-, 4th-, or 5th-level administrative units) to grid cells (e.g., 30x30m, 100x100m, 1x1km) [14]. The simplest models assume a uniform distribution of population within areal units (i.e., GPW [17,18], GHS-POP [19,20], HRSL [21]), while the most complex models use spatial covariates to inform spatial disaggregation from the areal unit to grid cells (i.e., WorldPop [22,23], LandScan [24,25], WPE [26]). To estimate gridded population figures beyond the year of the last census; birth, migration, and death rates are used to project new population totals by areal unit [27]. “Bottom-up” gridded population estimates are derived from micro-census population counts in a sample of areas, or from assumptions about the average household size, and have only recently been developed [28,29]. Read papers by Leyk and colleagues (2019) and Thomson and colleagues (2020) for detailed descriptions and comparisons of gridded population datasets [14,16].
The accuracy of “top-down” gridded population data is generally calculated at the scale of the input population areal units because these are the finest-scale population counts available to the data producers. A number of factors contribute to gridded population model accuracy including: (1) the modelling algorithm itself, (2) inaccuracy of the input population data, (3) the geographic scale of the input population data (e.g., census tracts versus districts), (4) the age, accuracy, completeness, and type of ancillary data, (5) the nature of the relationship between ancillary data and population density, and (6) the geographic scale of the output grid. Of these, the two strongest predictors of accuracy (at the scale of areal units) in top-down gridded population models are the resolution and age of the input population data [30]. Among top-down gridded population datasets, the WorldPop-Global-Unconstrained Random Forest model was among the best documented and most accurate gridded population models available at the time of this analysis in 2017–2019 [22,31]. Specifically, the model code [32] and pre-processed model covariates [33,34] were publicly available enabling reproducibility and evaluation. WorldPop-Global-Unconstrained and its preceding data products (AfriPop, AsiaPop, and AmeriPop) result in estimates for all land areas; however, a new WorldPop-Global-Constrained dataset was published in 2020 limiting population estimates to cells with buildings or built-up features [35].
To evaluate cell-level accuracy of gridded population data, actual population counts are needed for each grid cell or in finer-scale units such as household point locations. Few censuses in LMICs collect household latitude-longitude coordinates, and where these censuses exist, the data are extremely sensitive and difficult to obtain. Furthermore, even the best census data might be problematic because vulnerable sub-populations including homeless and nomadic populations are supposed to be counted separately in special enumerations. Unfortunately, though, under-resourced statistical offices are often not able to perform these counts [36], and some censuses do not include certain refugee or internally displaced populations [37]. To ensure that this analysis of cell-level accuracy did not exclude the urban poorest and other hidden populations, we chose to simulate a realistic population in a LMIC setting. It was important that the synthetic population was located in a real-world location so that actual covariate datasets–with their own imperfections–could be used to generate realistic gridded population datasets. We adapted methods outlined by Thomson and colleagues (2018) for simulating a geo-located realistic household population, and added classification of urban households by slum/non-slum area in a final step to focus this analysis on dynamic, complex LMICs cities where inaccuracies in gridded data are likely to propagate [38].
This paper describes how we evaluated the cell-level accuracy of 32 simulated 100x100m WorldPop-Global-Unconstrained gridded population datasets which reflect realistic levels of census (1) outdatedness (0-, 5-, 10-, and 15-years outdated), (2) inaccuracy (none, low, middle, and high missing population counts), and (3) two administrative-level aggregations of the population in an urban LMIC setting. This is among the first assessments of cell-level accuracy of a gridded population dataset in a LMIC setting. While the methods and approach outlined here to evaluate cell-level accuracy (developing a realistic synthetic population, and from this, deriving several realistic versions of census data) were applied to just one gridded population dataset, they could be applied to other gridded population data products used for development monitoring and decision-making.
Methods
Setting
We chose to simulate a population in Khomas, Namibia–in which the vast majority of residents reside in Windhoek, the capital–because the government has produced numerous high-quality population datasets [39], and Windhoek’s population is incredibly dynamic (Fig 1). Namibia, like some other countries that inherited colonial boundaries, placed restrictions on freedom of movement until independence in 1990 [40]. After independence, vast numbers of people migrated to Windhoek, exaggerating rural-to-urban migration patterns observed globally during this time period [41,42]. Windhoek is also a destination for immigrants from neighbouring countries including financially unstable Zimbabwe [42,43]. The population of the Windhoek metropolitan area grew by a staggering 37% between the 2001 and 2011 censuses [39], with much of that growth in informal settlements [40].
Source: Constituency boundaries publically available from https://gadm.org/.
Simulation overview
To simulate realistic gridded population datasets for Khomas, Namibia, we (a) simulated a “true” synthetic 2016 population geo-located to realistic manually-generated household point locations; (b) introduced realistic outdatedness by removing households in 2011, 2006, and 2001; (c) introduced realistic inaccuracies among urban-slum, urban-non-slum, and rural sub-populations; and (d) aggregated these 16 simulated population scenarios into two geographic areal units (census EA and constituency) to generate 32 realistic census datasets. These 32 realistic census datasets were consequently used to model 32 realistic WorldPop-Global-Unconstrained 100x100m gridded population datasets. This workflow is summarised in Fig 2 and detailed below.
(1) Simulate a realistic population geo-located to realistic building point locations, (2) simulate three periods of outdatedness by removing households at point locations not present on satellite imagery in earlier years, (3) simulate low/middle/high census inaccuracy by removing points at random from rural, urban-slum, and urban-non-slum household types, (4) aggregate to 922 census enumeration areas (EAs) and 10 constituencies (admin-2), (5) generate 100x100m gridded population datasets in raster grid format using WorldPop-Global-Unconstrained approach and WorldPop-Global spatial covariates.
Simulating a “true” synthetic 2016 population geo-located to household latitude-longitude points
To simulate a realistic population in Khomas, Namibia, we used all of the same population inputs and spatial auxiliary datasets as Thomson and colleagues (2018) [38]. Broadly, this involved the creation of three datasets—modelled surfaces of household types, manually digitised building point locations, and synthetic (simulated) households—then linked synthetic households to point locations based on the household type probability surfaces.
- Modelled surfaces of household types. Household types were defined from Namibia 2013 Demographic and Health Survey (DHS) data using k-means analysis with variables that were also present in the Namibia 2011 census (e.g., improved sanitation facilities, gender of head of household). Next, probability surfaces of these household types were created using a Random Forrest model and spatial covariates to interpolate the likelihood of a given household type across Namibia between DHS survey locations [38]. The probability surfaces of “urban poor” and “urban non-poor” household types were manually adjusted due to high misclassification. These adjustments were made by manually assigning the proportion of households in each census enumeration area (EA) that appeared to be located in areas of small disorganised buildings based on visual inspection of 30m Quickbird satellite imagery.
- Synthetic households. Separately, we modelled a synthetic population of individuals nested within households across Khomas from Namibia 2011 census microdata using an iterative proportional fitting model and conditional annealing [44].
- Building locations. A third set of data, building point locations, were manually digitised from 2014–2016 30cm Quickbird imagery in ArcGIS 10.
To link synthetic households with building locations, we calculated the most likely household type of each synthetic household using k-means analysis scores. Next, we iteratively assigned synthetic households (2) to building point locations (3) based on the probability of each household type at a given building point (1). Finally, using the manually classified EAs (with our estimated portion of urban poor households), we classified all urban households as being located in either a slum or non-slum area. All of these steps are detailed in Supplement 1 and the paper by Thomson and colleagues (2018) [38]. This simulated population is meant to represent a realistic “true” synthetic reference population for 2016.
Simulating realistic outdatedness of Khomas census population.
To simulate population outdatedness in Khomas, we imported the above 2016 synthetic population household point locations into Google Earth, and used the software’s historical Maxar and SPOT imagery (40cm) to flag all buildings that were not present in 2011, 2006, and 2001 imagery. The oldest imagery available at 40cm resolution in Google Earth was from 2004, so we used some judgement to flag buildings that looked recently built in 2004 (e.g., bare fresh soil) and assumed they were not present in 2001. During this exercise, we ensured that the number of household coordinates in each constituency matched the number of households reported in the 2001 and 2011 Population and Housing Census final reports to ensure that both patterns and degree of outdatedness were realistic [39] (Fig 3). The synthetic population is provided in Supplement 2 and is comparable to the Oshikoto, Namibia 2016 synthetic population created by Thomson and colleagues [38].
Sources: Constituency boundaries publically available from https://gadm.org/. Synthetic population latitude-longitude coordinates available in Supplement 2.
Simulating realistic levels of under-count inaccuracy in censuses.
To identify realistic levels of under-counts among urban-slum, urban-non-slum, and rural populations in LMIC censuses, we reviewed the scientific and grey literature. The review included census post enumeration surveys (PESs) in 108 LMICs listed by the UN Statistical Division Census Programme website [8], and a systematic search in PubMed and Scopus of articles published between January 1, 1990 and February 28, 2017 using the following search criteria: “census AND (listing OR enumerat* OR count OR coverage OR miss*) AND (nomad* OR pastoral* OR refugee OR displaced OR migrant OR slum OR poorest OR unregistered OR homeless OR [street] sleeper OR pavement [dweller] OR floating)”. The first wave of the literature search resulted in 459 unique articles, of which co-author DRT screened all titles and abstracts. Of 72 potentially eligible articles from LMICs, DRT reviewed the full-text, and kept five which reported a census under-count. In a second wave, we used Google Scholar to identify the top 20 “cited by” and top 20 “related” articles for each of the five articles identified in the first wave. The second wave resulted in 334 unique articles, of which 49 had potentially relevant titles or abstracts. After a full-text review of these articles, we found eight additional reported census under-counts. Together, census under-counts in LMICs were collated from 10 PESs [45–54], and 13 articles [10,55–66] (Fig 4). The average census under-counts were 46% in urban-slum populations, 6% in urban-non-slum populations, and 7% in rural populations (Table 2, see Supplement 3 for details).
Based on these findings, we simulated three levels of census inaccuracy: low inaccuracy was considered to be missing 2% of rural and urban-non-slum households, and 10% of urban-slum households; medium inaccuracy was considered to be missing 5% of rural and urban-non-slum households, and 30% of urban-slum households; and finally, high inaccuracy was classified as missing 10% of rural and urban-non-slum households, and 60% of urban-slum households (Table 1). We applied the inaccuracy rates at random within rural, urban-slum, and urban-non-slum households such that there was no spatial pattern inherent to the simulated under-counts. This exercise resulted in one “true” and 15 outdated-inaccurate simulated populations which we used to generate realistic gridded population datasets that reflect typical gridded population estimates currently available across LMICs (Table 2).
Simulating realistic gridded population datasets.
To simulate realistic gridded population datasets, we aggregated each of the simulated household populations to EA or constituency (second-level administrative unit) boundaries, and applied the WorldPop-Global-Unconstrained modelling technique (for a total of 32 datasets). We applied the WorldPop-Global-Unconstrained model in three phases as described in WorldPop’s method publication [22] (Fig 5, Table 3).
- In the first phase (A), a non-parametric Random Forest ensemble machine-learning algorithm grows a “forest” of decision trees for each input unit (EA or constituency) [67]. Each Random Forest tree is a model of the potential relationships between multiple auxiliary covariates and census population counts. In the Random Forest modelling workflow, this is where model uncertainty is calculated–at the scale of the input population areal unit.
- In the second phase (B), all of the covariates are prepared in 100x100m cells. In this phase, the split values of each classification tree developed in phase A are used to parameterize corresponding regression models to predict population density within 100x100m cells [22]. For each cell, the predicted population values from all regression models are averaged to make a single population estimate, though these population estimates are not pycnophylactic, meaning that estimates in cells do not necessarily sum to the original areal unit population.
- Thus the WorldPop-Global-Unconstrained workflow involves a third phase (C) outside of the Random Forest model to normalize cell-level predicted population densities to preserve census input population counts [22].
(A) Each decision tree in the ensemble is built upon a random bootstrap sample of the log-transformed population and ancillary data by administrative unit. (B) Population density prediction for each cell ycell(x) is based on an average of the individual trees. (C) Predicted cell densities are normalized by administrative unit and used to dasymetrically disaggregate log-transformed administrative unit population, then transformed to predict population per cell.
Analysing cell-level accuracy
To empirically measure cell-level accuracy of the 32 gridded population datasets, we compared each cell-level estimate against the “true” synthetic point-level 2016 population count in that cell, then calculated root mean square error (RMSE), a measure of error magnitude that penalises large errors. This was performed on 100x100m cells, and then estimated cell population counts were aggregated and assessed for accuracy at 200x200m, 300x300m, and so on up to 1x1km. This was to test a common assumption that large model errors at fine geographic scale are “smoothed out” and become less severe as population estimates are aggregated across larger zones. To compare RMSE across cells of different geographic sizes, we normalised the statistic by average population (Eq 1) and by area (Eq 2). The former represents RMSE of population counts expressed as a portion of the population [83], while the latter represents RMSE of population density per hectare (100x100m unit) [84]. We evaluated RMSE in urban-slum, urban-non-slum, and rural cells separately. In the calculation of RMSE, yi is the “true” synthetic population count in cell i, is the gridded population estimate in cell i, Di is the “true” synthetic population density per hectare,
is the estimated population density per hectare, and n is the number of grid cells.
To better understand the mechanics of the WorldPop-Global-Unconstrained model and workflow, we calculated bias, a measure of error direction and magnitude. This metric was especially useful for the two gridded population datasets derived from “true” synthetic population counts because any inaccuracies would be related to the model and covariate datasets alone; and not inaccuracies in the input population counts. Bias (Eq 3) reveals to what extent cell-level estimates are systematically under- or over-estimated, and reflects over/under-counts in cells of different sizes that a user might encounter in the field. Relative bias (Eq 4) refers to bias normalised by the average synthetic population which enables comparisons across grid scales. As above, bias and relative bias were assessed in 100x100m cells as well as cell sizes that ranged up to 1x1km, and separately in urban versus rural areas.
To assess the degree to which non-zero population estimates in the WorldPop-Global-Unconstrained dataset resulted in misallocation of population, a third statistic was calculated counting the entire modelled population in Khomas that was misallocated to cells which were unsettled according to the “true” synthetic population. For all statistics, we excluded gridded population cell-level estimates of less than 1 person to avoid millions of near-zero cell-level estimates in unsettled areas of Khomas (located outside of Windhoek) from dominating the accuracy assessments.
Results
Neither measure of RMSE differed substantially across the simulated outdated-inaccurate census scenarios (Figs 6 and 7). Furthermore, errors only slightly decreased when the input data were aggregated to EA (finer) rather than constituency (coarser) (Figs 6 and 7). The major driver of RMSE in cells was urban versus rural location, with further difference between urban-slum and urban-non-slum. In urban cells, population-adjusted RMSE was substantially smaller than rural cells (Fig 6), but much larger per hectare due to larger population numbers (Fig 7). In urban areas, RMSE per hectare was lowest in 100x100m cells (slum range: 32–72, non-slum range: 21–33), while in rural areas, RMSE per hectare was lowest in cells 300x300m to 500x500m (rural range: 2–54) (Fig 7). Results for select scenarios are presented in Fig 6 ranging from the synthetic “true” 2016 population to the most outdated (2001) and inaccurate (missing 10% to 60%) population, though tables of all results are provided in Supplement 4.
Assessment of bias in the two gridded population datasets that were derived from synthetic “true” 2016 population counts revealed systematic and substantial under-estimates of populations in urban-slum and urban-non-slum cells due to the aggregation-level of the input population data and modelling approach, and not inaccuracies in the input data (Tables 4 and 5). For example, the average 300x300m urban-slum cell under-estimated the population by more than 350 people (EA-level input) up to 500 people per cell (constituency-level input). For comparison, the average 300x300m non-slum cell was under-estimated by 165 people (constituency-level input) to 187 people (EA-level input), while the average rural cell of the same size was over-estimated by 3 people (constituency-level input) to 14 people (EA-level input) (Table 4). When adjusted for population, the results indicate that for every person estimated in an urban non-slum cell, 0.5 to 1 person is omitted; and for every person estimated in an urban slum cell, 0.75 to 1.5 people are omitted (Table 5).
Table 6 summarises the percent of the estimated population misallocated to “truly” unsettled cells according to the synthetic population. For this analysis, no cells in the estimated population were excluded. Roughly 20% (EA-level input) or 10% (constituency-level input) of the population was misallocated to unsettled 100x100m cells (Table 6). However, as cells were aggregated, the percent of misallocated population dropped precipitously. For example, at 300x300m, approximately 2% (EA-level input) or 1% (constituency-level input) of Khomas’s population was misallocated to unsettled cells. This indicates that most of the population was disaggregated to unsettled cells within, or near to, settlements. The rates of misallocation were similar when cells with less than one person were excluded (not reported).
Discussion
This is among the first accuracy assessments of a top-down gridded population model at the grid-cell level, and the first that we know of in a LMIC setting. By developing a simulated realistic population and several scenarios of the population with realistic levels of outdatedness and inaccuracy, we were able to evaluate the accuracy of a gridded population model, as well as assess the impact of outdated-inaccurate census inputs on estimates. In this paper, we evaluated just one of several gridded population models–WorldPop-Global-Unconstrained. We also only analysed one simulated population and focused on the particular setting of Khomas, Namibia, so the results do no necessarily generalize to other cities or datasets. In this specific analysis, cell-level inaccuracies between urban versus rural areas dominated the results.
In practical terms, this massive difference between urban versus rural accuracy means that urban development indicators calculated with a WorldPop-Global-Unconstrained dataset at fine scale (e.g., neighbourhood) would likely be incorrect, and could lead to poorly informed decisions. For example, an underestimate of the number of people living in a neighbourhood could overestimate both vaccination coverage and disease infection rates. Contrary to what some might assume, there was limited evidence in this study that outdated or inaccurate census data played a major role in cell-level inaccuracy of gridded population estimates. Instead, we address three other potential sources of the cell-level inaccuracies observed.
The first issue is specific to the WorldPop-Global-Unconstrained modelling approach. In this approach, input administrative units with zero population are excluded and the remaining population counts are log-transformed before inclusion in a Random Forest model. While this procedure ensures that population counts are normally distributed during modelling, it also means that unpopulated cells are assigned a very small fraction of a person [22]. A possible concern is that non-zero population estimates across millions of unsettled cells could result in a sizable portion of the population being misallocated. Our analysis of misallocation, however, indicates that this phenomenon played only a minor role in cell-level inaccuracies, if at all. Table 6 demonstrates that even in this context of vast unsettled areas, only a small portion of Khomas’ population was misallocated to cells far from actual settlements. Nearly all of the population was estimated to be in cells within 200 to 300 metres of the “true” synthetic population.
Most global gridded population producers constrain estimates to settled cells as defined with a settlement layer (e.g. LandScan [24,85], GHP-POP [19,20], HRSL [21], GRID3 [28,86], WPE [26]). Until recently, these settlement layers tended to be relatively coarse (e.g. GHS-BUILT 1x1km [87]) and/or had a tendency to omit areas with few sparse buildings (e.g. GUF [80]) which could under-estimate the population in rural areas and over-estimate the population in urban areas. However, new free very high resolution Sentinel-2 imagery, and major leaps in computing power for extracting building footprints and other features from imagery, have enabled development of several new detailed settlement layers in the last few years (e.g., GHS-BUILT-S2 [88], Maxar/Ecopia [89]). Recently, WorldPop-Global produced a constrained global gridded population estimate for 2020 that uses the same input population and covariate datasets as its unconstrained model plus several building footprint metrics (in Africa), and then masks all 100x100m cells without building footprints (in Africa) or built settlement (rest of the world) [35], eliminating the issue of non-zero population estimates in unsettled cells.
The second potential source of inaccuracy relates to covariate resolution and the relationship of covariates with population density. This issue seems to have contributed more substantially to errors in this analysis, particularly within the city of Windhoek. A number of the Random Forest model covariates, such a land cover type and night-time lights, had an original resolution substantially coarser than 100x100m which could have resulted in a “halo” effect around settlements, causing populations to be disaggregated to cells near a settlement, but not directly over it. Table 5 provides evidence of this; the accuracy of the estimated population distribution, and correct allocation of population to settled cells, both performed well when the estimated population was aggregated to 300x300m or larger. Other covariates, such as distance to roads and intersection locations were available at very fine spatial resolution and thus were precise at the 100x100m scale. Although they are good indicators of a settlement, they are not necessarily good indicators of higher or lower population density within a settlement. The lack of fine-scale covariates associated with population density within cities and towns likely explains a portion of the cell-level error observed in Khomas’s urban population. Other issues that might further decrease local spatial accuracy are temporal miss-match of covariates [16] and covariate spatial autocorrelation [90]. With the recent release of several building footprint datasets (e.g., Maxar/Ecopia in most of Africa [89], Bing in Tanzania and Uganda [91]), several new covariate layers have been created by the WorldPop team including number of buildings and total area of buildings in 100x100m cells [92]. Building footprints are likely associated with population density within settlements and have a finer spatial resolution than 100x100m, making it a potentially powerful covariate to differentiate lower and higher population density within urban areas in any gridded population model. The WorldPop team, among other gridded population producers, is currently working to test and incorporate building footprint datasets into gridded population models.
The third potential source of cell-level inaccuracies is use of average population densities from large administrative units to estimate population densities in much smaller grid cells. This is known as the ecological fallacy [93], and probably played the largest role in cell-level inaccuracies, especially within urban areas. Population densities are used by the Random Forest model to establish relationships between covariates and population density (total population divided by total area), not population totals. Even with perfect covariates and exclusion of unsettled areas, this would mean that cells with high “true” synthetic population counts are likely to be severely underestimated because the geographic size of input population units are larger (and population densities are smaller) than the output grid cells. When this happens, population counts that are not allocated to the densest cells will instead be allocated to other less dense cells in the same input areal unit. Tables 4 and 5 provide strong evidence of this issue with the population in urban cells, especially urban-slum cells, systematically underestimated regardless of cell size.
Although these results apply only to the WorldPop-Global-Unconstrained model, we can speculate about how these results might apply to other gridded population datasets. Most top-down gridded population datasets use average population densities from large input areal units in some way to populate smaller grid cells, and are thus likely subject to similar errors linked with the ecological fallacy. The High Resolution Settlement Layer (HRSL), for example, uses uniform areal disaggregation of the population from input units (e.g., EA) to 30x30m grid cells which contain a building footprint [21], and the Global Human Settlement GHS-POP dataset takes a similar approach disaggregating input populations into 250x250m cells that are classified as settled [19,20]. Gridded Population of the World (GPWv4) is likely even less accurate at the cell-level because the population from each input unit (e.g., EA) are smoothed across all cells in that unit, including unsettled cells [17]. Gridded population datasets based on complex models with variable disaggregation from units to grid cells, such as LandScan [24] and World Population Estimates (WPE) [26], are instead subject to the second limitation described above because, like WorldPop-Global-Unconstrained, they lack high-resolution model covariates (e.g., building density) to accurately differentiate population density within settled cells.
This analysis reinforces findings of other studies which find that currently available gridded population products tend to underestimate populations in urban areas [94–96], especially in higher-density poorer neighbourhoods [97]. For example, Tuholske and colleagues (2021) compared five gridded population products to estimate the proportion of population affected by natural disasters (SDG 11.5) in three regions where disasters had occurred, and found that 1x1km population estimates varied widely among data products, and reflected anywhere from 20% to 80% of the total UN estimated population in each region. Furthermore, they found that WorldPop-Global-Unconstrained generally performed better than un-modelled products (e.g., GPW), but not as well as products that constrained estimates to settled cells (e.g., GHS-POP) [94]. In a separate comparison of nine gridded population estimates of Kenyan and Nigerian slum populations (SDG 11.1.1) where field counts were available for reference, the estimated population in each slum varied widely and WorldPop-Global-Unconstrained estimates reflected just 11% of the overall slum population while the best performing data product (HRSL) estimated just 34% of all slum dwellers [97]. A key take-away from gridded population comparison studies is that fine-scale accuracy across data products varies substantially depending on location, potentially leading to different conclusions and decisions (e.g., about the humanitarian need or health care burden) depending on the gridded population dataset used for analysis. Furthermore, these studies underscore the need to understand fine-scale accuracy across gridded population datasets and locations to inform improvements to the underlying modelling methods and inputs.
Our analysis of a simulated population offers a methodological approach that can be replicated in other settings to evaluate the accuracy of any gridded population dataset at the cell-level. This analysis also points toward two solutions–use of building footprint covariates and finer-scale training data–that stand to improve cell-level accuracy of gridded population datasets derived from complex models, including all WorldPop-Global datasets as well as LandScan [24,25], WPE [26], and GRID3 [28,86]. Other techniques would be needed to improve the accuracy of gridded population datasets that do not vary (weight) population densities within areal units based on auxiliary information (e.g., HRSL [21], GHS-POP [19,20], GPW [17,18]).
Our first suggestion to improve WorldPop-Global datasets is to incorporate finer-scale training data into models to overcome the problem of larger areal-unit average values being used in smaller grid cells. In cases where the input areal units are geographically large, WorldPop-Global-Unconstrained (and Constrained) models incorporate training data from a neighbouring country that has finer-scale input population counts [22]. Our analysis showed, however, that even when relatively small geographic units (census EAs) were used as the input population area unit, urban slum and non-slum cell-level errors were still substantial, and cell-level accuracy with EA-level input was only marginally improved compared to constituency-level input (Fig 7). This suggests that finer-scale training data (e.g., closer to 100x100m) should be incorporated during the model training phase, particularly from high-density urban areas, to ensure that the WorldPop Random Forest model contains sufficiently large population density values to assign to urban cells. Fine-scale training datasets might come from existing household survey enumerations (e.g., World Bank Living Standards Measurement Surveys), or slum community profiles such as those published on the Know Your City Campaign website [98]. Even if fine-scale densities are only available for a small sample of locations, they would provide the model with more accurate maximum population values at the scale of 100x100m during model training.
The second potential solution is to incorporate more spatially detailed datasets into models which correlate with variations in population density. This analysis of WorldPop-Global-Unconstrained data raises broader questions about the cell-level accuracy of all gridded population estimates in urban areas, especially the densest parts of cities such as in slums, informal settlements, and neighbourhoods with high-rise apartment buildings [99–101]. New datasets derived from very high resolution satellite imagery, in particular building footprints, are a promising new covariate to reduce the “halo” effect of populations misallocated nearby, but not directly over, the highest density cells. More work will be needed to improve building footprint datasets by distinguishing residential and non-residential buildings to avoid population being misallocated to business districts, factories, universities, airports, and other non-residential cells [102,103].
Conclusions
Global gridded population data initiatives aim to fill a gap in available disaggregated and current population counts to ensure that everyone is counted and that all needs are met in development initiatives. However, many gridded population datasets are not evaluated for accuracy at fine spatial scale. This analysis of one simulated population in one setting revealed substantial and systematic under-estimation of population in slums. Further analyses of other gridded population datasets are needed across diverse settings. However, if severe under-estimates in slums and other high-density urban areas are widespread, this means that gridded population datasets might unintentionally reinforce marginalisation of the urban poorest by omitting them from maps and population counts. We offer two suggestions to address this challenge: inclusion of finer-scale training data from household survey listings or “slum” enumerations, and the addition of new building footprints data as model covariates. Given the increased use of gridded population datasets for monitoring health and development outcomes in small areas, it is imperative that gridded population datasets area assessed for cell-level accuracy and are improved where possible.
Supporting information
S1 Table. Percent of population missing from LMIC censuses by source.
https://doi.org/10.1371/journal.pone.0271504.s001
(DOCX)
S2 Table. Root Mean Square Error (RMSE) statistics for all scenarios.
https://doi.org/10.1371/journal.pone.0271504.s002
(DOCX)
S1 File. Simulating a population in Khomas, Namibia.
https://doi.org/10.1371/journal.pone.0271504.s003
(PDF)
S2 File. Simulated population in Khomas, Namibia.
https://doi.org/10.1371/journal.pone.0271504.s004
(CSV)
Acknowledgments
We would like to thank Drs. Angela Luna Hernandez and Ryan Engstrom for their feedback on an earlier version of this work.
References
- 1.
UN Human Settlements Programme (UN-Habitat). World cities report 2020: the value of sustainable urbanization. Nairobi: UN-Habitat; 2020. 377 p.
- 2. Utazi CE, Wagai J, Pannell O, Cutts FT, Rhoda DA, Ferrari MJ, et al. Geospatial variation in measles vaccine coverage through routine and campaign strategies in Nigeria: analysis of recent household surveys. Vaccine. 2020;38(14):3062–71. pmid:32122718
- 3. Ruktanonchai CW, Ruktanonchai NW, Nove A, Lopes S, Pezzulo C, Bosco C, et al. Equality in maternal and newborn health: modelling geographic disparities in utilisation of care in five East African countries. PLoS One. 2016;11(8):e0162006. pmid:27561009
- 4. Cutts FT, Ferrari MJ, Krause LK, Tatem AJ, Mosser JF. Vaccination strategies for measles control and elimination: time to strengthen local initiatives. BMC Med. 2021;19(1):1–8.
- 5. Turok I, McGranahan G. Urbanization and economic growth: the arguments and evidence for Africa and Asia. Environ Urban. 2013;25(2):465–82.
- 6. Chen M, Zhang H, Liu W, Zhang W. The global pattern of urbanization and economic growth: Evidence from the last three decades. PLoS One. 2014;9(8):e103799. pmid:25099392
- 7.
United Nations Statistics Division (UNSD). 2020 world population and housing census programme [Internet]. Census dates for all countries. 2021 [cited 2021 Sep 29]. Available from: https://unstats.un.org/unsd/demographic-social/census/censusdates/.
- 8. Bekele S. The accuracy of demographic data in the Ethiopian censuses. East Afr Soc Sci Res Rev. 2017;33(1):15–38.
- 9. Carr-Hill R. Missing millions and measuring development progress. World Dev. 2013;46:30–44.
- 10. Ahonsi BA. Deliberate falsification and census-data in Nigeria. Afr Aff (Lond). 1988 Oct;87(349):553–62.
- 11. Okolo A. The Nigerian census: problems and prospects. Am Stat. 1999;53(4):321–5.
- 12. Yin S. Objections surface over Nigerian census results [Internet]. Population Reference Bureau. 2007 [cited 2021 Sep 29]. p. 1–3. Available from: www.prb.org/resources/objections-surface-over-nigerian-census-results/.
- 13.
United Nations Department of Economic and Social Affairs (UN-DESA). World Urbanization Prospects: The 2018 Revision [Internet]. 2018 [cited 2021 Sep 29]. Available from: https://population.un.org/wup/DataQuery/.
- 14. Thomson DR, Rhoda DA, Tatem AJ, Castro MC. Gridded population survey sampling: a systematic scoping review of the field and strategic research agenda. Int J Health Geogr. 2020;19:34. pmid:32907588
- 15.
POPGRID Data Collaborative. Leaving no one off the map: a guide for gridded population data for sustainable development [Internet]. New York NY USA; 2020. Available from: www.popgrid.org/sites/default/files/documents/Leaving_no_one_off_the_map.pdf.
- 16. Leyk S, Gaughan AE, Adamo SB, de Sherbinin A, Balk D, Freire S, et al. Allocating people to pixels: a review of large-scale gridded population data products and their fitness for use. Earth Syst Sci Data Discuss. 2019;11:1385–409.
- 17. Doxsey-Whitfield E, MacManus K, Adamo SB, Pistolesi L, Squires J, Borkovska O, et al. Taking advantage of the improved availability of census data: a first look at the Gridded Population of the World, version 4. Pap Appl Geogr. 2015 Jul 3;1(3):226–34.
- 18.
Center for International Earth Science Information Network (CIESIN), Columbia University. Gridded Population of the World v4 [Internet]. 2016 [cited 2021 Sep 29]. Available from: http://sedac.ciesin.columbia.edu/data/collection/gpw-v4/sets/browse.
- 19. Pesaresi M, Ehrlich D, Florczyk AJ, Freire S, Julea A, Kemper T, et al. Operating procedure for the production of the Global Human Settlement Layer from Landsat data of the epochs 1975, 1990, 2000, and 2014 [Internet]. Ispra Italy: European Commission Joint Research Centre; 2016. 67 p. Available from: http://publications.jrc.ec.europa.eu/repository/handle/JRC97705.
- 20.
European Commission Joint Research Centre (EC-JRC). Global human settlement population model (GHS-POP) [Internet]. 2020 [cited 2021 Sep 29]. Available from: https://ghsl.jrc.ec.europa.eu/data.php.
- 21.
Facebook Connectivity Lab, CIESIN—Columbia University. High Resolution Settlement Layer (HRSL) [Internet]. 2016 [cited 2021 Sep 29]. Available from: https://data.humdata.org/dataset/highresolutionpopulationdensitymaps.
- 22. Stevens FR, Gaughan AE, Linard C, Tatem AJ. Disaggregating census data for population mapping using random forests with remotely-sensed and ancillary data. PLoS One. 2015;10(2):e0107042. pmid:25689585
- 23.
WorldPop. Population Counts 2000–2020 UN-Adjusted Unconstrained 100m [Internet]. 2020 [cited 2021 Sep 29]. Available from: www.worldpop.org/doi/10.5258/SOTON/WP00660.
- 24. Dobson JE, Bright EA, Coleman PR, Worley BA, Bright EA, Coleman PR, et al. LandScan: a global population database for estimating populations at risk. Photogramm Eng Remote Sensing. 2000 Jul;66(7):849–57.
- 25.
Oak Ridge National Laboratories. LandScan Data Availability [Internet]. 2017 [cited 2021 Sep 29]. Available from: www.ornl.gov.
- 26. Frye C, Nordstrand E, Wright DJ, Terborgh C, Foust J. Using classified and unclassified land cover data to estimate the footprint of human settlement. Data Sci J. 2018;17:1–12.
- 27. Long JF, McMillen DB. A survey of census bureau population projection methods. Clim Change. 1987;11:141–77. pmid:12280853
- 28. Leasure DR, Jochem WC, Weber EM, Seaman V, Tatem AJ. National population mapping from sparse survey data: a hierarchical Bayesian modeling framework to account for uncertainty. Proc Natl Acad Sci U S A. 2020;117(39):24173–9. pmid:32929009
- 29. Leasure DR, Dooley CA, Bondarenko M, Tatem AJ. peanutButter: an R package to produce rapid-response gridded population estimates from building footprints, version 0.3.0 [Internet]. 2020 [cited 2021 Sep 29]. Available from: https://apps.worldpop.org/peanutButter/.
- 30. Hay S, Noor A, Nelson A, Tatem A. The accuracy of human population maps for public health application. Trop Med Int Heal. 2005;10:1073–86. pmid:16185243
- 31. Gaughan AE, Stevens FR, Linard C, Jia P, Tatem AJ. High resolution population distribution maps for Southeast Asia in 2010 and 2015. PLoS One. 2013;8(2):e55882. pmid:23418469
- 32. Bondarenko M, Nieves JJ, Stevens FR, Gaughan AE, Tatem A, Sorichetta A. wpgpRFPMS: random forests population modelling R scripts, version 0.1.0 [Internet]. Southampton UK; 2020. Available from:
- 33. Lloyd CT, Chamberlain H, Kerr D, Yetman G, Pistolesi L, Stevens FR, et al. Global spatio-temporally harmonised datasets for producing high-resolution gridded population distribution datasets. Big Earth Data. 2019;3(2):108–39. pmid:31565697
- 34.
WorldPop. WorldPop-Global covariates [Internet]. 2020 [cited 2021 Sep 29]. Available from: https://www.worldpop.org/project/categories?id=14.
- 35.
WorldPop. Top-down estimation modelling: constrained vs unconstrained [Internet]. 2020 [cited 2021 Sep 29]. Available from: www.worldpop.org/methods/top_down_constrained_vs_unconstrained.
- 36.
United Nations Statistics Division (UNSD). Report on the results of a survey on census methods used by countries in the 2010 census round [Internet]. New York NY USA; 2010. (Working paper). Report No.: UNSD/DSSB/1. Available from: http://unstats.un.org/unsd/census2010.htm.
- 37. Cobham A. Uncounted: power, inequalities and the post-2015 data revolution. Development. 2014;57(3–4):320–37.
- 38. Thomson DR, Kools L, Jochem WC. Linking synthetic populations to household geolocations: a demonstration in Namibia. Data. 2018;3(3):30.
- 39.
Namibia Statistics Agency (NSA). Namibia 2011 Population and Housing Census main report [Internet]. Windhoek Namibia; 2011. Available from: https://cms.my.na/assets/documents/p19dmn58guram30ttun89rdrp1.pdf.
- 40.
Newaya TP. Rapid urbanization and its influence on the growth of informal settlements in Windhoek, Namibia. MSc Thesis, Cape Peninsula University of Technology. 2010. Available from: http://etd.cput.ac.za/handle/20.500.11838/1451.
- 41. Lai S, Erbach-Schoenberg E zu, Pezzulo C, Ruktanonchai NW, Sorichetta A, Steele J, et al. Exploring the use of mobile phone data for national migration statistics. Palgrave Commun. 2019;5(1):34. pmid:31579302
- 42.
Olivier M. Migration in Namibia: a country profile 2015. Geneva: International Organization for Migration (IOM); 2015. 174 p.
- 43.
WorldPop. Africa 1km internal migration flows [Internet]. 2016 [cited 2021 Sep 29]. Available from: www.worldpop.org/geodata/summary?id=1281.
- 44. Alfons A, Kraft S, Templ M, Filzmoser P. Simulation of close-to-reality population data for household surveys with application to EU-SILC. Stat Methods Appl. 2011;20(3):383–407.
- 45.
Oliveira LC de S, Freitas MPS de, Dias MRML, Nascimento CMF, Mattos E da S, Junior JJAR. Censo Demográfico 2000—pesquisa de avaliação da cobertura da coleta [Internet]. Rio de Janeiro; 2003. Available from: https://biblioteca.ibge.gov.br/biblioteca-catalogo.html?id=21402&view=detalhes.
- 46.
Korale RBM. Post Enumeration Survey 2001 [Nepal Population Census] Draft Report [Internet]. Kathmandu; 2002 [cited 2019 Jan 20]. Available from: https://nepal.unfpa.org/sites/default/files/pub-pdf/PopulationMonograph2014Volume1.pdf.
- 47.
Maro R. Post enumeration survey Tanzania experience [Internet]. Workshop on the 2010 World programme on population and housing censuses: census evaluation and post enumeration surveys, for English-speaking African countries. 2009 [cited 2021 Sep 29]. p. 12. Available from: https://unstats.un.org/unsd/demographic/meetings/wshops/Ethiopia_14_Sept_09/Country_Presentations/Tanzania.ppt.
- 48.
Uganda Bureau of Statistics (UBS). Post enumeration survey: 2002 Uganda population and housing census [Internet]. Entebbe Uganda; 2005 [cited 2021 Sep 29]. Available from: www.ubos.org/wp-content/uploads/publications/03_20182002_CensusPopnSizeGrowthAnalyticalReport.pdf.
- 49.
Ghana Statistical Service (GSS). 2010 Population and Housing Census Post Enumeration Survey Report [Internet]. Accra Ghana; 2012 [cited 2021 Sep 29]. Available from: www2.statsghana.gov.gh/docfiles/2010phc/2010_PHC_PES_Report.pdf.
- 50.
Central Statistical Office (CSO). [Zambia] 2010 Census of Population and Housing Post Enumeration Survey (PES) [Internet]. Lusaka Zambia; 2013 [cited 2021 Sep 29]. Available from: https://web.archive.org/web/20151113170741/ http://www.zamstats.gov.zm/report/Census/2010/National/2010%20Census%20Post%20Enumeration%20Report.pdf.
- 51.
Bangladesh Institute of Development Studies (BIDS). Report of the post enumeration check (PEC) of the [Bangladesh] Population and Housing Census, 2011 [Internet]. Dhaka Bangladesh; 2012 [cited 2021 Sep 29]. Available from: http://203.112.218.65:8008/WebTestApplication/userfiles/Image/LatestReports/PEC%20Report%202011.pdf.
- 52.
National Statistical Commission (NSC). Census of India 2011: Report on post enumeration survey [Internet]. New Delhi India; 2014 [cited 2021 Sep 29]. Available from: https://censusindia.gov.in/nada/index.php/catalog/1366.
- 53.
Statistics South Africa (SSA). Census 2011 post-enumeration survey [Internet]. Pretoria South Africa; 2012 [cited 2021 Sep 29]. Available from: www.datafirst.uct.ac.za/dataportal/index.php/catalog/485/download/8289.
- 54.
National Institute of Statistics of Rwanda (NISR). Post enumeration survey report: fourth Population and Housing Census, Rwanda, 2012 [Internet]. Kigali Rwanda; 2010 [cited 2021 Sep 29]. Available from: www.statistics.gov.rw/publication/rphc4-post-enumeration-survey.
- 55. Agarwal S. The state of urban health in India: comparing the poorest quartile to the rest of the urban population in selected states and cities. Environ Urban. 2011;23(1):13–28.
- 56. Carr-Hill R. Improving population and poverty estimates with citizen surveys: evidence from East Africa. World Dev. 2017;93:249–59.
- 57. Ebenstein A, Zhao Y. Tracking rural-to-urban migration in China: lessons from the 2005 inter-census population survey. Popul Stud (NY). 2015;69(3):337–53. pmid:26296099
- 58. Gidado SO, Nguku PJ, Ndadilnasiya Waziri M, Ohuabunwo C, Etsano A, Mahmud MZ, et al. Polio field census and vaccination of underserved populations Northern Nigeria, 2012–2013. Morb Mortal Wkly Rep. 2013;62(33):663–5.
- 59. Gurgel RQ, Da Fonseca JDC, Neyra-Castañeda D, Gill G V., Cuevas LE. Capture-recapture to estimate the number of street children in a city in Brazil. Arch Dis Child. 2004;89:222–4. pmid:14977695
- 60. Jiang Q, Li X, Sánchez-Barricarte JJ. Data uncertainties in China’s population. Asian Soc Sci. 2015;11(13):200–5.
- 61. Karanja I. An enumeration and mapping of informal settlements in Kisumu, Kenya, implemented by their inhabitants. Environ Urban. 2010;22(1):217–39.
- 62. Kronenfeld DA. Afghan refugees in Pakistan: not all refugees, not always in Pakistan, not necessarily Afghan? J Refug Stud. 2008;21(1):43–63.
- 63. Lucci P, Bhatkal T, Khan A. Are we underestimating urban poverty? World Dev. 2018;103:297–310.
- 64. Sabry S. How poverty is underestimated in Greater Cairo, Egypt. Environ Urban. 2010;22(2):523–41.
- 65. Stark L, Rubenstein BL, Pak K, Taing R, Yu G, Kosal S, et al. Estimating the size of the homeless adolescent population across seven cities in Cambodia. BMC Med Res Methodol. 2017;17:1–8.
- 66.
Treiman DJ, Mason WM, Lu Y, Pan Y, Qi Y, Song S. Observations on the design and implementation of sample surveys in China [Internet]. Los Angeles; 2005. Report No.: CCPR-006-05. Available from: http://papers.ccpr.ucla.edu/index.php/pwp/article/download/PWP-CCPR-2005-006/405.
- 67. Breiman L. Random forests. Mach Learn. 2001;45:5–32.
- 68.
OpenStreetMap contributors. OpenStreetMap base data [Internet]. 2000 [cited 2021 Sep 29]. Available from: www.openstreetmap.org.
- 69.
United Nations Environment Programme-World Conservation Monitoring Centre (UNEP-WCMS), International Union for Conservation of Nature (IUCN). World database on protected areas & Global database on protected areas management effectiveness [Internet]. UNEP-WCMS & IUCN. 2016 [cited 2021 Sep 29]. Available from: www.protectedplanet.net.
- 70.
[USA] National Oceanic and Atmospheric Administration (NOAA). VIIRS nighttime lights [Internet]. 2012 [cited 2021 Sep 29]. Available from: www.ncei.noaa.gov/maps/VIIRS_DNB_nighttime_imagery.
- 71.
[USA]National Oceanic and Atmospheric Administration (NOAA). Version 4 DMSP-OLS Nighttime Lights Time Series [Internet]. 2017 [cited 2021 Sep 29]. Available from: www.ngdc.noaa.gov/eog/dmsp/downloadV4composites.html.
- 72. Zhang Q, Pandey B, Seto KC. A robust method to generate a consistent time series from DMSP / OLS nighttime light data. IEEE Trans Geosci Remote Sens. 2016;54(10):5821–31.
- 73. Weiss D, Nelson A, Gibson H, Temperley W, Peedell S, Lieber A, et al. A global map of travel time to cities to assess inequalities in accessibility in 2015. Nature. 2018;553(7688):333–6. pmid:29320477
- 74.
European Space Agency—Climate Change Initiative (ESA-CCI). Land Cover CCI Product—Annual LC maps from 2000 to 2015 (v2.0.7) [Internet]. 2017 [cited 2021 Sep 29]. Available from: http://maps.elie.ucl.ac.be/CCI/viewer/.
- 75.
European Space Agency—Climate Change Initiative (ESA-CCI). Land cover CCI product—MERIS Waterbody product v4.0 (150 m) [Internet]. 2017 [cited 2021 Sep 29]. Available from: http://maps.elie.ucl.ac.be/CCI/viewer/.
- 76.
de Ferranti J. Digital elevation data—Viewfinder panoramas [Internet]. 2017 [cited 2021 Sep 29]. Available from: www.viewfinderpanoramas.org/dem3.html.
- 77.
de Ferranti J. Digital elevation data: SRTM void fill—Viewfinder panoramas [Internet]. 2017 [cited 2021 Sep 29]. Available from: www.viewfinderPanoramas.org/voidfill.html.
- 78.
Center for International Earth Science Information Network—CIESIN—Columbia University. Gridded Population of the World, Version 4.11 (GPWv4.11) [Internet]. 2018 [cited 2021 Sep 29]. Available from: https://doi.org/10.7927/H4F47M65.
- 79.
European Commission. Global human settlement city model (GHS-SMOD) [Internet]. 2017 [cited 2021 Sep 29]. Available from: https://ghsl.jrc.ec.europa.eu/download.php.
- 80.
DLR Earth Observation Center. Global Urban Footprint (GUF) [Internet]. 2017 [cited 2021 Sep 29]. Available from: www.dlr.de/eoc/en/desktopdefault.aspx/tabid-11725/20508_read-47944/.
- 81. Nieves JJ, Sorichetta A, Linard C, Bondarenko M, Steele JE, Stevens FR, et al. Annually modelling built-settlements between remotely-sensed observations using relative changes in subnational populations and lights at night. Comput Environ Urban Syst. 2020;80:101444. pmid:32139952
- 82. Fick SE, Hijmans RJ. WorldClim 2: new 1-km spatial resolution climate surfaces for global land areas. Int J Climatol. 2017;37(12):4302–15.
- 83.
Gregory IN. An evaluation of the accuracy of the areal interpolation of data for the analysis of long-term change in England and Wales. In: GeoComputation [Internet]. Greenwich UK; 2000. Available from: www.geocomputation.org/2000/GC045/Gc045.htm.
- 84. Bozheva AM, Petrov AN, Sugumaran R. The effect of spatial resolution of remotely sensed data in dasymetric mapping of residential areas. GIScience Remote Sens. 2005;42(2):113–30.
- 85.
Oak Ridge National Laboratories (ORNL). LandScan documentation [Internet]. 2017 [cited 2021 Sep 29]. Available from: https://landscan.ornl.gov/about.
- 86.
CIESIN, UNFPA, WorldPop, Flowminder. Geo-Referenced Infrastructure and Demographic Data for Development (GRID3) [Internet]. 2018 [cited 2021 Sep 29]. Available from: www.grid3.org.
- 87.
European Commission Joint Research Centre. GHS-BUILT [Internet]. 2019 [cited 2021 Sep 29]. Available from: https://ghsl.jrc.ec.europa.eu/ghs_bu2019.php.
- 88. Corbane C, Sabo F, Politis P, Syrris V. HS-BUILT-S2 R2020A - GHS built-up grid, derived from Sentinel-2 global image composite for reference year 2018 using Convolutional Neural Networks (GHS-S2Net). European Commission, Joint Research Centre (JRC); 2020.
- 89.
Maxar. Satellite Imagery [Internet]. 2019 [cited 2021 Sep 29]. Available from: www.maxar.com/products/satellite-imagery.
- 90. Sinha P, Gaughan AE, Stevens FR, Nieves JJ, Sorichetta A, Tatem AJ. Assessing the spatial sensitivity of a random forest model: application in gridded population modeling. Comput Environ Urban Syst. 2019;75:132–45.
- 91.
Microsoft. Building Footprints [Internet]. AI for Humanitarian Action program. 2020 [cited 2021 Sep 29]. Available from: www.microsoft.com/en-us/maps/building-footprints.
- 92. Dooley CA, Leasure DR, Boo G, Tatem AJ. Gridded maps of building patterns throughout sub-Saharan Africa, version 2.0 [Internet]. WorldPop. 2021 [cited 2021 Sep 29]. Available from: https://wopr.worldpop.org/?/Buildings.
- 93. Selvin HC. Durkheim’s suicide and problems of empirical research. Am J Sociol. 1958;63(6):607–19.
- 94. Tuholske C, Gaughan AE, Sorichetta A, de Sherbinin A, Bucherie A, Hultquist C, et al. Implications for tracking SDG indicator metrics with gridded population data. Sustain. 2021;13(13).
- 95. Yin X, Li P, Feng Z, Yang Y, You Z, Xiao C. Which gridded population data product is better? Evidences from mainland southeast Asia (MSEA). ISPRS Int J Geo-Information. 2021;10(10).
- 96. Archila Bustos MF, Hall O, Niedomysl T, Ernstson U. A pixel level evaluation of five multitemporal global gridded population datasets: a case study in Sweden, 1990–2015. Popul Environ. 2020;42(2):255–77.
- 97. Thomson DR, Gaughan AE, Stevens FR, Yetman G, Elias P, Chen R. Evaluating the accuracy of gridded population estimates in slums: a case study in Nigeria and Kenya. Urban Sci. 2021;5(2):48.
- 98.
Slum/Shack Dwellers International (SDI). Know Your City [Internet]. 2016 [cited 2021 Sep 29]. Available from: https://sdinet.org/explore-our-data/.
- 99. Nuissl H, Heinrichs D. Slums: perspectives on the definition, the appraisal and the management of an urban phenomenon. J Geogr Soc Berlin. 2013;144(2):105–16.
- 100. Ezeh A, Oyebode O, Satterthwaite D, Chen Y, Ndugwa R, Sartori J, et al. The history, geography, and sociology of slums and the health problems of people who live in slums. Lancet. 2017;389:547–58. pmid:27760703
- 101. Mahabir R, Croitoru A, Crooks A, Agouris P, Stefanidis A. A critical review of high and very high-resolution remote sensing approaches for detecting and mapping slums: trends, challenges and emerging opportunities. Urban Sci. 2018;2:8.
- 102. Sturrock HJW, Woolheater K, Bennett AF, Andrade-Pacheco R, Midekisa A. Predicting residential structures from open source remotely enumerated data using machine learning. PLoS One. 2018;13(9):e0204399. pmid:30240429
- 103. Lloyd CT, Sturrock HJW, Leasure DR, Jochem WC, Lázár AN, Tatem AJ. Using GIS and machine learning to classify residential status of urban buildings in low and middle income settings. Remote Sens. 2020;12(23):3847.