Abstract
Sustainable Development Goals (SDG) and its measurement is a key policy focus across the globe. Despite existence of several indices and reporting agencies, it is a challenging task to identify progress, specifically in the case of developing economies. These economies are predominantly in Asia and Africa and have a great bearing on global performance. These countries have diverse geographical and cultural elements with an active sub-national institutional framework. Data gap coupled with poor data quality and limited financial support does not help their case. Without appropriate indicator selection and index measurement it is not possible to judge the actual current situation or compare the SDG situation around the world. This paper attempts a practical and simpler approach to overcome the constraints, provide direction and facilitate measurement of SDG position in such countries using the case of India. This is done by identifying gaps, suggesting a tailored approach to indicator selection and measurement and further, developing a suitable index for SDG measurement at the sub-national level. The results and findings should be of great interest for policy making and implementing agencies.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
The details about the 17 SDGs can be referred to at: https://www.undp.org/content/undp/en/home/sustainable-development-goals.html.
The VNR database and official country VNR reports can be accessed at https://sustainabledevelopment.un.org/vnrs/.
Union Territories (UTs) are administrative divisions in India, which like states, do not have their own elected governments and are in the direct control of the central government.
The states included in this study are: Andhra Pradesh (AP), Assam (AS), Bihar (BR), Chhattisgarh (CT), Delhi (DL), Gujarat (GJ), Haryana (HY), Himachal Pradesh (HP), Jammu and Kashmir (J&K), Jharkhand (JH), Karnataka (KA), Kerala, Madhya Pradesh (MP), Maharashtra (MH), Odisha (OD), Punjab (PB), Rajasthan (RJ), Tamil Nadu (TN), Telangana (TL), Uttar Pradesh (UP), Uttarakhand (UK), West Bengal (WB).
References
AEEE (Alliance for an Energy Efficient Economy). (2018). State Energy Efficiency Preparedness Index. New Delhi. Retrieved December 14, 2018, from https://www.aeee.in/wp-content/uploads/2018/09/State-EE-Preparedness-Index-FINAL_July2018.pdf.
Alkire, S., Friedman, M., Aguilar, G. R., Valenti, S., Santos, M. E., Gaye, A., & Scott, T. (2015). Training Material for Producing National Human Development Reports. UNDP Occasional Paper. Retrieved December 12, 2018, from http://hdr.undp.org/sites/default/files/hdi_training.pdf.
Allen, C., Metternicht, G., & Wiedmann, T. (2018). Initial progress in implementing the Sustainable Development Goals (SDGs): a review of evidence from countries. Sustainability Science,13(5), 1453–1467. https://doi.org/10.1007/s11625-018-0572-3.
Annoni, P., & Brüggemann, R. (2009). Exploring partial order of European countries. Social Indicators Research,92(3), 471.
Arcagni, A., di Belgiojoso, E. B., Fattore, M., & Rimoldi, S. M. (2019). Multidimensional analysis of deprivation and fragility patterns of migrants in Lombardy, using partially ordered sets and self-organizing maps. Social Indicators Research,141(2), 551–579.
Barbier, E. (2011). The policy challenges for green economy and sustainable economic development: The policy challenges for green economy and sustainable economic development. Natural Resources Forum,35(3), 233–245. https://doi.org/10.1111/j.1477-8947.2011.01397.x.
Basu, A., Hickok, E., Mohandas, S., Kundu, A., Sinha, A., Pranav, M. B., et al. (2018). Artificial Intelligence in the Governance Sector in India. Bengaluru: Centre for Internet and Society.
Becker, W., Saisana, M., Paruolo, P., & Vandecasteele, I. (2017). Weights and importance in composite indicators: Closing the gap. Ecological Indicators,80, 12–22.
Beycan, T., Vani, B. P., Bruggemann, R., & Suter, C. (2019). Ranking Karnataka districts by the Poverty Index (MPI) and by applying simple elements of partial order theory. Social Indicators Research, 143(1), 173–200.
Boccuzzo, G., & Caperna, G. (2017). Evaluation of life satisfaction in Italy: Proposal of a synthetic measure based on poset theory. In F. Maggino (Ed.), Complexity in society: From indicators construction to their synthesis (Vol. 70, pp. 291–321). Cham: Springer.
Booysen, F. (2002). An overview and evaluation of composite indices of development. Social Indicators Research,39, 115–151. https://doi.org/10.1023/A:1016275505152.
Boza, M. E., Tomas, F., Rijo, R., & Cáceres, M. (2017). SDG Dashboards. UNDP. Retrieved July 14, 2018, from https://www.undp.org/content/dam/rbap/docs/meetTheSDGs/SDGDashboardsUNDP-SIGOB.pdf.
Campagnolo, L., Carraro, C., Eboli, F., Farnia, L., Parrado, R., & Pierfederici, R. (2017). The ex-ante evaluation of achieving sustainable development goals. Social Indicators Research,136(1), 73–116. https://doi.org/10.1007/s11205-017-1572-x.
Campagnolo, L., Eboli, F., Farnia, L., & Carraro, C. (2018). Supporting the UN SDGs transition: Methodology for sustainability assessment and current worldwide ranking. Economics,12, 1–31. https://doi.org/10.5018/economics-ejournal.ja.2018-10.
Carlsen, L., & Brüggemann, R. (2014). Indicator analyses: what is important—And for what? In R. Brüggemann, L. Carlsen, & J. Wittmann (Eds.), Multi-indicator systems and modelling in partial order (pp. 359–387). New York: Springer.
CEPEI. (2016). Report on the Colombia multi-stakeholder workshop on data for sustainable development goals roadmap. Bogota: International Strategic Thinking Centre.
Chandrasekharan, I., Sendhil Kumar, R., Seena Raghunathan, R., & Chandrasekaran, S. (2013). Construction of environmental performance index and ranking of states. Current Science,104(4), 435–439.
Costanza, R., Daly, L., Fioramonti, L., Giovannini, E., Kubiszewski, I., Mortensen, L. F., et al. (2016). Modelling and measuring sustainable wellbeing in connection with the UN sustainable development goals. Ecological Economics,130, 350–355. https://doi.org/10.1016/j.ecolecon.2016.07.009.
CPCB (Central Pollution Control Board). (2013). Guidelines for the measurement of ambient air pollutants (Vol. I) (No. NAAQMS/36/2012-13). Ministry of Environment and Forest. Government of India.
DCS (Department of Census and Statistics). (2017). Status of Sustainable Development Goals in Sri Lanka: 2017. Ministry of National Policies and Economic Affairs, Sri Lanka. Retrieved July 8, 2018, from http://www.statistics.gov.lk/sdg/application/publications/book.pdf.
Eckersley, R. (2018). Letter to the editor: Are indicators telling us the real story about progress? Social Indicators Research,141(2), 919–929. https://doi.org/10.1007/s11205-018-1843-1.
Edenhofer, O., Ramón, P.-M., Sokona, Y., Farahani, E., Kadner, S., Seyboth, K., & Brunner, S. (2014). Summary for policymakers: climate change. Retrieved August 27, 2018, from https://www.ipcc.ch/site/assets/uploads/2018/02/ipcc_wg3_ar5_summary-for-policymakers.pdf.
Espey, J., Swanson, E., Badiee, S., Christensen, Z., Fischer, A., Levy, M., et al. (2015). Data for development: A needs assessment for SDG monitoring and statistical capacity development. New York: Sustainable Solutions Development Network.
Fattore, M., & Arcagni, A. (2018). A reduced posetic approach to the measurement of multidimensional ordinal deprivation. Social Indicators Research,136(3), 1053–1070.
Fukuda-parr, S. (2016). From the Millennium development goals to the sustainable development goals: Shifts in purpose, concept, and politics of global goal setting for development. Gender and Development. https://doi.org/10.1080/13552074.2016.1145895.
GED (General Economics Division). (2017). Data Gap Analysis for Sustainable Development Goals (SDGs) Bangladesh Perspective. Planning Commission, Bangladesh. Retrieved April 23, 2018, from http://bbs.portal.gov.bd/sites/default/files/files/bbs.portal.gov.bd/page/3acbc97e_6ba3_467b_bdb2_cfb3cbbf059f/Final_Data-Gap-Analysis-of-SDGs_Bangladesh-Perspective_23_02_2017.pdf.
Greco, S., Ishizaka, A., Tasiou, M., & Torrisi, G. (2019). On the methodological framework of composite indices: A review of the issues of weighting, aggregation, and robustness. Social Indicators Research,141(1), 61–94. https://doi.org/10.1007/s11205-017-1832-9.
Happaerts, S., van Den Brande, K., & Bruyninckx, H. (2010). Governance for sustainable development at the inter-subnational level: The case of the network of regional governments for sustainable development (nrg4SD). Regional and Federal Studies,20(1), 127–149. https://doi.org/10.1080/13597560903187362.
Hauff, M. V., Chandran, D., & Saraswati, L. R. (2013). Challenges for the National Sustainability Strategy of India. South Asia-Chronicle (Vol. 44(1–2), pp. 133–155). https://doi.org/10.1093/cdj/bsp019.
IIPS. (2017). National Family Health Survey (NFHS-4) 2015-16 India. Mumbai: International Institute for Population Sciences.
Jain, G., Revi, A., Koduganti, J., & Abbas, A. (2018). Localising SDGs for India. Indian Institute of Human Settlements, Bengaluru. https://doi.org/10.24943/sdgsindia.2018
Kapoor, A., Kapoor, M., & Krylova, P. (2017). Social Progress Index: States of India 2005-2016, Methodology Report. Institute for Competitiveness, Gurgaon. Retrieved September 19, 2018, from https://socialprogress.in/wp-content/uploads/2017/10/SPI_2017_Methodology.pdf.
Khalid, A. M., Sharma, S., & Dubey, A. K. (2018). Developing an indicator set for measuring sustainable development in India. Natural Resources Forum,42(3), 185–200. https://doi.org/10.1111/1477-8947.12151.
Kharas, H., Mcarthur, J. W., & Rasmussen, K. (2018). How many people will the world leave behind? Assessing current trajectories on the Sustainable Development Goals (No. 123). Global Economy and Development. The Brookings Research Institute. Retrieved December 6, 2018, from https://www.brookings.edu/wp-content/uploads/2018/09/HowManyLeftBehind.pdf.
KKHSOU (Krishna Kanta Handiqui State Open University). (2011). Introduction to Nature of Indian Federalism: Division of Power Between The Union and The States. Retrieved December 12, 2018, from http://kkhsou.in/main/polscience/indian_federalism.html.
Krajnc, D., & Glavič, P. (2005). A model for integrated assessment of sustainable development. Resources, Conservation and Recycling,43(2), 189–208.
Kumar, S., Kumar, N., & Vivekadhish, S. (2016). 2016 Kumar MDG to SDG.pdf. Indian Journal of Community Medicine (Vol. 41(1), pp. 1–4). Retrieved December 17, 2018 from https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4746946/
Lafortune, G., Fuller, G., Moreno, J., Schmidt-Traub, G., & Kroll, C. (2018). SDG Index and Dashboards Detailed Methodological paper. Retrieved January 6, 2019, from https://raw.githubusercontent.com/sdsna/2018GlobalIndex/master/2018GlobalIndexMethodology.pdf.
Leal Filho, W., Tripathi, S. K., Andrade Guerra, J. B. S. O. D., Giné-Garriga, R., Orlovic Lovren, V., & Willats, J. (2018). Using the sustainable development goals towards a better understanding of sustainability challenges. International Journal of Sustainable Development and World Ecology,26(2), 179–190. https://doi.org/10.1080/13504509.2018.1505674.
Lu, Y., Nakicenovic, N., Visbeck, M., & Stevance, A.-S. (2015). Five priorities for the UN sustainable development goals. Nature,520, 432–433. https://doi.org/10.1038/520432a.
Marks, G., Hooghe, L., & Schakel, A. H. (2008). Measuring regional authority. Regional and Federal Studies,18(2–3), 111–121. https://doi.org/10.1080/13597560801979464.
McArthur, J. W. (2013). Own the Goals: What the Millennium Development Goals Have Accomplished. Foreign Affairs,92(2), 152–162.
Moldan, B., Janoušková, S., & Hák, T. (2012). How to understand and measure environmental sustainability: Indicators and targets. Ecological Indicators,17, 4–13. https://doi.org/10.1016/j.ecolind.2011.04.033.
MoSPI (Ministry of Statistics and Programme Implementation). (2018). EnviStats India 2018: Supplement on Environmental Accounts. Government of India. Retrieved December 15, 2018, from http://www.mospi.gov.in/sites/default/files/reports_and_publication/statistical_publication/EnviStats/EnviStats_India_27sep18.pdf.
Mulholland, E., Dimitrova, A., & Hametner, M. (2018). SDG Indicators and Monitoring: Systems and Processes at the Global, European, and National Level. In ESDN Quarterly Report. Retrieved February 16, 2019, from https://www.sd-network.eu/quarterlyreports/reportfiles/pdf/2018-April-SDG_Indicators_and_Monitoring.pdf.
Mundle, S., Chowdhury, S., & Sikdar, S. (2016). Governance Performance of Indian States (No. 164). National Institute of Public Finance and Policy, New Delhi.
Nardo, M., Saisana, M., Saltelli, A., Tarantola, S., Hoffman, A., & Giovannini, E. (2005). Handbook on Constructing Composite Indicators: Methodology and User Guide (No. STD/DOC(2005)3). https://doi.org/10.1787/9789264043466-en.
NCRB (National Crime Records Bureau). (2016). Crime in India 2016 Statistics. Ministry of Home Affairs. Government of India. Retrieved November 14, 2018, from http://ncrb.gov.in/StatPublications/CII/CII2016/pdfs/NEWPDFs/Crime in India - 2016 Complete PDF 291117.pdf.
NIHFW (National Institute of Health and Family Welfare). (2014). The Story of India’s Population. New Delhi. Retrieved August 29, 2017, from http://www.nihfw.org/Doc/Policy_unit/The_Story_ofour_Popualtion-Fertility_trends_and_levels_of_achievement(2013).pdf.
Nilsson, M., Griggs, D., & Visbeck, M. (2016). Map the interactions between sustainable development goals. Nature,534(7607), 320–332. https://doi.org/10.1038/534320a.
NITI (National Institution for Transforming India). (2018). SDG India Index: Baseline Report 2018. Retrieved December 23, 2018, from http://niti.gov.in/writereaddata/files/SDX_Index_India_21.12.2018.pdf.
NITI Aayog. (2017). Voluntary National Review Report. Retrieved March 26, 2018, from http://niti.gov.in/writereaddata/files/Final_VNR_report.pdf.
OECD (Organisation for Economic Co-operation and Development). (2008). Handbook on constructing composite indicators: methodology and user guide. Paris: OECD Publishing.
OECD (Organisation for Economic Co-operation and Development). (2012). Benchmarking performance and measuring progress. Directorate for Financial and Enterprise Affairs. Retrieved September 9, 2018, from http://www.oecd.org/investment/toolkit/measuringprogress/41435024.pdf.
OECD (Organisation for Economic Co-operation and Development). (2017). Measuring distance to the SDG targets 2017. Paris. https://doi.org/10.1787/9789264308183-en.
Osborn, D., Cutter, A., & Ullah, F. (2015). Universal Sustainable Development Goals: Understanding the transformational challenge for developed countries. In Stakeholder Forum. http://www.who.int/mediacentre/factsheets/fs310/en/index2.htm
Papadimitriou, E., Neves, A. R., & Becker, W. (2019). JRC statistical audit of the sustainable development goals index and dashboards. EUR 29776 EN, 2019, ISBN 978-92-76-08995-7. https://doi.org/10.2760/723763, JRC116857.
Parris, T. M., & Kates, R. W. (2003). Characterizing and measuring sustainable development. Annual Review of Environment and Resources,28(1), 559–586. https://doi.org/10.1146/annurev.energy.28.050302.105551.
Paul, Y., Hickok, E., Sinha, A., Tiwari, U., Mohandas, S., Ray, S., et al. (2018). Artificial intelligence in the healthcare industry in India. Bengaluru: Centre for Internet and Society.
Pink, B., Taylor, S., & Wetzler, H. (2014). Part two: Measuring real income and wellbeing. In A. Podger & D. Trewin (Eds.), Measuring and promoting wellbeing: How important is economic growth? (pp. 163–190). Canberra: ANU E Press.
Pintér, L., Hardi, P., & Bartelmus, P. (2005). Sustainable development indicators: Proposals for the way forward. In International Institute for Sustainable Development Discussion Paper prepared for the UN. Retrieved May 22, 2017, from https://www.iisd.org/pdf/2005/measure_indicators_sd_way_forward.pdf.
Pollesch, N. L., & Dale, V. H. (2016). Normalization in sustainability assessment: Methods and implications. Ecological Economics,130, 195–208.
RGI (Registrar General and Census Commissioner of India). (2006). Population Projections for India and States 2001-2026. Government of India. Retrieved July 17, 2018, from https://nrhm-mis.nic.in/Part B Demographic and Vital Indicators/Population Projection Report 2006 by RGI.pdf.
Rickels, W., Dovern, J., Hoffmann, J., Quaas, M. F., Schmidt, J. O., & Visbeck, M. (2016). Indicators for monitoring sustainable development goals: An application to oceanic development in the European Union. Earth’s Future,4(September), 252–267. https://doi.org/10.1002/2016EF000353.Abstract.
Rodriguez, F., & Schonrock, P. (2018). Data Reconciliation: Process, Standards, and Lessons. Bogota: International Strategic Thinking Centre.
Sachs, J. D., Schmidt-Traub, G., Kroll, C., Lafortune, G., & Fuller, G. (2018). SDG Index and Dashboards Report 2018. New York: Bertelsmann Stiftung and Sustainable Development Solutions Network (SDSN).
Saikia, N., & Kulkarni, P. M. (2017). An Assessment of India’s Readiness for Tracking SDG Targets on Health and Nutrition. In ORF Occasional Paper (No. 108). Retrieved June 13, 2018, from https://www.orfonline.org/wp-content/uploads/2017/02/ORF_OccasionalPaper_108.pdf.
Santos, M. E., & Santos, G. (2014). Composite indices of development. Oxford: Oxford University Press.
Singh, R. K., Murty, H. R., Gupta, S. K., & Dikshit, A. K. (2009). An overview of sustainability assessment methodologies. Ecological Indicators,15(1), 281–299. https://doi.org/10.1016/j.ecolind.2011.01.007.
Smeets, E., & Weterings, R. (1999). Environmental indicators: Typology and overview. Copenhagen: European Environment Agency.
Stanton, E. A., & Ackerman, F. (2009). Climate and development economics: Balancing science, politics and equity. Natural Resources Forum,33(4), 262–273. https://doi.org/10.1111/j.1477-8947.2009.01251.x.
Sterck, M. (2006). Performance measurement for sub-national service delivery. Public Management Institute. Catholic University Leuven, Belgium. Retrieved October 4, 2018, from http://steunpuntbov.be/rapport/s0405012_perf_meas_subnat_service_delivery.pdf.
Suryanarayana, M. H., Agrawal, A., & Prabhu, K. S. (2011). Inequality-adjusted Human Development Index for India’s States. UNDP India.
Szeker, M., & Heisig, A.-M. (2018). Voluntary National Reviews submitted to the 2018 High-level Political Forum – a Comparative Analysis. Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH, Bonn.
Talukder, B., Hipel, K. W., & vanLoon, G. W. (2017). Developing composite indicators for agricultural sustainability assessment: Effect of normalization and aggregation techniques. Resources,6(4), 66.
Tan, K. G., & Rao, K. (2015). Sub-national competitiveness analysis and simulation studies for 35 states and union territories of India. International Journal of Indian Culture and Business Management,10(4), 476–493. https://doi.org/10.1504/IJICBM.2015.069648.
Tollefson, J., & Gilbert, N. (2012). Nature-2012-Rio report card.pdf. Nature,486(7401), 6–9. https://doi.org/10.1038/486020a.
UCLG (United Cities and Local Governments). (2018). Towards the localization of the SDGs. Barcelona. Retrieved February 8, 2019, from https://www.uclg.org/sites/default/files/towards_the_localization_of_the_sdgs.pdf.
UN (United Nations). (2010). The Millennium Development Goals Report 2010. New York: United Nations Publications.
UN (United Nations). (2018). The Sustainable Development Goals Report 2018. https://doi.org/10.29171/azu_acku_pamphlet_k3240_s878_2016
UNECA (United Nations Economic Commission for Africa). (2017). Africa Sustainable Development Report 2017. https://doi.org/10.18356/3cff8bc0-en
UNESCAP (United Nations Economic and Social Commission for Asia and the Pacific). (2017). Measuring SDG progress in Asia and the Pacific: Is there enough data? Statistical Yearbook for Asia and the Pacific 2017 (ST/ESCAP/2825).
UNSTATS. (United Nations Statistics Division) (2018). Tier Classification for Global SDG Indicators. Retrieved February 22, 2019, from United Nation https://unstats.un.org/sdgs/files/Tier Classification of SDG Indicators_31 December 2018_web.pdf.
Van de Kerk, G., & Manuel, A. R. (2008). A comprehensive index for a sustainable society: The SSI - the Sustainable Society Index. Ecological Economics,66(2–3), 228–242. https://doi.org/10.1016/j.ecolecon.2008.01.029.
Weitz, N., Carlsen, H., Nilsson, M., & Skånberg, K. (2018). Towards systemic and contextual priority setting for implementing the 2030 agenda. Sustainability Science,13(2), 531–548. https://doi.org/10.1007/s11625-017-0470-0.
WHO (World Health Organization). (2006). Air quality guidelines: Global update 2005. Copenhagen: WHO Regional Office.
WHO (World Health Organization). (2017). Global Nutrition Monitoring Framework: Targets for 2025. Geneva. Licence: CC BY-NC-SA 3.0 IGO.
Wilde, A., Narang, S., Laberge, M., & Moretto, L. (2009). A Users’ Guide to Measuring Local Governance. Oslo: UNDP Oslo Governance Centre.
Wong, J., & Wang, T. (2018). Frontier technologies for sustainable development in Asia and the Pacific. United Nations Economic Commission for Asia and the Pacific. Retrieved February 27, 2019, from https://www.unescap.org/sites/default/files/publications/Frontier tech for SDG.pdf.
Yu, S. H. (2019). Benchmarking and performance evaluation towards the sustainable development of regions in Taiwan: A minimum distance-based measure with undesirable outputs in additive DEA. Social Indicators Research. https://doi.org/10.1007/s11205-019-02087-y.
Acknowledgements
We thank Professor Tara Chandra Kandpal, Dhwani Gambhir and Sapan Thapar for valuable comments at different stages of this research. We wish to also acknowledge Pankaj Singh Rawat for his assistance in formatting of this paper.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khalid, A.M., Sharma, S. & Dubey, A.K. Data Gap Analysis, Indicator Selection and Index Development: A Case for Developing Economies. Soc Indic Res 148, 893–960 (2020). https://doi.org/10.1007/s11205-019-02225-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-019-02225-6