Skip to main content

Privacy-Aware Data Gathering for Urban Analytics

  • Conference paper
  • First Online:
Book cover Information Management and Big Data (SIMBig 2017)

Abstract

Nowadays, there are a mature set of tools and techniques for data analytics, which help Data Scientists to extract knowledge from raw heterogeneous data. Nonetheless, there is still a lack of spatiotemporal historical dataset allowing to study everyday life phenomena, such as vehicular congestion, press influence, the effect of politicians comments on stock exchange markets, the relation between food prices evolution and temperatures or rainfall, social structure resilience against extreme climate events, among others. Unfortunately, few datasets are combining from different sources of urban data to carry out studies of phenomena occurring in cities (i.e., Urban Analytics). To solve this problem, we have implemented a Web crawler platform for gathering a different kind of available public datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Legislative Decree 1353: “Decreto legislativo que crea la autoridad nacional de transparencia y acceso a la información pública, fortalece el régimen de protección de datos personales y la regulación de la gestión de intereses”.

  2. 2.

    Sistema Nacional de Información Ambiental: sinia.minam.gob.pe/.

  3. 3.

    Weibo website: tw.weibo.com.

  4. 4.

    London city dashboard: citydashboard.org/london.

  5. 5.

    Scrapy: scrapy.org.

  6. 6.

    BITMAP Urban Analytics: bitmap.com.pe/urbands.html.

  7. 7.

    Indico API: https://indico.io/.

  8. 8.

    Source: https://indico.io/blog/sentimenthq-new-accuracy-standard/.

References

  1. Abbar, S., Zanouda, T., Borge-Holthoefer, J.: Robustness and resilience of cities around the world. arXiv preprint arXiv:1608.01709 (2016)

  2. Barlacchi, G., De Nadai, M., Larcher, R., Casella, A., Chitic, C., Torrisi, G., Antonelli, F., Vespignani, A., Pentland, A., Lepri, B.: A multi-source dataset of urban life in the city of milan and the province of trentino. Sci. Data 2, 150055 (2015)

    Article  Google Scholar 

  3. Di Clemente, R., Luengo-Oroz, M., Travizano, M., Vaitla, B., Gonzalez, M.C.: Sequence of purchases in credit card data reveal life styles in urban populations. arXiv preprint arXiv:1703.00409 (2017)

  4. Gambs, S., Killijian, M.O., del Prado Cortez, M.N.: De-anonymization attack on geolocated data. J. Comput. Syst. Sci. 80(8), 1597–1614 (2014)

    Article  MathSciNet  Google Scholar 

  5. Gray, S., O’Brien, O., Hügel, S.: Collecting and visualizing real-time urban data through city dashboards. Built Environ. 42(3), 498–509 (2016)

    Article  Google Scholar 

  6. Nunez-del Prado, M., Bravo, E., Sierra, M., Canchay, M., Hoyos, I.: Knowledge tier platform for graph mining in (smart) cities. In: Proceedings of Symposium on Information Management and Big Data (2016)

    Google Scholar 

  7. Panagiotou, N., et al.: Intelligent urban data monitoring for smart cities. In: Berendt, B., Bringmann, B., Fromont, É., Garriga, G., Miettinen, P., Tatti, N., Tresp, V. (eds.) ECML PKDD 2016. LNCS (LNAI), vol. 9853, pp. 177–192. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46131-1_23

    Chapter  Google Scholar 

  8. Rathore, M.M., Ahmad, A., Paul, A., Rho, S.: Urban planning and building smart cities based on the internet of things using big data analytics. Comput. Netw. 101, 63–80 (2016)

    Article  Google Scholar 

  9. Santos, H., Furtado, V., Pinheiro, P., McGuinness, D.L.: Contextual data collection for smart cities. arXiv preprint arXiv:1704.01802 (2017)

  10. Scrapy: Scrapy API. https://doc.scrapy.org/en/latest/topics/architecture.html

  11. Srivastava, A.K.: Segregated data of urban poor for inclusive urban planning in India: needs and challenges. SAGE Open 7(1), 2158244016689377 (2017)

    Article  Google Scholar 

  12. Xu, Z., Liu, Y., Yen, N., Mei, L., Luo, X., Wei, X., Hu, C.: Crowdsourcing based description of urban emergency events using social media big data. IEEE Trans. Cloud Comput. 99(PP), 1–10 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Miguel Nunez-del-Prado .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nunez-del-Prado, M., Esposito, B., Luna, A., Morzan, J. (2018). Privacy-Aware Data Gathering for Urban Analytics. In: Lossio-Ventura, J., Alatrista-Salas, H. (eds) Information Management and Big Data. SIMBig 2017. Communications in Computer and Information Science, vol 795. Springer, Cham. https://doi.org/10.1007/978-3-319-90596-9_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-90596-9_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-90595-2

  • Online ISBN: 978-3-319-90596-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics