Rutuja Gurav
Gautam Thakur
ABSTRACT
With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.
- Modified 2010. Terminology-POI WG Terminology Glossary. https://www.w3.org/2010/POI/wiki/Terminology.Google Scholar
- Renato Andrade, Ana Alves, and Carlos Bento. 2020. POI Mining for Land Use Classification: A Case Study. ISPRS International Journal of Geo-Information 9, 9 (2020), 493.Google ScholarCross Ref
- Guy De Tré, Daan Van Britsom, Tom Matthé, and Antoon Bronselaer. 2013. Automated cleansing of POI databases. In Quality issues in the management of web information. Springer, 55--91.Google Scholar
- William L Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Proceedings of the 31st International Conference on Neural Information Processing Systems. 1025--1035.Google Scholar
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.Google ScholarCross Ref
- Matthew Honnibal and Ines Montani. 2017. spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing. (2017). To appear.Google Scholar
- Yingjie Hu, Song Gao, Krzysztof Janowicz, Bailang Yu, Wenwen Li, and Sathya Prasad. 2015. Extracting and understanding urban areas of interest using geotagged photos. Computers, Environment and Urban Systems 54 (2015), 240--254.Google ScholarCross Ref
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).Google Scholar
- Chiao-Ling Kuo, Ta-Chien Chan, I Fan, Alexander Zipf, et al. 2018. Efficient method for POI/ROI discovery using Flickr geotagged photos. ISPRS International Journal of Geo-Information 7, 3 (2018), 121.Google ScholarCross Ref
- Shahin Sharifi Noorian, Achilleas Psyllidis, and Alessandro Bozzon. 2019. ST-Sem: A Multimodal Method for Points-of-Interest Classification Using Street-Level Imagery. In International Conference on Web Engineering. Springer, 32--46.Google Scholar
- Rachel Palumbo, Laura Thompson, and Gautam Thakur. 2019. SONET: a semantic ontological network graph for managing points of interest data heterogeneity. In ACM SIGSPATIAL International Workshop on Geospatial Humanities. 1--6.Google ScholarDigital Library
- Adam Rae, Vanessa Murdock, Adrian Popescu, and Hugues Bouchard. 2012. Mining the web for points of interest. In Proceedings of international ACM SIGIR conference on Research and development in information retrieval. 711--720.Google ScholarDigital Library
- Gautam Thakur, Kelly Sims, Chantelle Fortier, Joseph Bentley, Debraj De, Junchuan Fan, Tao Liu, Rachel Palumbo, Jesse McGaha, Phil Nugent, Bryan Eaton, Jordan Burdette, Tyler Sheldon, and Kevin Sparks. 2021. "Industrial Paper": Accelerated Assessment of Critical Infrastructure in Aiding Recovery Efforts During Natural and Human-made Disasters. In Proceedings of the 29th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2021).Google Scholar
- Minjie Wang, Da Zheng, Zihao Ye, Quan Gan, Mufei Li, and et. al. 2019. Deep Graph Library: A Graph-Centric, Highly-Performant Package for Graph Neural Networks. arXiv preprint arXiv:1909.01315 (2019).Google Scholar
- Zhecheng Wang, Haoyuan Li, and Ram Rajagopal. [n.d.]. Urban2Vec: Incorporating Street View Imagery and POIs for Multi-Modal Urban Neighborhood Embedding. In Proceedings of AAAI Conference on Artificial Intelligence, Vol. 34.Google Scholar
- Muhan Zhang and Yixin Chen. [n.d.]. Link prediction based on graph neural networks. Advances in Neural Information Processing Systems 31 ([n. d.]).Google Scholar
- Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba. 2017. Places: A 10 million Image Database for Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (2017).Google Scholar
- Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva. 2014. Learning deep features for scene recognition using places database. (2014).Google Scholar
- Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph
Recommendations
Improvement of spatial data quality using the data conflation
ICCSA'11: Proceedings of the 2011 international conference on Computational science and its applications - Volume Part IAfter the introduction of digital mapping techniques in the 1960s and then GIS shortly afterwards, researchers realized that error and uncertainty in digital spatial data had the potential to cause problems that had not been experienced with paper maps [...
Geometrical DCC-Algorithm for merging polygonal geospatial data
ICCSA'10: Proceedings of the 2010 international conference on Computational Science and Its Applications - Volume Part IGeospatial data integration technology involves fusing equivalent objects from multiple datasets. Due to different acquisition methods of geospatial data, new problem cases arise in data integration systems and thus the complexity of the integration ...
Comments