Yikai Gong
ABSTRACT
Transport congestion is an increasing problem especially for larger cities. Typically traffic conditions are monitored in Australia by state and/or federal authorities using expensive electronic devices/sensors on roads or through CCTV cameras. However there is an alternative and far cheaper way to monitor real-time traffic status on roads: through targeted social media analytics. Social networking sites such as Twitter are hugely popular, public and often real-time in nature. A growing number of people post tweets about their lives and feelings every day and everywhere, often with location-based service information included. In this paper, we present an architecture and novel harvesting and analytics approach that exploits this information to identify near real-time transport congestion. Specifically, we present an algorithm for targeted harvesting of tweets solely on the road network using the definitive road network data for Australia. We then implement spatial-temporal clustering algorithms to identify spatio-temporal clusters of tweets on roads to identify potential traffic congestion. We show the scalability of the solution through the use of the large-scale Cloud facilities offered through the National eResearch Collaboration Tools and Resources (NeCTAR -- www.nectar.org.au) Research Cloud.
- Twitter, Inc., "Company | About," 2015. {Online}. Available: https://about.twitter.com/company. {Accessed 1 June 2015}.Google Scholar
- R. Feldman, "Techniques and applications for sentiment analysis," Communications of the ACM, vol. 56, no. 4, pp. 82--89, 2013. Google ScholarDigital Library
- E. Kouloumpis, T. Wilson and J. Moore, "Twitter sentiment analysis: The good the bad and the omg!," Icwsm, vol. 11, pp. 538--541, 2011.Google Scholar
- D. Morley and others, Media, modernity and technology: The geography of the new, Routledge, 2006.Google ScholarCross Ref
- D. Sui and M. Goodchild, "The convergence of GIS and social media: challenges for GIScience," International Journal of Geographical Information Science, vol. 25, no. 11, pp. 1737--1748, 2011.Google ScholarCross Ref
- J. Manyika, M. Chui, B. Brown, J. Bughin, R. Dobbs, C. Roxburgh and A. H. Byers, "Big data: The next frontier for innovation, competition, and productivity," 2011.Google Scholar
- K. M. Tolle, D. S. W. Tansley and A. J. Hey, "The fourth paradigm: Data-intensive scientific discovery {point of view}," Proceedings of the IEEE, vol. 99, no. 8, pp. 1334--1337, 2011.Google ScholarCross Ref
- A. Kaur and V. Gupta, "A survey on sentiment analysis and opinion mining techniques," Journal of Emerging Technologies in Web Intelligence, vol. 5, no. 4, pp. 367--371, 2013.Google ScholarCross Ref
- A. Oghina, M. Breuss, M. Tsagkias and M. de Rijke, "Predicting imdb movie ratings using social media," in Advances in information retrieval, Springer, 2012, pp. 503--507. Google ScholarDigital Library
- S. Muralidharan, L. Rasmussen, D. Patterson and J.-H. Shin, "Hope for Haiti: An analysis of Facebook and Twitter usage during the earthquake relief efforts," Public Relations Review, vol. 37, no. 2, pp. 175--177, 2011.Google ScholarCross Ref
- A. Bruns and Y. E. Liang, "Tools and methods for capturing Twitter data during natural disasters," First Monday, vol. 17, no. 4, 2012.Google Scholar
- M. Conover, J. Ratkiewicz, M. Francisco, B. Gonalves, F. Menczer and A. Flammini, "Political Polarization on Twitter.," in ICWSM, 2011.Google Scholar
- S. Zhao, L. Zhong, J. Wickramasuriya and V. Vasudevan, "Human as real-time sensors of social and physical events: A case study of twitter and sports games," arXiv preprint arXiv:1106.4300, 2011.Google Scholar
- A. Signorini, A. M. Segre and P. M. Polgreen, "The use of Twitter to track levels of disease activity and public concern in the US during the influenza A H1N1 pandemic," PloS one, vol. 6, no. 5, p. e19467, 2011.Google ScholarCross Ref
- M. S. Gerber, "Predicting crime using Twitter and kernel density estimation," Decision Support Systems, vol. 61, pp. 115--125, 2014.Google ScholarCross Ref
- K. Yanai and Y. Kawano, "Twitter Food Photo Mining and Analysis for One Hundred Kinds of Foods," in Advances in Multimedia Information Processing - PCM 2014, Springer, 2014, pp. 22--32. Google ScholarDigital Library
- M. Mathioudakis and N. Koudas, "Twittermonitor: trend detection over the twitter stream," in Proceedings of the 2010 ACM SIGMOD International Conference on Management of data, 2010. Google ScholarDigital Library
- M. Cha, H. Haddadi, F. Benevenuto and P. K. Gummadi, "Measuring User Influence in Twitter: The Million Follower Fallacy." ICWSM, vol. 10, no. 10--17, p. 30, 2010.Google Scholar
- S. Chandra, L. Khan and F. B. Muhaya, "Estimating twitter user location using social interactions--a content based approach," in Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third Inernational Conference on Social Computing (SocialCom), 2011 IEEE Third International Conference on, 2011.Google Scholar
- R. Kosala, E. Adi and others, "Harvesting real time traffic information from Twitter," Procedia Engineering, vol. 50, pp. 1--11, 2012.Google ScholarCross Ref
- N. Wanichayapong, W. Pruthipunyaskul, W. Pattara-Atikom and P. Chaovalit, "Social-based traffic information extraction and classification," in ITS Telecommunications (ITST), 2011 11th International Conference on, 2011.Google Scholar
- A. Ishino, S. Odawara, H. Nanba and T. Takezawa, "Extracting transportation information and traffic problems from tweets during a disaster," Proc. IMMM, pp. 91--96, 2012.Google Scholar
- P. Lowrie, "Scats, sydney co-ordinated adaptive traffic system: A traffic responsive method of controlling urban traffic," 1990.Google Scholar
- S. Clement and J. Anderson, "Traffic signal timing determination: the Cabal model," 1997.Google Scholar
- E. Mazloumi, G. Rose, G. Currie and S. Moridpour, "Prediction intervals to account for uncertainties in neural network predictions: Methodology and application in bus travel time prediction," Engineering Applications of Artificial Intelligence, vol. 24, no. 3, pp. 534--542, 2011. Google ScholarDigital Library
- M. Hall and L. WILLUMSEN, "SATURN-a simulation-assignment model for the evaluation of traffic management schemes," Traffic Engineering & Control, vol. 21, no. 4, 1980.Google Scholar
- D. Yin and T. Z. Qiu, "Compatibility analysis of macroscopic and microscopic traffic simulation modeling," Canadian Journal of Civil Engineering, vol. 40, no. 7, pp. 613--622, 2013.Google ScholarCross Ref
- J. Monteil, A. Nantes, R. Billot, J. Sau and others, "Microscopic cooperative traffic flow: calibration and simulation based on a next generation simulation dataset," IET Intelligent Transport Systems, vol. 8, no. 6, pp. 519--525, 2014.Google ScholarCross Ref
- J. Brugmann, M. Schreckenberg and W. Luther, "A verifiable simulation model for real-world microscopic traffic simulations," Simulation Modelling Practice and Theory, vol. 48, pp. 58--92, 2014.Google ScholarCross Ref
- "Haversine formula," 2015. {Online}. Available: http://en.wikipedia.org/wiki/Haversine_formula.Google Scholar
- S. Kisilevich, F. Mansmann, M. Nanni and S. Rinzivillo, "Spatio-Temporal Clustering," in Data Mining and Knowledge Discovery Handbook, Springer US, 2010, pp. 855--874.Google Scholar
- M. Ester, H.-P. Kriegel, J. Sander and X. Xu, "A density-based algorithm for discovering clusters in large spatial databases with noise," in Kdd, 1996.Google Scholar
- "DBSCAN," 2015. {Online}. Available: http://en.wikipedia.org/wiki/DBSCAN. {Accessed 30 May 2015}.Google Scholar
- J. C. Anderson, J. Lehnardt and N. Slater, CouchDB: The Definitive Guide Time to Relax, 1st ed., O'Reilly Media, Inc., 2010. Google ScholarDigital Library
- J. Dean and S. Ghemawat, "MapReduce: simplified data processing on large clusters," Communications of the ACM - 50th anniversary issue: 1958 - 2008, vol. 51, no. 1, pp. 107--113, 1 January 2008. Google ScholarDigital Library
Index Terms
- Identification of (near) Real-time Traffic Congestion in the Cities of Australia through Twitter
Recommendations
Twitter Informatics: Tracking and Understanding Public Reaction during the 2009 Swine Flu Pandemic
WI-IAT '11: Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01Much attention has been focused on Twitter because it serves as a central hub for the publishing, dissemination, and discovery of online media. This is true for both traditional news outlets and user generated content, both of which can vary widely in ...
Celebrity's self-disclosure on Twitter and parasocial relationships
This study investigated how celebrities' self-disclosure on personal social media accounts, particularly Twitter, affects fans' perceptions. An online survey was utilized among a sample of 429 celebrity followers on Twitter. Results demonstrated that ...
Information resonance on Twitter: watching Iran
SOMA '10: Proceedings of the First Workshop on Social Media AnalyticsTwitter has undoubtedly caught the attention of both the general public, and academia as a microblogging service worthy of study and attention. Twitter has several features that sets it apart from other social media/networking sites, including its 140 ...
Comments