skip to main content
10.1145/3308558.3313418acmotherconferencesArticle/Chapter ViewAbstractPublication PageswwwConference Proceedingsconference-collections
research-article

Learning Travel Time Distributions with Deep Generative Model

Published:13 May 2019Publication History

ABSTRACT

Travel time estimation of a given route with respect to real-time traffic condition is extremely useful for many applications like route planning. We argue that it is even more useful to estimate the travel time distribution, from which we can derive the expected travel time as well as the uncertainty. In this paper, we develop a deep generative model - DeepGTT - to learn the travel time distribution for any route by conditioning on the real-time traffic. DeepGTT interprets the generation of travel time using a three-layer hierarchical probabilistic model. In the first layer, we present two techniques, amortization and spatial smoothness embeddings, to share statistical strength among different road segments; a convolutional neural net based representation learning component is also proposed to capture the dynamically changing real-time traffic condition. In the middle layer, a nonlinear factorization model is developed to generate auxiliary random variable i.e., speed. The introduction of this middle layer separates the statical spatial features from the dynamically changing real-time traffic conditions, allowing us to incorporate the heterogeneous influencing factors into a single model. In the last layer, an attention mechanism based function is proposed to collectively generate the observed travel time. DeepGTT describes the generation process in a reasonable manner, and thus it not only produces more accurate results but also is more efficient. On a real-world large-scale data set, we show that DeepGTT produces substantially better results than state-of-the-art alternatives in two tasks: travel time estimation and route recovery from sparse trajectory data.

References

  1. Christophe Andrieu, Nando De Freitas, Arnaud Doucet, and Michael I Jordan. 2003. An introduction to MCMC for machine learning. Machine learning 50, 1-2 (2003), 5-43.Google ScholarGoogle Scholar
  2. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural Machine Translation by Jointly Learning to Align and Translate. CoRR abs/1409.0473(2014).Google ScholarGoogle Scholar
  3. Atilim Gunes Baydin, Barak A. Pearlmutter, Alexey Andreyevich Radul, and Jeffrey Mark Siskind. 2017. Automatic Differentiation in Machine Learning: a Survey. JMLR 18(2017), 153:1-153:43. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Christopher M Bishop. 2006. Pattern recognition and machine learning. springer. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. David M. Blei, Alp Kucukelbir, and Jon D. McAuliffe. 2016. Variational Inference: A Review for Statisticians. CoRR abs/1601.00670(2016).Google ScholarGoogle Scholar
  6. David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. JMLR 3(2003), 993-1022. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Yun Cheng, Xiucheng Li, Zhijun Li, Shouxu Jiang, and Xiaofan Jiang. 2014. Fine-Grained Air Quality Monitoring Based on Gaussian Process Regression. In ICONIP 2014. 126-134.Google ScholarGoogle Scholar
  8. Yun Cheng, Xiucheng Li, Zhijun Li, Shouxu Jiang, Yilong Li, Ji Jia, and Xiaofan Jiang. 2014. AirCloud: a cloud-based air-quality monitoring system for everyone. In Proceedings of the 12th ACM Conference on Embedded Network Sensor Systems, SenSys '14, Memphis, Tennessee, USA, November 3-6, 2014. 251-265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Peter Dayan, Geoffrey E Hinton, Radford M Neal, and Richard S Zemel. 1995. The helmholtz machine. Neural computation (1995), 889-904. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. S. M. Ali Eslami, Nicolas Heess, Theophane Weber, Yuval Tassa, David Szepesvari, Koray Kavukcuoglu, and Geoffrey E. Hinton. 2016. Attend, Infer, Repeat: Fast Scene Understanding with Generative Models. In NIPS 2016, December 5-10, 2016, Barcelona, Spain. 3225-3233. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Raghu K. Ganti, Mudhakar Srivatsa, and Tarek F. Abdelzaher. 2014. On Limits of Travel Time Predictions: Insights from a New York City Case Study. In ICDCS 2014, Madrid, Spain, June 30 - July 3, 2014. 166-175. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Andrew Gelman, John B Carlin, Hal S Stern, and Donald B Rubin. 1995. Bayesian data analysis. Chapman and Hall/CRC.Google ScholarGoogle Scholar
  13. Prem Gopalan, Jake M Hofman, and David M Blei. 2013. Scalable recommendation with poisson factorization. CORR (2013).Google ScholarGoogle Scholar
  14. Prem K Gopalan, Laurent Charlin, and David Blei. 2014. Content-based recommendations with poisson factorization. In NIPS 2014. 3176-3184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Matthew D Hoffman, David M Blei, Chong Wang, and John Paisley. 2013. Stochastic variational inference. JMLR 14, 1 (2013), 1303-1347. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Liangjie Hong, Amr Ahmed, Siva Gurumurthy, Alexander J. Smola, and Kostas Tsioutsiouliklis. 2012. Discovering geographical topics in the twitter stream. In WWW 2012, Lyon, France, April 16-20, 2012. 769-778. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Timothy Hunter, Aude Hofleitner, Jack Reilly, Walid Krichene, Jerome Thai, Anastasios Kouvelas, Pieter Abbeel, and Alexandre M. Bayen. 2013. Arriving on time: estimating travel time distributions on large-scale road networks. CoRR abs/1302.6617(2013).Google ScholarGoogle Scholar
  18. Tsuyoshi Ide´ and Masashi Sugiyama. 2011. Trajectory Regression on Road Networks. In AAAI 2011, San Francisco, California, USA, August 7-11, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Diederik P. Kingma and Jimmy Ba. 2014. Adam: A Method for Stochastic Optimization. ICLR 2015 abs/1412.6980(2014).Google ScholarGoogle Scholar
  20. Diederik P. Kingma, Shakir Mohamed, Danilo Jimenez Rezende, and Max Welling. 2014. Semi-supervised Learning with Deep Generative Models. In NIPS 2014, December 8-13 2014, Montreal, Quebec, Canada. 3581-3589. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Diederik P. Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. ICLR 2013 abs/1312.6114 (2013).Google ScholarGoogle Scholar
  22. Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter. 2017. Self-Normalizing Neural Networks. In NIPS 2017, 4-9 December 2017, Long Beach, CA, USA. 972-981. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Mu Li, Amr Ahmed, and Alexander J. Smola. 2015. Inferring Movement Trajectories from GPS Snippets. In WSDM 2015, Shanghai, China, February 2-6, 2015. 325-334. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Xiucheng Li, Kaiqi Zhao, Gao Cong, Christian S. Jensen, and Wei Wei. 2018. Deep Representation Learning for Trajectory Similarity Computation. In ICDE 2018, Paris, France, April 16-19, 2018. 617-628.Google ScholarGoogle Scholar
  25. Yaguang Li, Kun Fu, Zheng Wang, Cyrus Shahabi, Jieping Ye, and Yan Liu. 2018. Multi-task Representation Learning for Travel Time Estimation. In SIGKDD 2018, London, UK, August, 2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Dawen Liang, Rahul G. Krishnan, Matthew D. Hoffman, and Tony Jebara. 2018. Variational Autoencoders for Collaborative Filtering. In WWW 2018, Lyon, France, April 23-27, 2018. 689-698. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Kevin P Murphy. 2012. Machine learning: a probabilistic perspective. Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Paul Newson and John Krumm. 2009. Hidden Markov map matching through noise and sparseness. In SIGSPATIAL 2009, November 4-6, 2009, Seattle, Washington, USA, Proceedings. 336-343. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In SIGKDD 2014, New York, NY, USA - August 24 - 27, 2014. 701-710. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Ian Porteous, David Newman, Alexander Ihler, Arthur Asuncion, Padhraic Smyth, and Max Welling. 2008. Fast collapsed gibbs sampling for latent dirichlet allocation. In SIGKDD 2008. ACM, 569-577. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Sashank J Reddi, Satyen Kale, and Sanjiv Kumar. 2018. On the convergence of adam and beyond. ICLR 2018.Google ScholarGoogle Scholar
  32. Danilo Jimenez Rezende and Shakir Mohamed. 2015. Variational Inference with Normalizing Flows. In ICML 2015, Lille, France, 6-11 July 2015. 1530-1538. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. In ICML 2014, Beijing, China, 21-26 June 2014. 1278-1286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Dalia Tiesyte and Christian S. Jensen. 2008. Similarity-based prediction of travel times for vehicles traveling on known routes. In SIGSPATIAL 2008, November 5-7, 2008, Irvine, California, USA, Proceedings. 14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Aäron van den Oord, Oriol Vinyals, and Koray Kavukcuoglu. 2017. Neural Discrete Representation Learning. In NIPS 2017, 4-9 December 2017, Long Beach, CA, USA. 6309-6318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Dong Wang, Junbo Zhang, Wei Cao, Jian Li, and Yu Zheng. 2018. When Will You Arrive? Estimating Travel Time Based on Deep Neural Networks. In AAAI 2018, New Orleans, Louisiana, USA, February 2-7, 2018.Google ScholarGoogle Scholar
  37. Hongjian Wang, Yu-Hsuan Kuo, Daniel Kifer, and Zhenhui Li. 2016. A simple baseline for travel time estimation using large-scale trip data. In SIGSPATIAL 2016, Burlingame, California, USA, October 31 - November 3, 2016. 61:1-61:4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Yilun Wang, Yu Zheng, and Yexiang Xue. 2014. Travel time estimation of a path using sparse trajectories. In SIGKDD 2014, New York, NY, USA - August 24 - 27, 2014. 25-34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Zheng Wang, Kun Fu, and Jieping Ye. 2018. Learning to Estimate the Travel Time. In KDD 2018, London, UK, August 19-23, 2018. 858-866. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Hao Wu, Jiangyun Mao, Weiwei Sun, Baihua Zheng, Hanyuan Zhang, Ziyang Chen, and Wei Wang. 2016. Probabilistic Robust Route Recovery with Spatio-Temporal Dynamics. In SIGKDD 2016, San Francisco, CA, USA, August 13-17, 2016. 1915-1924. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Xinchen Yan, Jimei Yang, Kihyuk Sohn, and Honglak Lee. 2016. Attribute2image: Conditional image generation from visual attributes. In ECCV 2016. 776-791.Google ScholarGoogle ScholarCross RefCross Ref
  42. Di Yao, Gao Cong, Chao Zhang, and Jingping Bi. 2019. Computing Trajectory Similarity in Linear Time: A Generic Seed-Guided Neural Metric Learning Approach. In ICDE 2019, Macau, China, April 8-12, 2019.Google ScholarGoogle Scholar
  43. Zhijun Yin, Liangliang Cao, Jiawei Han, Chengxiang Zhai, and Thomas S. Huang. 2011. Geographical topic discovery and comparison. In WWW 2011, Hyderabad, India, March 28 - April 1, 2011. 247-256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Quan Yuan, Gao Cong, and Chin-Yew Lin. 2014. COM: a generative model for group recommendation. In KDD '14, New York, NY, USA - August 24 - 27, 2014. 163-172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat-Thalmann. 2013. Who, where, when and what: discover spatio-temporal topics for twitter users. In KDD 2013, Chicago, IL, USA, August 11-14, 2013. 605-613. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Jiangchuan Zheng and Lionel M. Ni. 2013. Time-Dependent Trajectory Regression on Road Networks via Multi-Task Learning. In AAAI 2013, July 14-18, 2013, Bellevue, Washington, USA. Google ScholarGoogle ScholarDigital LibraryDigital Library

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    WWW '19: The World Wide Web Conference
    May 2019
    3620 pages
    ISBN:9781450366748
    DOI:10.1145/3308558

    Copyright © 2019 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 13 May 2019

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article
    • Research
    • Refereed limited

    Acceptance Rates

    Overall Acceptance Rate1,899of8,196submissions,23%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format .

View HTML Format