Skip to main content
SpringerLink
Log in

Vehicular Ad Hoc Network Mobility Models Applied for Reinforcement Learning Routing Algorithm

  • Conference paper
Contemporary Computing (IC3 2010)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 95))

Included in the following conference series:

Abstract

Vehicular ad-hoc networks (VANET) are specialized applications of mobile ad-hoc network. To analyze the complex and dynamic topologies of these scalable applications a simulation based analysis plays a vital role in realizing the effective deployment of vehicles in realistic scenarios and its corresponding effect on routing protocols. Mobility models mimic the movement of vehicles and we consider Manhattan, City section and INVENT mobility models for our analysis. We measure the performances of these mobility models with suitable mobility metrics and try to correlate its corresponding impact on the performances of routing protocols. Routing protocols play a central role in the design of these types of networks. To meet the challenging requirements of the vehicular networks we analyze the suitability of a reinforcement learning based routing algorithm. We compare the performance of a reinforcement learning algorithm with AODV which is considered as one of the robust routing protocols under varying traffic and load conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Mahajan, A., Potnis, N., Gopalan, K., Wang, A.-I.A.: Urban Mobility Models for VANET. In: 2nd IEEE International Workshop on Next Generation Wireless Networks (2006)

    Google Scholar 

  2. Artimy, M.M., Robertson, W., Phillips, W.J.: Vehicular Ad Hoc Networks: An Emerging Technology Towards Safe and Efficient Transportation. In: Boukerche, A. (ed.) Algorithms and Protocols for Wireless and Mobile Ad Hoc Networks, pp. 40-5 – 40-8. John Wiley & Sons, Chichester (2009)

    Google Scholar 

  3. Kihl, M., Sichitu, M.L.: Performance Issues in Vehicular Ad Hoc Networks. In: Boukerche, A. (ed.) Algorithms and Protocols for Wireless and Mobile Ad Hoc Networks, pp. 4-33 – 4-40. John Wiley & Sons, Chichester (2009)

    Google Scholar 

  4. Wang, S.Y.: The effects of wireless transmission range on path lifetime in vehicle-formed mobile ad hoc networks on highways. In: IEEE International Conference on Communications, pp. 3177–3181 (2005)

    Google Scholar 

  5. Dowling, J., Curran, E., Cunningham, R., Cahill, V.: Using Feedback in Collaborative Reinforcement Learning to Adaptively Optimize MANET Routing. IEEE Transactions on Systems Man and Cybernetics. Part A: Systems and Humans 35(3) (2005)

    Google Scholar 

  6. Perkins, C., Royer, E.: Ad Hoc On-Demand Distance Vector Routing. In: Proceedings of the 2nd IEEE Workshop on Mobile Computing Systems and Applications, pp. 90–100 (1999)

    Google Scholar 

  7. Perkins, C., Royer, E., Das, S.: Ad-Hoc on demand distance vector (AODV) routing, http://www.ietf.org/internet-drafts/draft-ietf-manet-aodv-03.txt

  8. ETSI, Universal Mobile Telecommunications System (UMTS), Selection procedures for choice of radio transmission technologies of the UMTS, UMTS 30.03, Version 3.2.0 (1998), http://www.3gpp.org/ftp/specs/html-info/30034.html

  9. Chaudhuri, P.S., Yves Le, B.J., Vojnovic, M.: Perfect Simulations for Random Trip Mobility Models. In: 38th Annual Simulation Symposium, San Diego, California (2005)

    Google Scholar 

  10. INVENT, http://www.njit.edu/~borcea/invent/invent-vehicular-traffic-generator.tar.gz

  11. Alpaydin, E.: Introduction to Machine Learning. PHI (2006)

    Google Scholar 

  12. Sutton, R., Barto, A.: Reinforcement Learning. MIT Press, Cambridge (1998)

    Google Scholar 

  13. Boyman, J.A., Littman, M.: Packet Routing in Dynamically Changing Networks: A Reinforcement Learning Approach. In: Advances in Neural Information Processing Systems. MIT Press, Cambridge (1994)

    Google Scholar 

  14. Royer, E.M., Toh, C.-K.: A Review of Current Routing Protocols for Ad-Hoc Mobile Wireless Networks. In: IEEE Personal Communications (1999)

    Google Scholar 

  15. Davies, V.: Evaluating Mobility Models within an Ad Hoc Network, MS Thesis, Colorado School of Mines (2000)

    Google Scholar 

  16. Fiore, M.: Vehicular Mobility Models. In: Olariu, S., Weigle, M.C. (eds.) Vehicular Networks From Theory to Practice, pp. 12-5 – 12-8. CRC Press, Boca Raton (2009)

    Google Scholar 

  17. Sarkar, S.K., Basavaraju, T.G., Puttamadappa, C.: Ad Hoc Mobile Wireless Networks Principles, Protocols and Applications, pp. 275–277. Aurbach Publications (2008)

    Google Scholar 

  18. Camp, T., Boleng, J., Davies, V.: A survey of Mobility Models for Ad Hoc Network Research (2002), http://toilers.mins.edu/papers/psgz/models.ps.gz

  19. Gipps, P.G.: A Behavioral Car Following Model for Computer Simulation. Transportation Research B 15, 105–111 (1981)

    Article  Google Scholar 

  20. Gipps, P.G.: A model for the structure of lane-changing decisions. Transportation Research Board 20B(5), 403–414 (1986)

    Article  Google Scholar 

  21. NS-2, The NS-2 Simulator, http://www.isi.edu/nsnam/ns

  22. Motion, B.: A mobility scenario generation and analysis tool (2005), http://web.informatik.uni-bonn.de/iv/mitarbeiter/decvaal/bonnmotion

  23. Random Trip Mobility Model, http://monarch.cs.rice.edu/~santa/research/mobility/code.tar.gz

  24. Broch, J., Maltz, D.A., Johnson, D.B., Hu, Y.C., Jetcheva, J.: A performance comparison of multi-hop wireless ad hoc routing protocols. In: 4th International Conference on Mobile Computing and Networking (ACM MOBICOM 1998), October 1998, pp. 85–97 (1998)

    Google Scholar 

  25. Nzouonta, J., Rajgure, N., Wang, G., Borcea, C.: VANET Routing on City Roads using Real-Time Vehicular Traffic Information. IEEE Transactions on Vehicular Technology 58(7) (2009)

    Google Scholar 

  26. Perkins, C.E., Bhagwat, P.: Highly Dynamic Destination-Sequenced Distance- Vector Routing (DSDV) for Mobile Computers (1994), http://www.cs.virginia.edu/~cl7v/cs851-papers/dsdv-sigcomm94.pdf

  27. Bai, F., Sadagopan, N., Helmy, A.: The Important framework for analyzing the Impact of Mobility on Performance of RouTing protocols for Adhoc NeTworks. Elsevier Ad Hoc Networks 1, 383–403 (2003)

    Article  Google Scholar 

  28. Curran., E.: Swarm: Cooperative reinforcement learning for routing ad-hoc networks (2003), http://peelmeagrape.net/eoin/swarm

  29. Johnson, D.B., Maltz, D.A., Broch, J.: DSR: The Dynamic Source Routing Protocol for Multi-hop Wireless Ad Hoc Networks (2001), http://citeseer.nj.nec.com/broch99supporting.html

  30. Beraldi, R., Baldoni, R.: Unicast Routing Techniques for Mobile Ad Hoc Networks. In: llyas, M. (ed.) The Handbook of Ad Hoc Wireless Networks. CRC Press, Boca Raton (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Research Scholar. Dept of CSE, N.I.E Mysore, Karnataka, India

    Shrirang Ambaji Kulkarni

  2. Principal NIE Institute of Technology, Mysore, Karnataka, India

    G. Raghavendra Rao

Authors
  1. Shrirang Ambaji Kulkarni
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. Raghavendra Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Dept. of Computer Sciences, University of Florida, 32611, Gainesville, FL, USA

    Sanjay Ranka

  2. University of Florida, Gainesville, Fl, USA

    Arunava Banerjee

  3. Department of Computer Science and Engineering, Indian Institute of Technology, 110016, New Delhi, INDIA

    Kanad Kishore Biswas

  4. Computer Science, College of Engineering and Science, Louisiana Tech University, LA 71272, Ruston, USA

    Sumeet Dua

  5. University of Florida, Gainesville, FL, USA

    Prabhat Mishra

  6. Department of Computer Science & Engineering, Indian Institute of Technology Kanpur, 208016, India

    Rajat Moona

  7. National Tsing Hua University, Hsin-Chu, Taiwan, R.O.C.

    Sheung-Hung Poon

  8. Department of Computer Science, The University of Hong Kong, Pokfulam Road, Hong Kong

    Cho-Li Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kulkarni, S.A., Rao, G.R. (2010). Vehicular Ad Hoc Network Mobility Models Applied for Reinforcement Learning Routing Algorithm. In: Ranka, S., et al. Contemporary Computing. IC3 2010. Communications in Computer and Information Science, vol 95. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14825-5_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14825-5_20

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14824-8

  • Online ISBN: 978-3-642-14825-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation