Skip to main content

Omniverse-OpenDS: Enabling Agile Developments for Complex Driving Scenarios via Reconfigurable Abstractions

  • Conference paper
  • First Online:
HCI in Mobility, Transport, and Automotive Systems (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13335))

Included in the following conference series:

Abstract

We present Omniverse, a set of configurable abstractions for efficient developments of complex driving events during simulated driving scenarios. The goal of Omniverse is to identify the inefficiency of existing scenario implementations and provide an alternative design for ease-of-implementations for simulated driving events. We first investigate the standard code base of driving scenarios and abstract their overlapped building blocks through mathematical models. Then, we design and implement a set of flexible and configurable abstractions as an external library, to allow further developments and adaptions for more generalized cases. Finally, we validate the correctness and examine the effectiveness of Omniverse through standard driving scenarios’ implementations, and the results show that Omniverse can (1) save 42.7% development time, averaged across all participants; and (2) greatly improve the overall user experience via significantly improved readability and extend-ability of codes. The whole library of Omniverse is online at https://github.com/unnc-ucc/Omniverse-OpenDS.

Z. Song and Y. Duan—Equal contributions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alvarez, I., Rumbel, L., Adams, R.: Skyline: a rapid prototyping driving simulator for user experience. In: Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, pp. 101–108 (2015)

    Google Scholar 

  2. Bella, F.: Driving simulator for speed research on two-lane rural roads. Accid. Anal. Prev. 40(3), 1078–1087 (2008)

    Article  Google Scholar 

  3. Boyle, L.N., Lee, J.D.: Using driving simulators to assess driving safety (2010)

    Google Scholar 

  4. Brand, J.G.: Graphics for a 3D driving simulator. Bachelor thesis, Center for Intelligent Information Processing Systems, University of Western Australia (2008)

    Google Scholar 

  5. Bray, T., Paoli, J., Sperberg-McQueen, C.M., Maler, E., Yergeau, F., Cowan, J.: Extensible markup language (XML) 1.0 (2000)

    Google Scholar 

  6. Dawson, J.D.: Practical and statistical challenges in driving research. Stat. Med. 38(2), 152–159 (2019)

    Article  MathSciNet  Google Scholar 

  7. Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: Carla: an open urban driving simulator. In: Conference on Robot Learning, pp. 1–16. PMLR (2017)

    Google Scholar 

  8. Duan, Y., Liu, J., Jin, W., Peng, X.: Characterizing Differentially-Private Techniques in the Era of Internet-of-Vehicles. Technical Report-Feb-03 at User-Centric Computing Group, University of Nottingham Ningbo China (2022)

    Google Scholar 

  9. Fouladinejad, N., Fouladinejad, N., Abd Jalil, M., Taib, J.M.: Modeling virtual driving environment for a driving simulator. In: 2011 IEEE International Conference on Control System, Computing and Engineering, pp. 27–32. IEEE (2011)

    Google Scholar 

  10. Hassan, B., Berssenbrügge, J., Al Qaisi, I., Stöcklein, J.: Reconfigurable driving simulator for testing and training of advanced driver assistance systems. In: 2013 IEEE International Symposium on Assembly and Manufacturing (ISAM), pp. 337–339. IEEE (2013)

    Google Scholar 

  11. Huang, Z., et al.: Face2Multi-modal: in-vehicle multi-modal predictors via facial expressions. In: Adjunct Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2020, Virtual Event, Washington, DC, USA, 21–22 September 2020, pp. 30–33. ACM (2020). https://doi.org/10.1145/3409251.3411716

  12. Jin, W., Duan, Y., Liu, J., Huang, S., Xiong, Z., Peng, X.: BROOK Dataset: A Playground for Exploiting Data-Driven Techniques in Human-Vehicle Interactive Designs. Technical Report-Feb-01 at User-Centric Computing Group, University of Nottingham Ningbo China (2022)

    Google Scholar 

  13. Jin, W., Ming, X., Song, Z., Xiong, Z., Peng, X.: Towards emulating internet-of-vehicles on a single machine. In: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2021, Leeds, United Kingdom, 9–14 September 2021 - Adjunct Proceedings, pp. 112–114. ACM (2021). https://doi.org/10.1145/3473682.3480275

  14. Kaptein, N.A., Theeuwes, J., Van Der Horst, R.: Driving simulator validity: some considerations. Transp. Res. Rec. 1550(1), 30–36 (1996)

    Article  Google Scholar 

  15. Kusterer, R.: jMonkeyEngine 3.0 Beginner’s Guide. Packt Publishing Ltd. (2013)

    Google Scholar 

  16. Lee, W.S., Kim, J.H., Cho, J.H.: A driving simulator as a virtual reality tool. In: Proceedings of the 1998 IEEE International Conference on Robotics and Automation (Cat. No. 98CH36146), vol. 1, pp. 71–76. IEEE (1998)

    Google Scholar 

  17. Li, X., Rakotonirainy, A., Yan, X.: How do drivers avoid collisions? A driving simulator-based study. J. Safety Res. 70, 89–96 (2019)

    Article  Google Scholar 

  18. Liu, J., et al.: HUT: Enabling High-UTility, Batched Queries under Differential Privacy Protection for Internet-of-Vehicles. Technical Report-Feb-02 at User-Centric Computing Group, University of Nottingham Ningbo China (2022)

    Google Scholar 

  19. Math, R., Mahr, A., Moniri, M.M., Müller, C.: OpenDS: a new open-source driving simulator for research. GMM-Fachbericht-AmE 2013, vol. 2 (2013)

    Google Scholar 

  20. Niezgoda, M., Kamiński, T., Ucińska, M., Kruszewski, M.: Effective methods for drivers research with use of a driving simulator. J. KONES 18, 309–316 (2011)

    Google Scholar 

  21. Papantoniou, P., Yannis, G., Christofa, E.: Which factors lead to driving errors? A structural equation model analysis through a driving simulator experiment. IATSS Res. 43(1), 44–50 (2019)

    Article  Google Scholar 

  22. Peng, X., Huang, Z., Sun, X.: Building BROOK: A Multi-modal and Facial Video Database for Human-Vehicle Interaction Research, pp. 1–9 (2020). https://arxiv.org/abs/2005.08637

  23. Saxby, D.J., Matthews, G., Hitchcock, E.M., Warm, J.S., Funke, G.J., Gantzer, T.: Effect of active and passive fatigue on performance using a driving simulator. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 52, pp. 1751–1755. Sage Publications, Los Angeles (2008)

    Google Scholar 

  24. Song, Z., Wang, S., Kong, W., Peng, X., Sun, X.: First attempt to build realistic driving scenes using video-to-video synthesis in OpenDS framework. In: Adjunct Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2019, Utrecht, The Netherlands, 21–25 September 2019, pp. 387–391. ACM (2019). https://doi.org/10.1145/3349263.3351497

  25. Sun, X., et al.: Exploring personalised autonomous vehicles to influence user trust. Cogn. Comput. 12(6), 1170–1186 (2020). https://doi.org/10.1007/s12559-020-09757-x

    Article  Google Scholar 

  26. Wang, J., Xiong, Z., Duan, Y., Liu, J., Song, Z., Peng, X.: The importance distribution of drivers’ facial expressions varies over time! In: 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI 2021, Leeds, United Kingdom, 9–14 September 2021 - Adjunct Proceedings, pp. 148–151. ACM (2021). https://doi.org/10.1145/3473682.3480283

  27. Wang, S., et al.: Oneiros-OpenDS: an interactive and extensible toolkit for agile and automated developments of complicated driving scenes. In: International Conference on Human-Computer Interaction (2022)

    Google Scholar 

  28. Wang, W., Cheng, Q., Li, C., André, D., Jiang, X.: A cross-cultural analysis of driving behavior under critical situations: a driving simulator study. Transport. Res. F: Traffic Psychol. Behav. 62, 483–493 (2019)

    Article  Google Scholar 

  29. Weir, D.H.: Application of a driving simulator to the development of in-vehicle human-machine-interfaces. IATSS Res. 34(1), 16–21 (2010)

    Article  Google Scholar 

  30. Xiong, Z., et al.: Face2Statistics: user-friendly, low-cost and effective alternative to in-vehicle sensors/monitors for drivers. In: International Conference on Human-Computer Interaction (2022)

    Google Scholar 

  31. Yang, Y., Hu, J., Chen, D.: Research on driving knowledge expert system of distributed vehicle driving simulator. In: 2007 11th International Conference on Computer Supported Cooperative Work in Design, pp. 693–697. IEEE (2007)

    Google Scholar 

  32. Zhang, Yu., Jin, W., Xiong, Z., Li, Z., Liu, Y., Peng, X.: Demystifying interactions between driving behaviors and styles through self-clustering algorithms. In: Krömker, H. (ed.) HCII 2021. LNCS, vol. 12791, pp. 335–350. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-78358-7_23

    Chapter  Google Scholar 

Download references

Acknowledgements

We thank anonymous reviewers in HCI’22 for their valuable feedback. We thank for all members of User-Centric Computing Group at the University of Nottingham Ningbo China for the stimulating environment. This work was started as Zilin Song’s internship and undergraduate thesis at the University of Nottingham Ningbo China.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiangjun Peng .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Song, Z., Duan, Y., Jin, W., Huang, S., Wang, S., Peng, X. (2022). Omniverse-OpenDS: Enabling Agile Developments for Complex Driving Scenarios via Reconfigurable Abstractions. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. HCII 2022. Lecture Notes in Computer Science, vol 13335. Springer, Cham. https://doi.org/10.1007/978-3-031-04987-3_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-04987-3_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-04986-6

  • Online ISBN: 978-3-031-04987-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics