Skip to main content

Large Scale Monocular Vision-Only Mapping from a Fixed-Wing sUAS

  • Chapter
  • First Online:
Field and Service Robotics

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 92))

Abstract

This paper presents the application of a monocular visual SLAM on a fixed-wing small Unmanned Aerial System (sUAS) capable of simultaneous estimation of aircraft pose and scene structure. We demonstrate the robustness of unconstrained vision alone in producing reliable pose estimates of a sUAS, at altitude. It is ultimately capable of online state estimation feedback for aircraft control and next-best-view estimation for complete map coverage without the use of additional sensors. We explore some of the challenges of visual SLAM from a sUAS including dealing with planar structure, distant scenes and noisy observations. The developed techniques are applied on vision data gathered from a fast-moving fixed-wing radio control aircraft flown over a \(1\times 1\) km rural area at an altitude of 20–100 m. We present both raw Structure from Motion results and a SLAM solution that includes FAB-MAP based loop-closures and graph-optimised pose. Timing information is also presented to demonstrate near online capabilities. We compare the accuracy of the 6-DOF pose estimates to an off-the-shelf GPS aided INS over a 1.7 km trajectory. We also present output 3D reconstructions of the observed scene structure and texture that demonstrates future applications in autonomous monitoring and surveying.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. M. Agrawal, K. Konolige, M. Blas, Censure: center surround extremas for realtime feature detection and matching, in International Conference on Computer Vision, The Proceedings of the, pp. 102–115 (2008)

    Google Scholar 

  2. M. Blosch, S. Weiss, D. Scaramuzza, R. Siegwart, Vision based MAV navigation in unknown and unstructured environments, in Robotics and Automation (ICRA), 2010 IEEE International Conference on, pp. 21–28. IEEE (2010)

    Google Scholar 

  3. M. Bryson, M. Johnson-Roberson, S. Sukkarieh, Airborne smoothing and mapping using vision and inertial sensors, in 2009 IEEE International Conference on Robotics and Automation, pp. 3143–3148. IEEE (2009)

    Google Scholar 

  4. A. Cherian, J. Andersh, V. Morellas, N. Papanikolopoulos, B. Mettler, Autonomous altitude estimation of a UAV using a single onboard camera, in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3900–3905 (2009)

    Google Scholar 

  5. R. Clark, M. Lin, C. Taylor, 3D environment capture from monocular video and inertial data, in SPIE on Three-Dimensional Image Capture and Applications (2006)

    Google Scholar 

  6. M. Cummins, P. Newman, FAB-MAP: probabilistic localization and mapping in the space of appearance. Int. J. Rob. Res. 27(6), 647–665 (2008)

    Article  Google Scholar 

  7. D. Eynard, P. Vasseur, C. Demonceaux, V. Frémont, UAV altitude estimation by mixed stereoscopic vision, in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, Iros, pp. 646–651. IEEE (2010)

    Google Scholar 

  8. A.J. Glover, W.P. Maddern, M.J. Milford, G.F. Wyeth, FAB-MAP + RatSLAM: appearance-based SLAM for multiple times of day, in The IEEE International Conference on Robotics and Automation, May 2010, pp. 3507–3512. IEEE, Alaska, USA (2010)

    Google Scholar 

  9. G. Grisetti, R. Kuemmerle, C. Stachniss, U. Frese, C. Hertzberg, Hierarchical optimization on manifolds for online 2d and 3d mapping, in Robotics and Automation (ICRA), 2010 IEEE International Conference on. IEEE, Anchorage, USA (2010)

    Google Scholar 

  10. B. Haralick, C. Lee, K. Ottenberg, M. Nölle, Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vis. 13(3), 331–356 (1994)

    Article  Google Scholar 

  11. V. Hiep, R. Keriven, P. Labatut, J.P. Pons, Towards high-resolution large-scale multi-view stereo, in Conference on Computer Vision and Pattern Recognition (CVPR), Miami, USA (2009)

    Google Scholar 

  12. H. Hoppe, Poisson surface reconstruction and its applications, in Proceedings of the 2008 ACM Symposium on Solid and Physical Modeling—SPM ’08, p. 10 (2008)

    Google Scholar 

  13. B.K.P. Horn, Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629 (1987)

    Article  MathSciNet  Google Scholar 

  14. T. Kanade, O. Amidi, Q. Ke, Real-time and 3D vision for autonomous small and micro air vehicles, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601), vol. 2, pp. 1655–1662 (2004)

    Google Scholar 

  15. A. Kassir, T. Peynot, Reliable automatic camera-laser calibration, in Australasian Conference on Robotics and Automation, Brisbane, Australia (2010)

    Google Scholar 

  16. J. Kim, S. Sukkarieh, Autonomous airborne navigation in unknown terrain environments. IEEE Trans. Aerosp. Electron. Syst. 40(3), 1031–1045 (2004)

    Article  Google Scholar 

  17. K. Konolige, M. Agrawal, Frameslam: from bundle adjustment to real-time visual mapping. IEEE Trans. Rob. 24(5), 1066–1077 (2008)

    Article  Google Scholar 

  18. D. Lowe, Object recognition from local scale-invariant features, in International Conference on Computer Vision, The Proceedings of the, vol. 2, pp. 1150–1157 (1999)

    Google Scholar 

  19. D. McKinnon, H. He, B. Upcroft, R.N. Smith, Towards automated and in-situ, near-real time 3-D reconstruction of coral reef environments, in Oceans, September 2011

    Google Scholar 

  20. C. Mei, G. Sibley, P. Newman, A constant-time efficient stereo SLAM system, in Systems Engineering, pp. 1–11 (2009)

    Google Scholar 

  21. D. Nistér, An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–777 (2004)

    Google Scholar 

  22. D. Nistér, O. Naroditsky, J. Bergen, Visual odometry for ground vehicle applications. J. Field Rob. 23(1), 3–20 (2006)

    Article  MATH  Google Scholar 

  23. M. Pollefeys, D. Nistér, J.M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, H. Towles, Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vis. 78(2–3), 143–167 (2007)

    Google Scholar 

  24. H. Strasdat, J. Montiel, A. Davison, Scale drift-aware large scale monocular SLAM, in Proceedings of Robotics: Science and Systems (RSS). Citeseer, Zaragoza, Spain (2010)

    Google Scholar 

  25. E. Tola, C. Strecha, P. Fua, Efficient large-scale multi-view stereo for ultra high-resolution image sets. Mach. Vis. Appl. 23(5), 903–920 (2011)

    Google Scholar 

  26. P. Torr, A. Fitzgibbon, A. Zisserman, The problem of degeneracy in structure and motion recovery from uncalibrated image sequences. Int. J. Comput. Vis. 32(1), 27–44 (1999)

    Article  Google Scholar 

  27. J. Volpe, Vulnerability assessment of the transportation infrastructure relying on the global positioning system, Transportation (2001)

    Google Scholar 

  28. M. Warren, D. McKinnon, H. He, B. Upcroft, Unaided stereo vision based pose estimation, in Australasian Conference on Robotics and Automation, December 2010, Brisbane, Australia (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Warren .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Warren, M., McKinnon, D., He, H., Glover, A., Shiel, M., Upcroft, B. (2014). Large Scale Monocular Vision-Only Mapping from a Fixed-Wing sUAS. In: Yoshida, K., Tadokoro, S. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 92. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40686-7_33

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40686-7_33

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40685-0

  • Online ISBN: 978-3-642-40686-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics