Abstract
Feature detection and description algorithms represent an important milestone in most computer vision applications. They have been examined from various perspectives during the last decade. However, most studies focused on their performance when used on visible band imagery. This modality suffers considerably in poor lighting conditions and notably during night-time. Infrared cameras, which noticed a considerable proliferation in recent years, offer a viable alternative in such conditions. Understanding how the building blocks of computer vision applications behave in this modality would help the community accommodating them. For this reason, we carried out a performance analysis of the most commonly used feature detectors and descriptors beyond the visible. A dataset accounting for the various challenges on these algorithms has been generated. In addition, challenges inherent to the thermal modality have been considered, notably the non-uniformity noise. A comprehensive quantitative investigation into the performance of feature detectors and descriptors is therefore presented. This study would serve to filling the gap in the literature as most analyzes have been based on visible band imagery.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Agrawal, M., Konolige, K., Blas, M.R.: CenSurE: Center surround extremas for realtime feature detection and matching. In: European Conference on Computer Vision, pp. 102–115 (2008)
Alahi, A., Ortiz, R., Vandergheynst, P.: FREAK: Fast retina keypoint. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 510–517 (2012)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Calonder, M., Lepetit, V., Strecha, C., Fua, P.: Brief: Binary robust independent elementary features. In: European Conference on Computer Vision, pp. 778–792 (2010)
Carlevaris-Bianco, N., Ushani, A.K., Eustice, R.M.: University of Michigan North Campus long-term vision and lidar dataset. Int. J. Robot. Res. 35(9), 1023–1035 (2015)
Dahl, A.L., Aanæs, H., Pedersen, K.S.: Finding the best feature detector-descriptor combination. In: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, pp. 318–325 (2011)
Evangelidis, G.D., Psarakis, E.Z.: Parametric image alignment using enhanced correlation coefficient maximization. IEEE Trans. Pattern Anal. Mach. Intell. 30(10), 1858–1865 (2008)
Gauglitz, S., Höllerer, T., Turk, M.: Evaluation of interest point detectors and feature descriptors for visual tracking. Int. J. Comput. Vis. 94(3), 335–360 (2011)
Harris, C., Stephens, M.: A combined corner and edge detector. In: 4th Alvey Vision Conference, pp. 147–152 (1988)
Krajník, T., Cristóforis, P., Kusumam, K., Neubert, P., Duckett, T.: Image features for visual teach-and-repeat navigation in changing environments. Robot. Auton. Syst. 88, 127–141 (2017)
Kumar, A., Sarkar, S., Agarwal, R.P.: Correcting infrared focal plane array sensor non uniformities based upon adaptive filter. In: International Conference on Image Processing, pp. 1537–1540 (2006)
Lee, J.H., Kim, Y.S., Lee, D., Kang, D.G., Ra, J.B.: Robust ccd and ir image registration using gradient-based statistical information. IEEE Signal Process. Lett. 17(4), 347–350 (2010)
Leutenegger, S., Chli, M., Siegwart, R.Y.: BRISK: Binary robust invariant scalable keypoints. In: IEEE International Conference on Computer Vision, pp. 2548–2555 (2011)
Lin, S.: Review: Extending visible band computer vision techniques to infrared band images. Technical Report No. MS,-CIS-01-04, pp. 1–23 (2001)
Lowe, D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Mair, E., Hager, G.D., Burschka, D., Suppa, M., Hirzinger, G.: Adaptive and generic corner detection based on the accelerated segment test. In: 11th European Conference on Computer Vision, pp. 183–196 (2010)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
Mikolajczyk, K., Tuytelaars, T., Schmid, C., Zisserman, A., Matas, J., Schaffalitzky, F., Kadir, T., Gool, L.V.: A comparison of affine region detectors. Int. J. Comput. Vis. 65(1), 43–72 (2005)
Moravec, H.P.: Obstacle avoidance and navigation in the real world by a seeing robot rover. PhD thesis, Stanford University, Stanford CA (1980)
Mouats, T., Aouf, N., Sappa, A.D., Aguilera, C., Toledo, R.: Multispectral stereo odometry. IEEE Trans. Intell. Transp. Syst. 16(3), 1210–1224 (2015)
Mousa, M., Zhang, X., Claudel, C.: Flash flood detection in urban cities using ultrasonic and infrared sensors. IEEE Sensors J. 16(19), 7204–7216 (2016)
Owens, K., Matthies, L.: Passive night vision sensor comparison for unmanned ground vehicle stereo vision navigation. In: IEEE International Conference on Robotics and Automation, vol. 1, pp. 122–131 (2000)
Ricaurte, P., Chilȧn, C., Aguilera-Carrasco, C.A., Vintimilla, B.X., Sappa, A.D.: Feature point descriptors: Infrared and visible spectra. Sensors (Basel Switzerland) 14(2), 3690 (2014)
Rosin, P.L.: Measuring corner properties. Comput. Vis. Image Underst. 73(2), 291–307 (1999)
Rosten, E., Drummond, T.: Machine learning for high-speed corner detection. In: European Conference on Computer Vision, pp. 430–443 (2006)
Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: ORB: An efficient alternative to SIFT or SURF. In: International Conference on Computer Vision, pp. 2564–2571 (2011)
Schmid, C., Mohr, R., Bauckhage, C.: Evaluation of interest point detectors. Int. J. Comput. Vis. 37 (2), 151–172 (2000)
Schmidt, A., Kraft, M., Kasiṅski, A.: An evaluation of image feature detectors. In: International Conference on Computer Vision and Graphics, pp. 251–259 (2010)
Shi, J., Tomasi, C.: Good features to track. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)
Sünderhauf, N., Shirazi, S., Dayoub, F., Upcroft, B., Milford, M.: On the performance of convnet features for place recognition. In: IEEE International Conference on Intelligent Robots and Systems, pp. 4297–4304 (2015)
Szeliski, R.: Computer Vision: Algorithms and Applications. Springer Science & Business Media (2010)
Tuytelaars, T., Mikolajczyk, K.: Local invariant feature detectors: A survey. Found. Trends Comput. Graph. Vis. 3(3), 177–280 (2008)
Vidas, S., Lakemond, R., Denman, S., Fookes, C., Sridharan, S., Wark, T.: An exploration of feature detector performance in the thermal-infrared modality. In: International Conference on Digital Image Computing: Techniques and Applications, pp. 217–224 (2011)
Vidas, S., Lakemond, R., Denman, S., Fookes, C., Sridharan, S., Wark, T.: A mask-based approach for the geometric calibration of thermal-infrared cameras. IEEE Trans. Instrum. Meas. 61(6), 1625–1635 (2012)
Wang, Z., Fan, B., Wu, F.: Local intensity order pattern for feature description. In: IEEE International Conference on Computer Vision, pp. 603–610 (2011)
Weinmann, M., Leitloff, J., Hoegner, L., Jutzi, B., Stilla, U., Hinz, S.: Thermal 3D mapping for object detection in dynamic scenes. ISPRS Annals of Photogrammetry Remote Sensing and Spatial Information Sciences II-1, pp. 53–60 (2014)
Yun, J., Song, M.H.: Detecting direction of movement using pyroelectric infrared sensors. IEEE Sensors J. 14(5), 1482–1489 (2014)
Zeng, D., Benilov, A., Bunin, B., Martini, R.: Long-wavelength ir imaging system to scuba diver detection in three dimensions. IEEE Sensors J. 10(3), 760–764 (2010)
Zhang, L., Wu, B., Nevatia, R.: Pedestrian detection in infrared images based on local shape features. In: International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Mouats, T., Aouf, N., Nam, D. et al. Performance Evaluation of Feature Detectors and Descriptors Beyond the Visible. J Intell Robot Syst 92, 33–63 (2018). https://doi.org/10.1007/s10846-017-0762-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-017-0762-8