RESEARCH OF DESCRIPTOR BASED IMAGE NORMALIZATION AND COMPARATIVE ANALYSIS OF SURF, SIFT, BRISK, ORB, KAZE, AKAZE DESCRIPTORS
Article Sidebar
Main Article Content
Abstract
The subject of research is image normalization based on key points analysis. The purpose is development of mathematical models and their software implementation for normalization of image geometric transformations based on the analysis of SIFT, SURF, ORB, BRISK, KAZE, AKAZE descriptors; the model application for comparative analysis of descriptors based on expert assessments of normalization quality, time costs and other indicators; construction and usage in experiments the own dataset with 100 real image pairs which contains scenes of five types: buildings, plane images outside, plane images inside, natural and artificial textures; making conclusions about the performance of the considered descriptors to solve the normalization problem. Such methods are applied: SIFT, SURF, ORB, BRISK, KAZE, AKAZE descriptors for describing key points, the Nearest Neighbor Distance Ratio method or symmetric method for search of corresponding pairs of key points from different images, the RANSAC method for rejecting false correspondences and obtaining a homography matrix, similarity measures, software modeling. The results obtained: experimental normalization results by SIFT, SURF, ORB, BRISK, KAZE, AKAZE descriptors for 100 real pairs of own dataset (normalized images, their overlaps, quantitative descriptor evaluation, precision and recall estimation, time costs estimation, expert quality assessment, conversion of all indicator values to an 8-point rating scale); summary diagrams and conclusions about advantages and weaknesses of the compared descriptors; recommendations about the most-suitable-algorithm selection for solving normalization problem in specific cases.
Article Details
References
Gorokhovatskij, V.A. (2014), Strukturny`j analiz i intellektual`naya obrabotka danny`kh v komp`yuternom zrenii [Structural analysis and data mining in computer vision], Kompaniya SMIT, Khar`kov, 316 p. (in Russian)
Putyatin, E.P. and Averin, S.I. (1990), Obrabotka izobrazhenij v robototekhnike [Image processing in robotics], Mashinostroenie, Moscow, 320 p. (in Russian)
Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2017), “ImageNet classification with deep convolutional neural networks”, Communications of the ACM, No60(6), pp. 84-90.
Putjatin E.P., Jakovleva E.V., Ljubchenko V.A. (1996), “Razlozhenie matricy centroaffinnogo preobrazovanija dlja normalizacii izobrazhenij” [Centroaffine transformation matrix decomposition for image normalization], Radiojelektronika i informatika No. 4 (05), pp. 91–94. (in Russian)
Yakovleva, E.V. (2004), “Metody` odnomerny`kh normalizaczij affinny`kh preobrazovanij v zadachakh raspoznavaniya izobrazhenij: dissertation” [Methods of dimensional normalization affine transformations in image recognition tasks: dissertation], Kharkiv, 199 p. (in Russian)
Genkin, V.L., Erosh, I.L., and Moskalev, E.S. (1988), Sistemy` raspoznavaniya avtomatizirovanny`kh proizvodstv [Recognition systems for automated production], Mashinostroenie, Leningrad, 246 p. (in Russian)
Lyubchenko, V.A. (2004), “Matematicheskie modeli i metody` normalizaczii proektivny`kh preobrazovanij v sistemakh obrabotki izobrazhenij: dissertation” [Mathematical models and methods of normalization of projective transformations in image processing systems: dissertation], Kharkiv 156 p.
Lowe, D.G. (2004), “Distinctive image features from scale-invariant keypoints”, International journal of computer vision, Vol. 60. – No 2. – pp. 91-110.
Bay, H., Tuytelaars, T., and Van Gool, L. (2006), “Surf: Speeded up robust features”, European conference on computer vision. Springer, Berlin, Heidelberg, pp. 404-417.
Rublee, E. et al. (2011), ORB: “An efficient alternative to SIFT or SURF”, 2011 International conference on computer vision, Ieee, pp. 2564-2571.
Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011), “BRISK: Binary robust invariant scalable keypoints”, 2011 International conference on computer vision, Ieee, pp. 2548-2555.
Alcantarilla, P.F., Bartoli, A., and Davison, A.J. (2012), “KAZE features”, European Conference on Computer Vision, Springer, Berlin, Heidelberg, pp. 214-227.
Alcantarilla, P. F., and Solutions, T. (2011), “Fast explicit diffusion for accelerated features in nonlinear scale spaces”, IEEE Trans. Patt. Anal. Mach. Intell, Vol. 34, No 7, pp. 1281-1298.
Márquez-Neila P. et al. (2016), “Speeding-up homography estimation in mobile devices”, Journal of Real-Time Image Processing, Vol. 11, No 1, pp. 141-154.
(2020); Detail material on “Research of descriptor based image normalization and comparative analysis of SURF, SIFT, BRISK, ORB, KAZE, AKAZE descriptors” (original image pairs, normalized images, their overlaps, the tables with different estimations, summary diagrams etc.)” available at: https://github.com/SytossResearch/DescriptorBasedNormalization