Combination method of accelerated metric data search in image classification problems

Main Article Content

Volodymyr Gorokhovatsky
Natalia Stiahlyk
Vytaliia Tsarevska

Abstract

The subject of research of the paper is the methods of image classification on a set of key point descriptors in computer vision systems. The goal is to improve the performance of structural classification methods by introducing indexed hash structures on the set of the dataset reference images descriptors and a consistent chain combination of several stages of data analysis in the classification process. Applied methods: BRISK detector and descriptors, data hashing tools, search methods in large data arrays, metric models for the vector relevance estimation, software modeling. The obtained results: developed an effective method of image classification based on the introduction of high-speed search using indexed hash structures, that speeds up the calculation dozens of times; the gain in computing time increases with an increase of the number of reference images and descriptors in descriptions; the peculiarity of the classifier is that not an exact search is performed, but taking into account the permissible deviation of data from the reference; experimentally verified the effectiveness of the classification, which indicates the efficiency and effectiveness of the proposed method. The practical significance of the work is the construction of classification models in the transformed space of the hash data representation, the efficiency confirmation of the proposed classifiers modifications on image examples, development of applied software models implementing the proposed classification methods in computer vision systems.

Article Details

How to Cite
Gorokhovatsky, V., Stiahlyk , N. ., & Tsarevska, V. (2021). Combination method of accelerated metric data search in image classification problems. Advanced Information Systems, 5(3), 5–12. https://doi.org/10.20998/2522-9052.2021.3.01
Section
Identification problems in information systems
Author Biographies

Volodymyr Gorokhovatsky, Kharkiv National University of RadioElectronics, Kharkiv, Ukraine

Doctor of Technical Sciences, Professor, Professor of Computer Science Department

Natalia Stiahlyk , Educational and Research Institute “Karazin Banking Institute” of V. N. Karazin Kharkiv National University, Kharkіv, Ukraine

Candidate of Pedagogical Sciences, Нead of Department of Information Technology and Mathematical Modeling

Vytaliia Tsarevska, Educational and Research Institute “Karazin Banking Institute” of V. N. Karazin Kharkiv National University, Kharkіv, Ukraine

student of Department of Information Technology and Mathematical Modeling

References

Daradkeh, Y.I., Tvoroshenko, I., Gorokhovatskyi, V., Latiff, L.A., and Ahmad, N. (2021), “Development of Effective Methods for Structural Image Recognition Using the Principles of Data Granulation and Apparatus of Fuzzy Logic”, IEEE Access, 9, pp. 13417-13428, DOI: http://dx.doi.org/10.1109/ACCESS.2021.3051625.

Gorokhovatskyi, V.O. and Gadetska, S.V. (2020), Statistical processing and data mining in structural image classi-fication methods (monograph), FLP Panov A.N., Kharkiv, 128 p., DOI: http://dx.doi.org/10.30837/978-617-7859-69-6.

Svyrydov, A., Kuchuk, H. and Tsiapa, O. (2018), “Improving efficienty of image recognition process: Approach and case study”, Proceedings of 2018 IEEE 9th International Conference on Dependable Systems, Services and Technol-ogies, DESSERT 2018, pp. 593-597, DOI: http://dx.doi.org/10.1109/DESSERT.2018.8409201.

Gorokhovatskyi, V.O., Pupchenko, D.V. & Solodchenko, K.G. (2018), “Analysis of properties, characteristics and results of application of the newest detectors for definition of special points of the image”, Control, navigation and communication systems, No. 1 (47), pp. 93-98, DOI: http://dx.doi.org/10.26906/SUNZ.2018.1.093.

Gorokhovatskiy, V.A., Gorokhovatskiy, A.V. and Peredrii, Ye.О. (2018), “Hashing of Structural Descriptions at Building of the Class Image Descriptor, Computing of Relevance and Classification of the Visual Objects”, Telecom-munications and Radio Engineering, Vol. 77 (13), pp. 1159–1168, DOI: http://dx.doi.org/10.1615/TelecomRadEng.v77.i13.40.

Leskovets, Yure, Radzharaman, Anand and Ulman, Dzheffry D. (2016), Analyzing large datasets, DMK Press, Mos-cow, 498 p.

Akho, A., Hopcroft, D. and Ulman, D. (2003), Data structures and algorithms, Williams, Moscow, 384 p.

Berman, A. and Shapiro, L. (1999), “A flexible image database system for content-based retrieval”, Computer Vision and Image Understanding, Vol. 75, No. ½, pp. 175–195.

Kinoshenko, D., Mashtalir, V., Yegorova, E. and Vinarsky, V. (2005), “Hierarchical partitions for content image re-trieval from large-scale database. Machine Learning and Data Mining in Pattern Recognition” / Perner, P., Imlya, A. (Eds.), Lecture Notes in Artificial Intelligence. Springer-Verlag. Vol. 3587. P. 445−455.

Babenko, A., Slesarev, A., Chigorin, A. and Lempitsky, V. (2014), “Neural codes for image retrieval”, Conference Paper. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8689 LNCS(PART 1), pр. 584-599.

Gorokhovatskyi, O., Gorokhovatskyi, V. and Peredrii, O. (2018), “Analysis of Application of Cluster Descriptions in Space of Characteristic Image Features”, Data, 3(4), 52, DOI: http://dx.doi.org/10.3390/data3040052.

Manning, C.D., Raghavan, P. and Schutze, H., (2008), Introduction to Information Retrieval, Cambridge, University Press, 528 p.

Cormen, T., Leizerson, Ch., Ryvest, R. and Shtain, K. (2005), Algorithms: construction and analysis, Publishing house "Williams", Moscow, 1296 p.

Flach, P. (2015), Machine learning. The science and art of building algorithms that extract knowledge from data, DMK Press, Moscow, 400 p.

Gionis, A., Indyk, P. and Motwani, R. (1999), “Similarity search in high dimensions via hashing”, Proc. Intl. Conf. on Very Large Databases, pp. 518–529.

Gorokhovatskyi, V.A., Putyatin, E.P. and Stolyarov, V.S. (2017), “Study of the effectiveness of structural methods of image classification using a cluster data model”, Radioelectronics, informatics, management, No. 3 (42), pp. 78–85.

Gorokhovatsky, V.A. and Putyatin, Ye. P. (2009), “Image Likelihood Measures of the Basis of the Set of Conformi-ties”, Telecommunications and Radio Engineering, 68 (9), pp. 763–778.

Nong, Ye. (2013), Data Mining: Theories, Algorithms, and Examples, CRC Press, Inc., USA.

Leutenegger, Stefan, Chli, Margarita and Roland Y., Siegwart (2011), “BRISK: Binary Robust Invariant Scalable Key-points”, Computer Vision (ICCV), pp. 2548 – 2555,

Yakovleva, O. and Nikolaieva, K. (2020), “Research of descriptor based image normalization and comparative analysis of SURF, SIFT, BRISK, ORB, KAZE, AKAZE descriptors“, Advanced Information Systems, Vol. 4, No. 4, pp. 89-101, DOI: http://dx.doi.org/10.20998/2522-9052.2020.4.13.

Xu. Zhang, Felix, X. Yu, Svebor, Karaman and Shih-Fu, Chang (2017), Learning Discriminative and Transformation Covariant Local Feature Detectors, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6818-6826.