Email this article A Model for the intelligent analysis and detection of anomalies in the data of statistical observation of educational organizations
- Authors: Vinogradov N.E.1, Vostroknutov I.E.1
-
Affiliations:
- MIREA – Russian Technological University
- Issue: Vol 12, No 5 (2025)
- Pages: 143-153
- Section: INFORMATICS AND INFORMATION PROCESSING
- URL: https://journal-vniispk.ru/2313-223X/article/view/358392
- DOI: https://doi.org/10.33693/2313-223X-2025-12-5-143-153
- EDN: https://elibrary.ru/EZTMLX
- ID: 358392
Cite item
Open Access
Access granted
Subscription Access
Abstract
This article describes an algorithm for applying an intelligent analysis model to detect anomalies in statistical observation data for educational organizations. The definition of an anomaly is given, typical anomalies that may be contained in statistical reporting data are analyzed. The classification of anomaly detection techniques is given depending on the level of markup of the training sample, and possible ways of marking up data to present the results of the anomaly search are analyzed. The analysis and description of the process of collecting and processing statistical data of educational organizations in the Scientific and Technical Center of RTU MIREA is carried out. The weaknesses of the data collection process are analyzed, which can be strengthened by applying intelligent analysis to search for anomalies in the data. The analysis and mathematical description of the format and features of the received and stored statistical data is carried out. An algorithm has been developed for preparing data for training an intelligent analysis model, taking into account their specifics, as well as the subsequent application of the trained model to detect anomalies in the data under consideration. The algorithm was tested on real data using the autoencoder neural network model.
Keywords
Full Text
##article.viewOnOriginalSite##About the authors
Nikita E. Vinogradov
MIREA – Russian Technological University
Author for correspondence.
Email: vinogradov_n@mirea.ru
SPIN-code: 1383-7078
graduate student, Institute for Advanced Technologies and Industrial Programming
Russian Federation, MoscowIgor E. Vostroknutov
MIREA – Russian Technological University
Email: vostroknutov_i@mail.ru
ORCID iD: 0000-0003-1690-7961
SPIN-code: 7619-6288
Scopus Author ID: 57205359470
ResearcherId: B-5750-2017
Dr. Sci. (Pedag.), Professor, Institute for Advanced Technologies and Industrial Programming
Russian Federation, MoscowReferences
- Bardasova I.A., Volkova E.A. Anomaly detection in emails using machine learning. Vestnik Nauki. 2024. Vol. 4. No. 5 (74). Pp. 1350–1358. (In Rus.)
- Grusho A.A. et al. Anomaly detection in big data. Sistemy i Sredstva Informatiki. 2022. Vol. 32. No. 1. Pp. 160–167. (In Rus.)
- Mikhnyaev A.L. et al. Anomaly detection in technological process data. In: Proceedings of the Conference “Digital Environment: Technologies and Prospects” (DETP 2022). N.N. Shalobyta (ed.) et al. Brest: Belarus: Brest State Technical University, 2022. Pp. 62–65.
- Safronov D.A., Katser Yu.D., Zaitsev K.S. Anomaly detection using autoencoders. International Journal of Open Information Technologies. 2022. Vol. 10. No. 8. Pp. 39–45. (In Rus.)
- Tokarev V.V. A review of machine learning methods used for outlier removal in datasets. In: Scientific review: Current issues of theory and practice. Proceedings of the V International Scientific and Practical Conference. Penza: Nauka i Prosveshchenie, 2023. Pp. 18–24.
- Shkodyrev V.P. et al. A survey of anomaly detection methods in data streams. In: Proceedings of the Second Conference on Software Engineering and Information Management. Vol. 1864. St. Petersburg, 2017.
- Shelukhin O.I., Ryabinin V.S. Anomaly detection in big data from unstructured system logs. Voprosy Kiberbezopasnosti. 2019. Vol. 2. No. 30. Pp. 36–41. (In Rus.)
- Zimek A., Schubert E. Outlier detection. In: Encyclopedia of database systems. New York: Springer, 2017.
- Braei M., Wagner S. Anomaly detection in univariate time-series: A survey on the state-of-the-art. arXiv preprint arXiv:2004.00433. 2020.
- Chandola V., Banerjee A., Kumar V. Anomaly detection: A survey. ACM computing surveys (CSUR). 2009. Vol. 41. No. 3. Pp. 1–58.
- Salgado C.M., Azevedo C., Proenca H., Vieira S.M. Noise versus outliers. Cham: Springer International Publishing, 2016. Pp. 163–183.
- Charu C. Aggarwal. outlier analysis. 2nd ed. Springer Publishing Company, Inc., 2016. ISBN: 3319475770.
- Hojjati H., Ho T.K.K., Armanfard N. Self-supervised anomaly detection: A survey and outlook. arXiv preprint arXiv:2205.05173. 2022.
- Ruff L. et al. A unifying review of deep and shallow anomaly detection. Proceedings of the IEEE. 2021. Vol. 109. No. 5. Pp. 756–795.
- Smiti A. A critical overview of outlier detection methods. Computer Science Review. 2020. Vol. 38. P. 100306.
Supplementary files
