电邮这篇文章 A Model for the intelligent analysis and detection of anomalies in the data of statistical observation of educational organizations
- 作者: Vinogradov N.E.1, Vostroknutov I.E.1
-
隶属关系:
- MIREA – Russian Technological University
- 期: 卷 12, 编号 5 (2025)
- 页面: 143-153
- 栏目: INFORMATICS AND INFORMATION PROCESSING
- URL: https://journal-vniispk.ru/2313-223X/article/view/358392
- DOI: https://doi.org/10.33693/2313-223X-2025-12-5-143-153
- EDN: https://elibrary.ru/EZTMLX
- ID: 358392
如何引用文章
开放存取
##reader.subscriptionAccessGranted##
订阅存取
详细
This article describes an algorithm for applying an intelligent analysis model to detect anomalies in statistical observation data for educational organizations. The definition of an anomaly is given, typical anomalies that may be contained in statistical reporting data are analyzed. The classification of anomaly detection techniques is given depending on the level of markup of the training sample, and possible ways of marking up data to present the results of the anomaly search are analyzed. The analysis and description of the process of collecting and processing statistical data of educational organizations in the Scientific and Technical Center of RTU MIREA is carried out. The weaknesses of the data collection process are analyzed, which can be strengthened by applying intelligent analysis to search for anomalies in the data. The analysis and mathematical description of the format and features of the received and stored statistical data is carried out. An algorithm has been developed for preparing data for training an intelligent analysis model, taking into account their specifics, as well as the subsequent application of the trained model to detect anomalies in the data under consideration. The algorithm was tested on real data using the autoencoder neural network model.
作者简介
Nikita Vinogradov
MIREA – Russian Technological University
编辑信件的主要联系方式.
Email: vinogradov_n@mirea.ru
SPIN 代码: 1383-7078
graduate student, Institute for Advanced Technologies and Industrial Programming
俄罗斯联邦, MoscowIgor Vostroknutov
MIREA – Russian Technological University
Email: vostroknutov_i@mail.ru
ORCID iD: 0000-0003-1690-7961
SPIN 代码: 7619-6288
Scopus 作者 ID: 57205359470
Researcher ID: B-5750-2017
Dr. Sci. (Pedag.), Professor, Institute for Advanced Technologies and Industrial Programming
俄罗斯联邦, Moscow参考
- Bardasova I.A., Volkova E.A. Anomaly detection in emails using machine learning. Vestnik Nauki. 2024. Vol. 4. No. 5 (74). Pp. 1350–1358. (In Rus.)
- Grusho A.A. et al. Anomaly detection in big data. Sistemy i Sredstva Informatiki. 2022. Vol. 32. No. 1. Pp. 160–167. (In Rus.)
- Mikhnyaev A.L. et al. Anomaly detection in technological process data. In: Proceedings of the Conference “Digital Environment: Technologies and Prospects” (DETP 2022). N.N. Shalobyta (ed.) et al. Brest: Belarus: Brest State Technical University, 2022. Pp. 62–65.
- Safronov D.A., Katser Yu.D., Zaitsev K.S. Anomaly detection using autoencoders. International Journal of Open Information Technologies. 2022. Vol. 10. No. 8. Pp. 39–45. (In Rus.)
- Tokarev V.V. A review of machine learning methods used for outlier removal in datasets. In: Scientific review: Current issues of theory and practice. Proceedings of the V International Scientific and Practical Conference. Penza: Nauka i Prosveshchenie, 2023. Pp. 18–24.
- Shkodyrev V.P. et al. A survey of anomaly detection methods in data streams. In: Proceedings of the Second Conference on Software Engineering and Information Management. Vol. 1864. St. Petersburg, 2017.
- Shelukhin O.I., Ryabinin V.S. Anomaly detection in big data from unstructured system logs. Voprosy Kiberbezopasnosti. 2019. Vol. 2. No. 30. Pp. 36–41. (In Rus.)
- Zimek A., Schubert E. Outlier detection. In: Encyclopedia of database systems. New York: Springer, 2017.
- Braei M., Wagner S. Anomaly detection in univariate time-series: A survey on the state-of-the-art. arXiv preprint arXiv:2004.00433. 2020.
- Chandola V., Banerjee A., Kumar V. Anomaly detection: A survey. ACM computing surveys (CSUR). 2009. Vol. 41. No. 3. Pp. 1–58.
- Salgado C.M., Azevedo C., Proenca H., Vieira S.M. Noise versus outliers. Cham: Springer International Publishing, 2016. Pp. 163–183.
- Charu C. Aggarwal. outlier analysis. 2nd ed. Springer Publishing Company, Inc., 2016. ISBN: 3319475770.
- Hojjati H., Ho T.K.K., Armanfard N. Self-supervised anomaly detection: A survey and outlook. arXiv preprint arXiv:2205.05173. 2022.
- Ruff L. et al. A unifying review of deep and shallow anomaly detection. Proceedings of the IEEE. 2021. Vol. 109. No. 5. Pp. 756–795.
- Smiti A. A critical overview of outlier detection methods. Computer Science Review. 2020. Vol. 38. P. 100306.
补充文件
