Operational statistical analysis of the results of computer-based testing of students
- Authors: Nardyuzhev V.I.1, Nardyuzhev I.V.2, Marfina V.E.1, Kurinin I.N.1
-
Affiliations:
- Рeoples’ Friendship University of Russia (RUDN University)
- Software development department, JSC “The Seventh Continent”
- Issue: Vol 15, No 1 (2018)
- Pages: 81-88
- Section: INNOVATION PEDAGOGICAL TECHNOLOGIES IN EDUCATION
- URL: https://journal-vniispk.ru/2312-8631/article/view/333523
- DOI: https://doi.org/10.22363/2312-8631-2018-15-1-81-88
- ID: 333523
Cite item
Full Text
Abstract
The article is devoted to the issues of statistical analysis of results of computer-based testing for evaluation of educational achievements of students. The issues are relevant due to the fact that computerbased testing in Russian universities has become an important method for evaluation of educational achievements of students and quality of modern educational process. Usage of modern methods and programs for statistical analysis of results of computer-based testing and assessment of quality of developed tests is an actual problem for every university teacher. The article shows how the authors solve this problem using their own program “StatInfo”. For several years the program has been successfully applied in a credit system of education at such technological stages as loading computerbased testing protocols into a database, formation of queries, generation of reports, lists, and matrices of answers for statistical analysis of quality of test items. Methodology, experience and some results of its usage by university teachers are described in the article. Related topics of a test development, models, algorithms, technologies, and software for large scale computer-based testing has been discussed by the authors in their previous publications which are presented in the reference list.
About the authors
Viktor Ivanovich Nardyuzhev
Рeoples’ Friendship University of Russia (RUDN University)
Author for correspondence.
Email: vin111@mail.ru
candidate of engineering sciences, associate professor of the department “Computer technologies” of the philological faculty of the Peoples’ Friendship University of Russia
Miklukho-Maklaya str., 6, Moscow, 117198, Russian FederationIvan Viktorovich Nardyuzhev
Software development department, JSC “The Seventh Continent”
Email: inard@rambler.ru
candidate of engineering sciences, programmer of the software development department of JSC “The Seventh Continent”
Building, 21, MKAD 47, v. Govorovo, Moscow, Russia, 142784Victoria Evgenievna Marfina
Рeoples’ Friendship University of Russia (RUDN University)
Email: vika434221@gmail.com
student of the master course at the department of comparative educational policy of the Peoples’ Friendship University of Russia
Miklukho-Maklaya str., 6, Moscow, 117198, Russian FederationIvan Nikolayevich Kurinin
Рeoples’ Friendship University of Russia (RUDN University)
Email: kurinin_in@pfur.ru
candidate of economic sciences, associate professor, head of the department “Computer technologies” of the philological faculty of the Peoples’ Friendship University of Russia
Miklukho-Maklaya str., 6, Moscow, 117198, Russian FederationReferences
- Anastazi A. Psikhologicheskoe testirovanie [Psychological Testing]. M.: Pedagogika, 1982. 320 p.
- Avanesov V.S. Kompozitsiya testovykh zadanii [Composition of test questions]. M.: Arena, 2002. 240 p.
- Balykhina T.M. Slovar’ terminov i ponyatii testologii [Testology terms and concepts dictionary]. M.: Izd-vo RUDN, 2000. 164 p.
- Vasil’ev V.I., Demidov A.N., Malyshev N.G., Tyagunova T.N. Metodologicheskie pravila konstruirovaniya komp’yuternykh pedagogicheskikh testov [Methodological rules of designing computer pedagogical tests]. M.: Izd-vo VTU, 2000. 64 p.
- Vasil’ev V.I., Tyagunova T.N. Osnovy kul’tury adaptivnogo testirovaniya [The basics of adaptive testing culture]. M.: Ikar, 2003. 584 p.
- Efremova N.F. Sovremennye testovye tekhnologii v obrazovanii [Modern test technologies in education]: uchebnoe posobie. M.: Logos, 2003. 176 p.
- Kurinin I.N., Nardyuzhev V.I., Nardyuzhev I.V. Komp’yuternoe testirovanie v otsenke uchebnykh dostizhenii studentov [Computer testing in assessing students’ academic achievements]: uchebnometodicheskoe posobie. M.: Izd-vo RUDN, 2008. 308 p.
- Kurinin I.N., Nardyuzhev V.I., Nardyuzhev I.V. Sbornik testovykh zadanii po kursam “Informatika” i “Komp’yuternye tekhnologii v nauke i obrazovanii” [Corpus of test question for courses “Informatics” and “Computer Technologies in Science and Education”]. M.: Izd-vo RUDN, 2010. 306 p.
- Kurinin I.N., Nardyuzhev V.I., Nardyuzhev I.V. Operativnyi statisticheskii analiz rezul’tatov komp’yuternogo testirovaniya v kreditnoi sisteme obucheniya [Operative statistical analysis of the results of computer testing in the credit system of education]. Vestnik Rossijskogo universiteta druzhby narodov. Serija «Informatizacija obrazovanija» [Bulletin of the Russian university of friendship of the people. “Education Informatization” series]. 2013. No. 1. Pp. 115—125.
- Kurinin I.N., Nardyuzhev V.I., Nardyuzhev I.V. Kompleksnaya tekhnologiya komp’yuternogo testirovaniya [Comprehensive technology of computer testing]. Vestnik Rossijskogo universiteta druzhby narodov. Serija «Informatizacija obrazovanija» [Bulletin of the Russian university of friendship of the people. “Education Informatization” series]. 2013. No. 2. Pp. 112—121.
- Kurinin I.N., Marfina V.E., Nardyuzhev V.I., Nardyuzhev I.V. Informatizatsiya prakticheskoi raboty prepodavatelya [Informatization of the teacher’s practical work]. Vestnik Rossijskogo universiteta druzhby narodov. Serija «Informatizacija obrazovanija» [Bulletin of the Russian university of friendship of the people. “Education Informatization” series]. 2015. No. 1. Pp. 42—52.
- Maiorov A.N. Testy shkol’nykh dostizhenii: konstruirovanie, provedenie, ispol’zovanie [School achievements tests: design, administration, usage]. SPb.: Obrazovanie i kul’tura, 1996. 304 p.
- Nardyuzhev V.I., Nardyuzhev I.V. Testirovanie na komp’yuterakh cherez Internet [Computer testing in the internet]. Trudy Tsentra testirovaniya. Vypusk 2. M.: Prometei, 1999. Pp. 139—157.
- Nardyuzhev V.I., Nardyuzhev I.V. Dostoinstva i nedostatki komp’yuternogo adaptivnogo testirovaniya [Advantages and disadvantages of computer adaptive testing]. Razvitie sistemy testirovanija v Rossii: tezisy dokladov 2 Vserossijskoj nauchno-prakticheskoj konferencii [The development of the testing system in Russia: abstracts of 2 all-Russian scientific-practical conference]. M.: Prometei, 2000. Vol. 3. Pp. 47—48.
- Nardyuzhev V.I., Nardyuzhev I.V. Modeli i algoritmy informatsionno-vychislitel’noi sistemy komp’yuternogo testirovaniya [Models and algorithms of information technology computer-based testing system]: monografiya. M.: Prometei, 2000. 148 p.
- Nardyuzhev V.I., Nardyuzhev I.V. Svidetel’stvo ROSPATENT № 2000610068 ot 27 yanvarya 2000 g. ob ofitsial’noi registratsii programmy dlya EVM “Operativnyi statisticheskii analiz rezul’tatov testirovaniya na komp’yuterakh cherez Internet (STATINFO)” [Certificate ROSPATENT No. 2000610068 dated January 27, 2000 on the Official Registration of the Computer Program “Operational Statistical Analysis of Computer-based Test Results in the Internet (STATINFO)”].
- Nardyuzhev V.I., Nardyuzhev I.V. Analiz urovnya komp’yuternoi gramotnosti uchastnikov tsentralizovannogo komp’yuternogo testirovaniya [Analysis of the level of computer literacy of participants in centralized computer testing]. M.: Tsentr testirovaniya Minobrazovaniya Rossii, 2001. Pp. 86—93.
- Nardyuzhev V.I., Nardyuzhev I.V. Sravnenie rezul’tatov tsentralizovannogo testirovaniya na blankakh i na komp’yuterakh [Comparison of the results of centralized testing on blank sheets and on computers]. M.: Narodnoe obrazovanie, 2002. 10 p.
- Nardyuzhev V.I., Nardyuzhev I.V., Marfina V.E., Kurinin I.N. Svidetel’stvo № 2016620662 ot 24 maya 2016 g. o gosudarstvennoi registratsii bazy dannykh “Testovye zadaniya. Komp’yuternye tekhnologii v nauke i obrazovanii” [Certificate No. 2016620662 Dated May 24, 2016 on the State Registration of the Database “Test tasks: Computer Technologies in Science and Education”]. Vydano Federal’noi sluzhboi po intellektual’noi sobstvennosti (RosPatent) [RosPatent].
- Nasledov A. SPSS 19: professional’nyi statisticheskii analiz dannykh [SPSS 19: Professional Statistical Analysis of Data]. SPb.: Piter, 2011. 400 p.
- Neiman Yu.M., Khlebnikov V.A. Vvedenie v teoriyu modelirovaniya i parametrizatsii pedagogicheskikh testov [Introduction to the theory of modeling and parametrization of pedagogical tests]. M.: Prometei, 2000. 168 p.
- Tyurin Yu.N., Makarov A.A. Statisticheskii analiz dannykh na komp’yutere [Statistical analysis of data on the computer]. M.: INFRA-M, 1998. 528 p.
- Chelyshkova M.B. Razrabotka pedagogicheskikh testov na osnove sovremennykh matematicheskikh modelei [Development of pedagogical tests based on modern mathematical models]: uchebnoe posobie. M.: Issledovatel’skii tsentr problem kachestva podgotovki spetsialistov, 1995. 32 p.
Supplementary files
