Digital Tools for Assessing Children's Mental Development: Validity in Visual Working Memory Testing


Дәйексөз келтіру

Толық мәтін

Аннотация

Diagnostics of mental development is a prerequisite for the timely identification of potential developmental risks and their correction in children of all ages. The development and implementation of digital versions of professional diagnostic methods will make it possible to ensure their availability, significantly reduce the procedural burden and improve the quality of the collected data. This study is aimed at assessing the diagnostic capabilities and psychometric characteristics of the digital version of the NEPSY II battery subtest: Memory for Designs. The study was conducted according to an intra-individual scheme on a sample of 62 preschool children. The sample was divided into two groups depending on the sequence of the traditional and digital versions of the methodology. The results confirmed the high consistency and internal reliability of both versions. Medium and strong positive correlations between the indicators of the method were found, regardless of the method of presentation. No significant differences were recorded in the results of visual working memory diagnostics depending on the form of the presented method. The results obtained open up new prospects for further research in the field of child development; in particular, they allow large-scale screening studies using the digital version of the methodology. However, it is important to remember that each digital tool must undergo a testing procedure before being used in large-scale screening studies, which includes a more detailed assessment of its psychometric properties and ergonomics.

Авторлар туралы

Margarita Gavrilova

Lomonosov Moscow State University

Email: gavrilovamrg@gmail.com
ORCID iD: 0000-0002-8458-5266
SPIN-код: 6955-9705

Ph.D. in Psychology, Junior Researcher of the Department of Psychology of Education and Pedagogy

1 Leninskie Gory, Moscow, 119991, Russian Federation

Margarita Aslanova

Lomonosov Moscow State University

Хат алмасуға жауапты Автор.
Email: simomargarita@ya.ru
ORCID iD: 0000-0002-3150-221X
SPIN-код: 3764-4682

Researcher of the Department of Psychology of Education and Pedagogy

1 Leninskie Gory, Moscow, 119991, Russian Federation

Zlata Airapetyan

Lomonosov Moscow State University

Email: zlata.a.v@yandex.ru
ORCID iD: 0000-0002-4466-9799

Junior Researcher of the Department of Psychology of Education and Pedagogy

1 Leninskie Gory, Moscow, 119991, Russian Federation

Әдебиет тізімі

  1. Almazova, O. V., Bukhalenkova, D. A., & Veraksa, A. N. (2019). Assessment of the level of development of executive functions in the senior preschool age. Psychology. Journal of Higher School of Economics, 16(2), 302–317. (In Russ.) https://doi.org/10.17323/1813-8918-2019-2-302-317
  2. Babanin, L. N. (2010). The problem of equivalence of traditional and computerized psychological techniques. In V. A. Barabanshchikov (Ed.). Experimental Psychology in Russia: Traditions and Prospects (pp. 77–80). Moscow: Institute of Psychology of Russian Academy of Sciences. (In Russ.)
  3. Barkley, R. A. (2001). The executive functions and self-regulation: An evolutionary neuropsychological perspective. Neuropsychology Review, 11(1), 1–29. https://doi.org/10.1023/a:1009085417776
  4. Butcher, J. N., Perry, J. N., & Atlis, M. M. (2000). Validity and utility of computer-based test interpretation. Psychological Assessment, 12(1), 6–18. https://doi.org/10.1037/1040-3590.12.1.6
  5. Chervinskaya, K. R. (2003). Computer psychodiagnostics. Saint Petersburg: Rech' Publ. (In Russ.)
  6. Colom, R., Abad, F. J., Quiroga, M.Á., Shih, P. C., & Flores-Mendoza, C. (2008). Working memory and intelligence are highly related constructs, but why? Intelligence, 36(6), 584–606. https://doi.org/10.1016/j.intell.2008.01.002
  7. Conway, A. R. A., Cowan, N., Bunting, M. F., Therriault, D. J., & Minkoff, S. R. B. (2002). A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence, 30(2), 163–183. https://doi.org/10.1016/s0160-2896(01)00096-4
  8. Diamond, A., & Lee, K. (2011). Interventions shown to aid executive function development in children 4 to 12 years old. Science, 333(6045), 959–964. https://doi.org/10.1126/science.1204529
  9. Ermakov, S. S. (2016). Special features of intellectual abilities computer diagnostics of pupils of 6–9 classes. Psychological Science and Education psyedu.ru, 8(4), 199–207. (In Russ.) https://doi.org/10.17759/psyedu.2016080419
  10. Fray, P. J., Robbins, T. W., & Sahakian, B. J. (1996). Neuorpsychiatyric applications of CANTAB. International Journal of Geriatric Psychiatry, 11(4), 329–336. https://doi.org/10.1002/(sici)1099-1166(199604)11:4<329::aid-gps453>3.0.co;2-6
  11. Glozman, J. M., & Plotnikova, A. (2021). Learning disabilities in primary school. How to diagnose and remediate the difficulties with a team approach: The first results. Psychology in Russia: State of the Art, 14(4), 38–50. https://doi.org/10.11621/pir.2021.0403
  12. Harder, L., Hernandez, A., Hague, C., Neumann, J., McCreary, M., Cullum, C. M., & Greenberg, B. (2020). Home-based pediatric teleneuropsychology: A validation study. Archives of Clinical Neuropsychology, 35(8), 1266–1275. https://doi.org/10.1093/arclin/acaa070
  13. Jaeggi, S. M., Buschkuehl, M., Jonides, J., & Shah, P. (2011). Short- and long-term benefits of cognitive training. Proceedings of the National Academy of Sciences, 108(25), 10081–10086. https://doi.org/10.1073/pnas.1103228108
  14. Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B. (2010). The concurrent validity of the N-back task as a working memory measure. Memory, 18(4), 394–412. https://doi.org/10.1080/09658211003702171
  15. Kane, M. J., Hambrick, D. Z., Tuholski, S. W., Wilhelm, O., Payne, T. W., & Engle, R. W. (2004). The generality of working memory capacity: A latent-variable approach to verbal and visuospatial memory span and reasoning. Journal of Experimental Psychology: General, 133(2), 189–217. https://doi.org/10.1037/0096-3445.133.2.189
  16. Korkman M., Kirk, U., Kemp S. (2007). NEPSY II. Administrative manual (2nd ed.). San Antonio, TX : Harcourt Assessment.
  17. Kronenberger, W. G., Montgomery, C. J., Henning, S. C., Ditmars, A., Johnson, C. A., Herbert, C. J., & Pisoni, D. B. (2021). Remote assessment of verbal memory in youth with cochlear implants during the COVID-19 pandemic. American Journal of Speech-Language Pathology, 30(2), 740–747. https://doi.org/10.1044/2021_ajslp-20-00276
  18. Luciana, M. (2003). Practitioner review: Computerized assessment of neuropsychological function in children: Clinical and research applications of the Cambridge Neuropsychological Testing Automated Battery (CANTAB). Journal of Child Psychology and Psychiatry, 44(5), 649–663. https://doi.org/10.1111/1469-7610.00152
  19. Luciana, M., & Nelson, C. A. (2000). Neurodevelopmental assessment of cognitive function using CANTAB: Validation and future goals. In M. Ernst, J. M. Rumsey, (Eds.). Functional Neuroimaging in Child Psychiatry (pp. 379–397). Cambridge: Cambridge University Press. https://doi.org/10.1017/cbo9780511470998.029
  20. Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 390(6657), 279–281. https://doi.org/10.1038/36846
  21. Milner, B. (1971). Interhemispheric differences in the localization of psycho- logical processes in man. British Medical Bulletin, 27(3), 272–277. https://doi.org/10.1093/oxfordjournals.bmb.a070866
  22. Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
  23. Morosanova, V. I. (2021). Conscious self-regulation as a metaresource for achieving goals and solving the problems of human activity. Lomonosov Psychology Journal, (1), 4–37. (In Russ.) https://doi.org/10.11621/vsp.2021.01.01
  24. Otero, T. M. (2017). Brief review of fluid reasoning: Conceptualization, neurobasis, and applications. Applied Neuropsychology: Child, 6(3), 204–211. https://doi.org/10.1080/21622965.2017.1317484
  25. Pind, J., Gunnarsdóttir, E. K., & Jóhannesson, H. S. (2003). Raven’s Standard Progressive Matrices: New school age norms and a study of the test’s validity. Personality and Individual Differences, 34(3), 375–386. https://doi.org/10.1016/s0191-8869(02)00058-2
  26. Raiford, S. E., Zhang, O., Drozdick, L. W., Getz, K., Wahlstrom, D., Gabel, A., Holdnack, J. A., & Daniel, M. (2016). WISC–V Coding and symbol search in digital format: Reliability, validity, special group studies, and interpretation (Q-interactive Technical Report 12). London: Pearson.
  27. Robinson, S. J., & Brewer, G. (2016). Performance on the traditional and the touch screen, tablet versions of the Corsi Block and the Tower of Hanoi tasks. Computers in Human Behavior, 60, 29–34. https://doi.org/10.1016/j.chb.2016.02.047
  28. Rosenqvist, J., Lahti-Nuuttila, P., Urgesi, C., Holdnack, J., Kemp, S. L., & Laasonen, M. (2017). Neurocognitive functions in 3- to 15-year-old children: An international comparison. Journal of the International Neuropsychological Society, 23(4), 367–380. https://doi.org/10.1017/s1355617716001193
  29. Ruffini, C., Tarchi, C., Morini, M., Giuliano, G., & Pecini, C. (2022). Tele-assessment of cognitive functions in children: A systematic review. Child Neuropsychology, 28(6), 709–745. https://doi.org/10.1080/09297049.2021.2005011
  30. Sim, G., & Horton, M. (2005). Performance and attitude of children in computer based versus paper based testing. In P. Kommers & G. Richards (Eds.). EdMedia + Innovate Learning. Proceedings of ED-MEDIA 2005 – World Conference on Educational Multimedia, Hypermedia & Telecommunications (pp. 3610–3614). Montreal, Canada: Association for the Advancement of Computing in Education (AACE).
  31. Solovieva, Yu., & Quintanar, L. (2015). Qualitative syndrome analysis by neuropsychological assessment in preschoolers with attention deficit disorder with hyperactivity. Psychology in Russia: State of the Art, 8(3), 112–124. https://doi.org/10.11621/pir.2015.0309
  32. Syväoja, H. J., Tammelin, T. H., Ahonen, T., Räsänen, P., Tolvanen, A., Kankaanpää, A., & Kantomaa, M. T. (2015). Internal consistency and stability of the CANTAB neuro-psychological test battery in children. Psychological Assessment, 27(2), 698–709. https://doi.org/10.1037/a0038485
  33. Utochkin, I. S., Yurevich, M. A., & Bulatova, M. E. (2016). Visual working memory: Methods, research, theory. The Russian Journal of Cognitive Science, 3(3), 58–76. (In Russ.)
  34. Veraksa, A., Almazova, O., & Bukhalenkova, D. (2020). Studying executive functions in senior preschoolers. PsyCh Journal, 9(1), 144–146. https://doi.org/10.1002/pchj.310
  35. Veraksa, A. N., & Chichinina, E. A. (2022). Comparison of media use among senior preschool children before and during the COVID-19 pandemic. Preschool Education Today, (2), 30–39. (In Russ.) https://doi.org/10.24412/1997-9657-2022-2110-30-39
  36. Veraksa, A. N., Almazova, O. V., & Bukhalenkova, D. A. (2020). Executive functions assessment in senior preschool age: A battery of methods. Psikhologicheskii Zhurnal, 41(6), 108–118. (In Russ.) https://doi.org/10.31857/S020595920012593-8
  37. Veraksa, A. N., Oshchepkova, E. S., Bukhalenkova, D. A., & Kartushina, N. A. (2019). The relationship of executive functions and speech production in senior preschool children: Working memory and storytelling. Clinical Psychology and Special Education, 8(3), 56–84. (In Russ.) https://doi.org/10.17759/cpse.2019080304
  38. Veraksa, N. E., Aslanova, M. S., Tarasova, K. S., & Klimenko, V. A. (2023). Technique for diagnosing cognitive flexibility in preschoolers: Comparison of blank and digital forms. RUDN Journal of Psychology and Pedagogics, 20(1), 105–125. (In Russ.) https://doi.org/10.22363/2313-1683-2023-20-1-105-125
  39. Veraksa, N. E., Bukhalenkova, D. A., Veraksa, A. N., & Chichinina, E. A. (2022). Rela-tionship between the use of digital devices and executive functions development in preschool children. Psikhologicheskii Zhurnal, 43(1), 51–59. (In Russ.) https://doi.org/10.31857/S020595920018769-1
  40. Verhagen, J., & Leseman, P. (2016). How do verbal short-term memory and working memory relate to the acquisition of vocabulary and grammar? A comparison between first and second language learners. Journal of Experimental Child Psychology, 141, 65–82. https://doi.org/10.1016/j.jecp.2015.06.015
  41. Vrana, S. R., & Vrana, D. T. (2017). Can a computer administer a Wechsler Intelligence Test? Professi-onal Psychology: Research and Practice, 48(3), 191–198. https://doi.org/10.1037/pro0000128
  42. Vuontela, V., Steenari, M.-R., Carlson, S., Koivisto, J., Fjällberg, M., & Aronen, E. T. (2003). Audiospatial and visuospatial working memory in 6–13-year old school children. Learning & Memory, 10(1), 74–81. https://doi.org/10.1101/lm.53503
  43. Wilken, P., & Ma, W. J. (2004). A detection theory account of change detection. Journal of Vision, 4(12), 1120–1135. https://doi.org/10.1167/4.12.11
  44. Williams, J. E., & McCord, D. M. (2006). Equivalence of standard and computerized versions of the Raven Progressive Matrices Test. Computers in Human Behavior, 22(5), 791–800. https://doi.org/10.1016/j.chb.2004.03.005
  45. Xanthopoulou, M., Kokalia, G., & Drigas, A. (2019). Applications for children with autism in preschool and primary education. International Journal of Recent Contributions from Engineering, Science & IT (IJES), 7(2), 4–16. https://doi.org/10.3991/ijes.v7i2.10335
  46. Zhang, W., & Luck, S. J. (2008). Discrete fixed-resolution representations in visual working memory. Nature, 453(7192), 233–235. https://doi.org/10.1038/nature06860

Қосымша файлдар

Қосымша файлдар
Әрекет
1. JATS XML

Согласие на обработку персональных данных с помощью сервиса «Яндекс.Метрика»

1. Я (далее – «Пользователь» или «Субъект персональных данных»), осуществляя использование сайта https://journals.rcsi.science/ (далее – «Сайт»), подтверждая свою полную дееспособность даю согласие на обработку персональных данных с использованием средств автоматизации Оператору - федеральному государственному бюджетному учреждению «Российский центр научной информации» (РЦНИ), далее – «Оператор», расположенному по адресу: 119991, г. Москва, Ленинский просп., д.32А, со следующими условиями.

2. Категории обрабатываемых данных: файлы «cookies» (куки-файлы). Файлы «cookie» – это небольшой текстовый файл, который веб-сервер может хранить в браузере Пользователя. Данные файлы веб-сервер загружает на устройство Пользователя при посещении им Сайта. При каждом следующем посещении Пользователем Сайта «cookie» файлы отправляются на Сайт Оператора. Данные файлы позволяют Сайту распознавать устройство Пользователя. Содержимое такого файла может как относиться, так и не относиться к персональным данным, в зависимости от того, содержит ли такой файл персональные данные или содержит обезличенные технические данные.

3. Цель обработки персональных данных: анализ пользовательской активности с помощью сервиса «Яндекс.Метрика».

4. Категории субъектов персональных данных: все Пользователи Сайта, которые дали согласие на обработку файлов «cookie».

5. Способы обработки: сбор, запись, систематизация, накопление, хранение, уточнение (обновление, изменение), извлечение, использование, передача (доступ, предоставление), блокирование, удаление, уничтожение персональных данных.

6. Срок обработки и хранения: до получения от Субъекта персональных данных требования о прекращении обработки/отзыва согласия.

7. Способ отзыва: заявление об отзыве в письменном виде путём его направления на адрес электронной почты Оператора: info@rcsi.science или путем письменного обращения по юридическому адресу: 119991, г. Москва, Ленинский просп., д.32А

8. Субъект персональных данных вправе запретить своему оборудованию прием этих данных или ограничить прием этих данных. При отказе от получения таких данных или при ограничении приема данных некоторые функции Сайта могут работать некорректно. Субъект персональных данных обязуется сам настроить свое оборудование таким способом, чтобы оно обеспечивало адекватный его желаниям режим работы и уровень защиты данных файлов «cookie», Оператор не предоставляет технологических и правовых консультаций на темы подобного характера.

9. Порядок уничтожения персональных данных при достижении цели их обработки или при наступлении иных законных оснований определяется Оператором в соответствии с законодательством Российской Федерации.

10. Я согласен/согласна квалифицировать в качестве своей простой электронной подписи под настоящим Согласием и под Политикой обработки персональных данных выполнение мною следующего действия на сайте: https://journals.rcsi.science/ нажатие мною на интерфейсе с текстом: «Сайт использует сервис «Яндекс.Метрика» (который использует файлы «cookie») на элемент с текстом «Принять и продолжить».