vavilovВавиловский журнал генетики и селекцииVavilov Journal of Genetics and Breeding2500-3259Institute of Cytology and Genetics of Siberian Branch of the RAS10.18699/VJGB-22-92vavilov-3577Research ArticleСИСТЕМНАЯ КОМПЬЮТЕРНАЯ БИОЛОГИЯSYSTEMS COMPUTATIONAL BIOLOGYАпробация технологии оценки мимики лиц для изучения динамики функциональных состояний человека в ЭЭГ-парадигме покояValidation of a face image assessment technology to study the dynamics of human functional states in the EEG resting-state paradigmhttps://orcid.org/0000-0002-3514-2901СавостьяновА. Н.SavostyanovA. N.

Новосибирск

Novosibirsk

a-sav@mail.ruhttps://orcid.org/0000-0002-8352-5368ВергуновЕ. Г.VergunovE. G.

Новосибирск

Novosibirsk

https://orcid.org/0000-0001-6789-2953СапрыгинА. Е.SapryginA. E.

Новосибирск

Novosibirsk

https://orcid.org/0000-0002-4356-9067ЛебедкинД. А.LebedkinD. A.

Новосибирск

Novosibirsk

Федеральный исследовательский центр Институт цитологии и генетики Сибирского отделения Российской академии наук; Научно-исследовательский институт нейронаук и медицины; Новосибирский национальный исследовательский государственный университет, Гуманитарный институтРоссияInstitute of Cytology and Genetics of the Siberian Branch of the Russian Academy of Sciences; Scientific Research Institute of Neurosciences and Medicine; Institute for the Humanities of Novosibirsk State UniversityRussian FederationНаучно-исследовательский институт нейронаук и медициныРоссияScientific Research Institute of Neurosciences and MedicineRussian FederationФедеральный исследовательский центр Институт цитологии и генетики Сибирского отделения Российской академии наук; Научно-исследовательский институт нейронаук и медициныРоссияInstitute of Cytology and Genetics of the Siberian Branch of the Russian Academy of Sciences; Scientific Research Institute of Neurosciences and MedicineRussian FederationНаучно-исследовательский институт нейронаук и медицины; Новосибирский национальный исследовательский государственный университет, Гуманитарный институтРоссияScientific Research Institute of Neurosciences and Medicine; Institute for the Humanities of Novosibirsk State UniversityRussian Federation202204012023268765772Copyright © Савостьянов А.Н., Вергунов Е.Г., Сапрыгин А.Е., Лебедкин Д.А., 20232023Савостьянов А.Н., Вергунов Е.Г., Сапрыгин А.Е., Лебедкин Д.А.Savostyanov A.N., Vergunov E.G., Saprygin A.E., Lebedkin D.A.This work is licensed under a Creative Commons Attribution 4.0 License.https://vavilov.elpub.ru/jour/article/view/3577

В статье представлены результаты исследования, направленного на поиск ковариат для учета дея тельности имплицитных когнитивных процессов в условиях функционального покоя испытуемых и при демонстрации им собственного или чужого лица в совместном анализе данных ЭЭГ-эксперимента. Предлагаемый подход основан на анализе динамики мышц лица испытуемого по видео. В пилотном исследовании приняли участие 18 здоровых добровольцев. В эксперименте испытуемые, сидя перед экраном, последовательно закрывали глаза (три пробы по 2 минуты) и открывали их (также три пробы между периодами закрытых глаз) либо перед пустым 

активности мышц лица испытуемых по их видео с открытыми глазами для получения ковариат, которые можно включать в последующую обработку совместно с ЭЭГ-коррелятами в нейрокогнитивных экспериментах с парадигмой, не предполагающей выполнение активных когнитивных заданий (resting-state conditions). Показано, что пол испытуемого, статус экрана (пустой, собственное/чужое лицо), номер пробы связаны с различиями в мимической активности лица и могут выступать искомыми ковариатами. Сделан вывод, что анализ динамики мимической активности по видео с открытыми глазами может быть дополнительным методом в нейрокогнитивных исследованиях для изучения имплицитных когнитивных процессов, связанных с восприятием изображения себя и другого, в парадигме функционального покоя.

The article presents the results of a study aimed at finding covariates to account for the activity of implicit cognitive processes in conditions of functional rest of the subjects and during them being presented their own or someone else’s face in a joint analysis of EEG experiment data. The proposed approach is based on the analysis of the dynamics of the facial muscles of the subject recorded on video. The pilot study involved 18 healthy volunteers. In the experiment, the subjects were sitting in front of a computer screen and performed the following task: sequentially closed their eyes (three trials of 2 minutes each) and opened them (three trials of the same duration between periods of closed eyes) when the screen was either empty or when it was showing a video recording of their own face or the face of an unfamiliar person of the same gender as the participant. EEG, ECG and a video of the face were recorded for all subjects. In the work a separate subtask of the study was also addressed: validating a technique for assessing the dynamics of the subjects’ facial muscle activity using the recorded videos of the “eyes open” trials to obtain covariates that can be included in subsequent processing along with EEG correlates in neurocognitive experiments with a paradigm that does not involve the performance of active cognitive tasks (“resting-state conditions”). It was shown that the subject’s gender, stimulus type (screen empty or showing own/other face), trial number are accompanied by differences in facial activity and can be used as study-specific covariates. It was concluded that the analysis of the dynamics of facial activity based on video recording of “eyes open” trials can be used as an additional method in neurocognitive research to study implicit cognitive processes associated with the perception of oneself and other, in the functional rest paradigm.

нейрокогнитивные исследованиясвое и чужое лицоЭЭГ-коррелятыковариатыимплицитные когнитивные процессысамовосприятиеneurocognitive studiesown and other faceEEG correlatescovariatesimplicit cognitive processesselfperceptionData collection and processing were supported by the Russian Science Foundation, grant No. 22-15-00142 “fMRI and EEG correlates of focus on oneself as a predisposition factor to affective disorders”. The work of A.N. Savostyanov and A.E. Saprygin on data preprocessing was financed from the funds of the budget project of the Institute of Cytology and Genetics of the Siberian Branch of the Russian Academy of Sciences No. FWNR-2022-0020 “System biology and bioinformatics: reconstruction, analysis and modeling of the structural and functional organization and evolution of human, animal, plant and microorganism gene networks”. The authors thank V.E. Kalikin for the software implementation of the tool for analyzing AU by face image based on the OpenFace framework.ReferencesBiswal B.B. Resting state fMRI: a personal history. Neuroimage. 2012; 62(2):938-944. DOI 10.1016/j.neuroimage.2012.01.090.Biswal B.B. Resting state fMRI: a personal history. Neuroimage. 2012; 62(2):938-944. DOI 10.1016/j.neuroimage.2012.01.090.Bringas­Vega M.L., Michel C.M., Saxena S., White T., Valdes­Sosa P.A. Neuroimaging and global health. Neuroimage. 2022;260:119458. DOI 10.1016/j.neuroimage.2022.119458.Bringas­Vega M.L., Michel C.M., Saxena S., White T., Valdes­Sosa P.A. Neuroimaging and global health. Neuroimage. 2022;260:119458. DOI 10.1016/j.neuroimage.2022.119458.Engemann D.A., Mellot A., Hochenberger R., Banville H., Sabbagh D., Gemein L., Ball T., Gramfort A. A reusable benchmark of brain­age prediction from M/EEG resting­state signals. Neuroimage. 2022; 262:119521. DOI 10.1016/j.neuroimage.2022.119521.Engemann D.A., Mellot A., Hochenberger R., Banville H., Sabbagh D., Gemein L., Ball T., Gramfort A. A reusable benchmark of brain­age prediction from M/EEG resting­state signals. Neuroimage. 2022; 262:119521. DOI 10.1016/j.neuroimage.2022.119521.Greicius M.D., Flores B.H., Menon V., Glover G.H., Solvason H.B., Kenna H., Reiss A.L., Schatzberg A.F. Resting-state functional connectivity in major depression: abnormally increased contributions from subgenual cingulate cortex and thalamus. Biol. Psychiatry. 2007;62(5):429-437. DOI 10.1016/j.biopsych.2006.09.020.Greicius M.D., Flores B.H., Menon V., Glover G.H., Solvason H.B., Kenna H., Reiss A.L., Schatzberg A.F. Resting-state functional connectivity in major depression: abnormally increased contributions from subgenual cingulate cortex and thalamus. Biol. Psychiatry. 2007;62(5):429-437. DOI 10.1016/j.biopsych.2006.09.020.Kabbara A., Paban V., Weill A., Modolo Ju., Hassan M. Brain network dynamics correlate with personality traits. Brain Connect. 2020; 10(3):108­120. DOI 10.1089/brain.2019.0723.Kabbara A., Paban V., Weill A., Modolo Ju., Hassan M. Brain network dynamics correlate with personality traits. Brain Connect. 2020; 10(3):108­120. DOI 10.1089/brain.2019.0723.Khanin Yu.L. Quick Guide to C.D. Spielberger’s Scale of State and Trait Anxiety. Leningrad, 1976. (in Russian)Khanin Yu.L. Quick Guide to C.D. Spielberger’s Scale of State and Trait Anxiety. Leningrad, 1976. (in Russian)Knyazev G.G., Savostyanov A.N., Volf N.V., Liou M., Bocharov A.V. EEG correlates of spontaneous self­referential thoughts: a crosscul tural study. Int. J. Psychophysiol. 2012;86(2):173-181. DOI 10.1016/j.ijpsycho.2012.09.002.Knyazev G.G., Savostyanov A.N., Volf N.V., Liou M., Bocharov A.V. EEG correlates of spontaneous self­referential thoughts: a crosscul tural study. Int. J. Psychophysiol. 2012;86(2):173-181. DOI 10.1016/j.ijpsycho.2012.09.002.Kovaleva V.Yu., Pozdnyakov A.A., Litvinov Yu.N., Efimov V.M. Estimation of the congruence between morphogenetic and molecular­genetic modules of gray voles Microtus s.l. variability along a climatic gradient. Ecol. Genet. 2019;17(2):21-34. DOI 10.17816/ecogen17221­34.Kovaleva V.Yu., Pozdnyakov A.A., Litvinov Yu.N., Efimov V.M. Estimation of the congruence between morphogenetic and molecular­genetic modules of gray voles Microtus s.l. variability along a climatic gradient. Ecol. Genet. 2019;17(2):21-34. DOI 10.17816/ecogen17221­34.Li M., Wang Y., Lopez-Naranjo C., Hu S., Reyes R.C.G., Paz-Linares D., Areces-Gonzalez A., Hamid A.I.A., Evans A.C., Savostyanov A.N., Calzada-Reyes A., Villringer A., Tobon-Quintero C.A., Garcia-Agustin D., Yao D., Dong L., Aubert-Vazquez E., Reza F., Razzaq F.A., Omar H., Abdullah J.M., Galler J.R., Ochoa-Gomez J.F., Prichep L.S., Galan-Garcia L., Morales-Chacon L., Valdes-Sosa M.J., Tröndle M., Zulkifly M.F.M., Rahman M.R.B.A., Milakhina N.S., Langer N., Rudych P., Koenig T., Virues-Alba T.A., Lei X., Bringas-Vega M.L., Bosch-Bayard J.F., Valdes-Sosa P.A. Harmonized-Multinational qEEG norms (HarMNqEEG). Neuroimage. 2022;256:119190. DOI 10.1016/j.neuroimage.2022.119190.Li M., Wang Y., Lopez-Naranjo C., Hu S., Reyes R.C.G., Paz-Linares D., Areces-Gonzalez A., Hamid A.I.A., Evans A.C., Savostyanov A.N., Calzada-Reyes A., Villringer A., Tobon-Quintero C.A., Garcia-Agustin D., Yao D., Dong L., Aubert-Vazquez E., Reza F., Razzaq F.A., Omar H., Abdullah J.M., Galler J.R., Ochoa-Gomez J.F., Prichep L.S., Galan-Garcia L., Morales-Chacon L., Valdes-Sosa M.J., Tröndle M., Zulkifly M.F.M., Rahman M.R.B.A., Milakhina N.S., Langer N., Rudych P., Koenig T., Virues-Alba T.A., Lei X., Bringas-Vega M.L., Bosch-Bayard J.F., Valdes-Sosa P.A. Harmonized-Multinational qEEG norms (HarMNqEEG). Neuroimage. 2022;256:119190. DOI 10.1016/j.neuroimage.2022.119190.Milakhina N.S., Tamozhnikov S.S., Proshina E.A., Karpova A.G., Savostyanov A.N., Afonasieva E.B. Delta and gamma activity of resting­state EEG as one of the markers of risk of depressive disorders in migrants of subpolar and polar regions of Siberia. In: 2020 Cognitive Sciences, Genomics and Bioinformatics (CSGB). Novosibirsk, 2020;90-92. DOI 10.1109/CSGB51356.2020.9214596.Milakhina N.S., Tamozhnikov S.S., Proshina E.A., Karpova A.G., Savostyanov A.N., Afonasieva E.B. Delta and gamma activity of resting­state EEG as one of the markers of risk of depressive disorders in migrants of subpolar and polar regions of Siberia. In: 2020 Cognitive Sciences, Genomics and Bioinformatics (CSGB). Novosibirsk, 2020;90-92. DOI 10.1109/CSGB51356.2020.9214596.Nikolaeva E.I., Vergunov E.G. Evaluation of the relationship of facial expression asymmetry with inhibitory control and lateral preferences in physically active men. Asimmetriya = Asymmetry. 2021; 15(4):38-53. DOI 10.25692/ASY.2021.15.4.004. (in Russian)Nikolaeva E.I., Vergunov E.G. Evaluation of the relationship of facial expression asymmetry with inhibitory control and lateral preferences in physically active men. Asimmetriya = Asymmetry. 2021; 15(4):38-53. DOI 10.25692/ASY.2021.15.4.004. (in Russian)Polunin D., Shtaiger I., Efimov V. JACOBI4 software for multivariate analysis of biological data. bioRxiv. 2019;803684. DOI 10.1101/803684.Polunin D., Shtaiger I., Efimov V. JACOBI4 software for multivariate analysis of biological data. bioRxiv. 2019;803684. DOI 10.1101/803684.Privodnova E.Yu., Slobodskaya H.R., Bocharov A.V., Saprigyn A.E., Knyazev G.G. Default mode network connections supporting intraindividual variability in typically developing primary school children: An EEG study. Neuropsychology. 2020;34(7):811­823. DOI 10.1037/neu0000699.Privodnova E.Yu., Slobodskaya H.R., Bocharov A.V., Saprigyn A.E., Knyazev G.G. Default mode network connections supporting intraindividual variability in typically developing primary school children: An EEG study. Neuropsychology. 2020;34(7):811­823. DOI 10.1037/neu0000699.Proshina E.A., Savostyanov A.N., Bocharov A.V., Knyazev G.G. Effect of 5­HTTLPR on current source density, connectivity, and topological properties of resting state EEG networks. Brain Res. 2018; 1697:67-75. DOI 10.1016/j.brainres.2018.06.018.Proshina E.A., Savostyanov A.N., Bocharov A.V., Knyazev G.G. Effect of 5­HTTLPR on current source density, connectivity, and topological properties of resting state EEG networks. Brain Res. 2018; 1697:67-75. DOI 10.1016/j.brainres.2018.06.018.Ränner S., Lindgren F., Geladi P., Wold S. A PLS kernel algorithm for data sets with many variables and fewer objects. Part 1: Theory and algorithm. J. Chemometrics. 1994;8(2):111­125. DOI 10.1002/cem.1180080204.Ränner S., Lindgren F., Geladi P., Wold S. A PLS kernel algorithm for data sets with many variables and fewer objects. Part 1: Theory and algorithm. J. Chemometrics. 1994;8(2):111­125. DOI 10.1002/cem.1180080204.Rohlf F.J., Corti M. Use of two-block partial least-squares to study covariation in shape. Syst. Biol. 2000;49(4):740­753. DOI 10.1080/106351500750049806.Rohlf F.J., Corti M. Use of two-block partial least-squares to study covariation in shape. Syst. Biol. 2000;49(4):740­753. DOI 10.1080/106351500750049806.Saprygin A., Lebedkin D., Savostyanov A., Vergounov E. Behavioral and neurophysiological study of subject’s personality traits under recognition of sentences about self and others. In: Bioinformatics of Genome Regulation and Structure/Systems Biology (BGRS/ SB­2022). Abstracts the Thirteenth International Multiconfer ence, Novosibirsk, 04–08 July 2022. Novosibirsk, 2022;950. DOI 10.18699/SBB-2022-556.Saprygin A., Lebedkin D., Savostyanov A., Vergounov E. Behavioral and neurophysiological study of subject’s personality traits under recognition of sentences about self and others. In: Bioinformatics of Genome Regulation and Structure/Systems Biology (BGRS/ SB­2022). Abstracts the Thirteenth International Multiconfer ence, Novosibirsk, 04–08 July 2022. Novosibirsk, 2022;950. DOI 10.18699/SBB-2022-556.Snyder A.Z., Raichle M.E. A brief history of the resting state: the Washington University perspective. Neuroimage. 2012;62(2):902-910. DOI 10.1016/j.neuroimage.2012.01.044.Snyder A.Z., Raichle M.E. A brief history of the resting state: the Washington University perspective. Neuroimage. 2012;62(2):902-910. DOI 10.1016/j.neuroimage.2012.01.044.Volf N.V., Belousova L.V., Knyazev G.G., Kulikov A.V. Gender differences in association between serotonin transporter gene polymorphism and resting­state EEG activity. Neuroscience. 2015;284:513521. DOI 10.1016/j.neuroscience.2014.10.030.Volf N.V., Belousova L.V., Knyazev G.G., Kulikov A.V. Gender differences in association between serotonin transporter gene polymorphism and resting­state EEG activity. Neuroscience. 2015;284:513521. DOI 10.1016/j.neuroscience.2014.10.030.

The authors declare that there are no conflicts of interest present.