RU2794989C1 - Method for assessing cognitive and behavioral functions of a subject using virtual reality technologies - Google Patents

Abstract

FIELD: personal qualities developing; virtual reality technology.

SUBSTANCE: invention relates to medicine, specifically to a method for assessing cognitive-behavioral functions of the subject using virtual reality technologies. At the initial stage, sensors for physiological parameters monitoring, device for virtual reality (1), headphones (2), VR gloves (7) and sensors for the attitude of body parts in space (6) are put on the subject. The control device (3) transmits electrical signals containing interactive audiovisual content to the headphones by means of control commands. Situation is simulated using content of modeling situations applications database to evaluate cognitive-behavioral functions, which are an interactive environment with the possibility of interacting with virtual elements and accompanying interactions with audiovisual effects. At the same time, data on the reaction of the subject and data from the sensors are transmitted in the form of electrical signals to the visualization device (4). After situation simulation is completed, measured data of the attitude of body parts in space and physiological parameters of the subject are transferred to the database of subject behavior analysis results. The database is designed to store specified measurements, calculate the increments of the specified measurements values in case of repeated simulation of the situation by the subjects, and transfer them to the hardware comparison device. The comparison device is designed in the form of a set of threshold devices with inputs connected to the database of the subject behavior analysis results, and outputs combined by the "AND" element. The output of the comparison device is connected to the visualization device. The comparison device is adjusted by selecting a finite set of threshold devices and setting each threshold device to a threshold value characterizing the required development of the trained function or the personal quality of the subject. The comparison device is designed to compare the results of the above measurements with reference values and to output information with assessment of required cognitive-behavioral functions development in the subject.

EFFECT: increased accuracy and reliability of development assessment of the required cognitive-behavioral functions of the subject.

3 cl, 1 dwg

Description

The invention relates to methods for developing the personal qualities of a person and the cognitive-behavioral functions of the body through virtual reality technology [A61B 5/00, G06Q 10/10].

The COGNITIVE FUNCTIONS ASSESSMENT SYSTEM AND THE COGNITIVE FUNCTIONS ASSESSMENT METHODOLOGY [KR 20220062197 A 06.11.2020] are known from the level. The cognitive assessment system according to an embodiment of the present invention provides the subject with a cognitive assessment program implemented in a plurality of types of games, and provides the subject with visual and auditory information when the subject plays a specific event game. The system includes a control module for providing, receiving feedback data from a subject, and a control module for storing feedback data and calculating a subject's cognitive function index based on the feedback data. The scoring system includes the reaction time and the percentage of correct answers, the index of cognitive function is calculated as a value obtained by statistical analysis of the mean and variance of at least one of the reaction time and the percentage of correct answers.

The disadvantage of the analogue is the low accuracy of the assessment of cognitive functions due to the fact that the subject is affected only by visual and auditory information. At the same time, at this stage of the development of the state of the art, there are technical means that allow a deeper immersion of the subject in an interactive environment that is as close as possible to real conditions, such means are, for example, augmented and virtual reality devices.

The closest in technical essence is the METHOD OF ANALYZING THE BEHAVIOR OF THE SUBJECT TO REVEAL ITS PSYCHOLOGICAL PECULIARITIES THROUGH VIRTUAL REALITY TECHNOLOGIES [RU 2766391, publ. 03/15/2022] A method for analyzing the behavior of the subject to identify his psychological characteristics using virtual reality technologies, characterized in that initially the subject is put on sensors for monitoring physiological parameters, as well as a device for virtual reality and headphones, on which, from the control device, through the control commands, transmit electrical signals containing interactive audiovisual content that simulates a stressful situation, at the same time, data on the reaction of the subject and data from sensors are transmitted in the form of electrical signals to the visualization device, then, during the diagnostic process, the content of the audiovisual content is dynamically changed by creating new interactive elements containing audiovisual content, with their subsequent transformation into an electrical signal and transmission by means of control commands from the control element through the control device to the device for virtual reality and headphones, thereby modifying the conditions of the stress situation depending on the results of measurements of sensors for monitoring physiological parameters and reactions subject by using a database of applications for modeling various situations for diagnosing personal qualities, which is an interactive environment made with the ability to interact with virtual elements and accompany interactions with audiovisual effects, an application with a database of interactive elements, made with the ability to embed any element in a running application for simulation of various situations, with the ability to create interactive elements and subsequent integration into a running application for modeling various situations, providing at any time access to the entire set of interactive elements from the application with a database of interactive elements, regardless of the initially launched application that modulates stress situation, and automatic real-time analysis of data from sensors in the control device, as well as on the basis of an analysis of the issuance of recommendations to specialized specialists on correcting the conditions of a stressful situation.

The main technical problem of the analog and prototype is the low accuracy of assessing the development of the required cognitive-behavioral functions in the subject due to the fact that the simulation of a stressful situation with fixing the values of the sensors of physiological parameters occurs once, and the analysis of the subject's behavior is implemented by an expert.

The objective of the invention is to eliminate the disadvantages of the prototype.

The technical result of the invention is to increase the accuracy of assessing the development of the required cognitive-behavioral functions in the subject.

The specified technical result is achieved due to the fact that the method for assessing the cognitive-behavioral functions of the subject using virtual reality technologies, characterized by the fact that at the initial stage, the subject is put on sensors for monitoring physiological parameters, as well as a device for virtual reality, headphones, on which from the control device by means of control commands, electrical signals are transmitted containing interactive audiovisual content that simulates a situation, by using a database of applications for modeling situations to evaluate cognitive-behavioral functions, which are an interactive environment made with the possibility of interacting with virtual elements and accompanying interactions with audiovisual effects, simultaneously with Thus, the data on the reaction of the subject and data from the sensors are transmitted in the form of electrical signals to the visualization device, characterized in that the subject is also put on VR gloves and sensors of the spatial position of body parts, after the simulation of the situation is completed, the measurement data of the spatial position of body parts and physiological parameters of the subject are transferred to the database of the results of the analysis of the behavior of the subject, made with the possibility of storing the indicated measurements, calculating the increments of the values of the indicated measurements during repeated simulation of the situation by the subjects and transferring them to a hardware-implemented comparison device, made in the form of a set of threshold devices, the inputs of which are connected to the database of results analysis of the subject's behavior, and the outputs are combined by the "AND" element, while the output of the comparison device is connected to the visualization device, while by selecting a finite set of threshold devices and setting each threshold device to a threshold value that characterizes the required development of the trained function or the personal quality of the subject, the setting is carried out a comparison device configured to compare the results of the above measurements with reference values and output information with an assessment of the development of the required cognitive-behavioral functions in the subject.

In particular, electrical control command signals are transmitted via a cable.

In particular, electrical control command signals are transmitted via a wireless communication network.

Brief description of the drawings

In FIG. 1 shows a schematic view of a device for implementing a method for assessing and developing the cognitive-behavioral functions of a subject using virtual reality technologies.

In FIG. shown: 1 - virtual reality device; 2 - headphones; 3 - control device; 4 - visualization device; 5 - control element; 6 - sensor, 7 - VR gloves.

Implementation of the invention

A device for implementing a method for assessing the cognitive-behavioral functions of a subject using virtual reality technologies includes a virtual reality device, 1 which can be virtual reality glasses or a virtual reality helmet; closed-type headphones 2, VR gloves 7 and control device 3. At the same time, control device 3 is configured to communicate with virtual reality device 1, headphones 2 and VR gloves 7. In embodiments, data exchange can be implemented via a cable or via wireless technologies (for example, Wi-Fi).

Additionally, a device for implementing a method for assessing the cognitive-behavioral functions of a subject using virtual reality technologies includes a set of various sensors 6 for measuring the spatial position of body parts and physiological parameters of a person (for example, sensors for measuring pulse and heartbeat, motion sensors for legs, arms, etc. ), which are connected to the control device 3 and are configured to display the measurement parameters of the sensors through the visualization device 4 in real time.

As a control device 3, a personal or specialized computer with pre-installed software can be used, including:

- a database of applications for modeling various situations for analyzing the behavior of the subject, which is a set of interactive environments prepared in advance by specialized specialists, made with the possibility of interacting with virtual elements and accompanying interactions with audiovisual effects.

- a database of the results of the analysis of the behavior of the subject, which includes data obtained from a set of sensors 6 for measuring the spatial position of body parts and physiological parameters of a person for each situation implemented in the device for the subject; also, the database of the results of the analysis of the behavior of the subject includes an arithmetic device capable of calculating increments of the values of the parameters of the spatial position of body parts and physiological parameters of a person, for each situation implemented in the device, by comparing the key parameters with each other for one scenario implemented by one subject ;

- a peripheral program for synchronizing the operation of the control device 3, the virtual reality device 1 of the VR gloves 7 and the headphones 2;

- visualization device 4 for displaying information transmitted to the virtual reality device 1 and displaying information from the comparison device;

- a control element 5, made with the possibility of launching and early termination of the scenario implemented by the application.

Also, the device described above includes a hardware-implemented comparison device, made in the form of a set of threshold devices, the inputs of which are connected to the database of the results of the analysis of the behavior of the subject, and the outputs are combined by the "AND" element. The comparison device is configured to compare the results of measuring the spatial position of body parts and physiological parameters of a person with the reference values of the parameters of the spatial position of body parts and physiological parameters of a person for each situation implemented in the device; wherein the output of the comparison device is connected to the visualization device.

A method for assessing the cognitive-behavioral functions of a test subject using virtual reality technologies, characterized in that before conducting a test or a series of tests, profile specialists select a scenario from an application database for modeling various situations in accordance with which cognitive-behavioral function or personal quality needs to be developed in the test subject. Next, specialized specialists configure the threshold devices in the comparison device for a specific scenario. The setting is carried out by choosing a finite set of threshold devices (which will characterize the number of key test parameters) and setting each threshold device - a threshold value that characterizes the required development of the trained function or quality of the subject. The inputs of the threshold devices are connected to the outputs of the database of the results of the analysis of the behavior of the subject; the outputs of the threshold devices are connected to the input of the logical element "AND" - to ensure that all conditions for the development of the trained function or the quality of the subject are met. Next, the test subject is put on a virtual reality device 1, headphones 2, VR gloves 7 and a set of sensors 6 is attached to it. control commands in the form of electrical signals transmit synchronized interactive audiovisual content to the virtual reality device 1 and headphones 2. Thus, the subject perceives audiovisual content through the virtual reality device 1 in the form of three-dimensional graphics, its animation and sound. Further, depending on which application from the database for modeling various situations for analyzing the behavior of the subject, a certain unique situation is modeled, aimed at developing specific personal qualities of the subject or cognitive-behavioral functions of the subject's body, which can be: stress resistance, leadership, oratory skills, motor skills, reaction speed, decision-making speed, memory skills, concentration, attention, variable, critical, creative and spatial thinking, verbal-figurative imagination, etc. Further, through the control device 3, the subject is given a command to start responding to a unique situation. In embodiments, this command may be given automatically and programmed into a personality diagnostic application. Also, an element of audio accompaniment during the training process can be specific instructions and instructions for passing the test and solving problems. Further, the subject, at his own discretion, makes decisions and performs actions with interactive virtual objects depending on the simulated situation by changing the spatial position of his body and VR gloves 7. At the same time, the visualization device 4 displays information transmitted to the virtual reality device 1 At the same time, the sensors 6 record in real time the spatial position of the body parts and the physiological parameters of the subject and also display on the visualization device 4. The dynamics of changes in the spatial position of the body parts and the physiological parameters of the subject is also recorded as a finite set of numerical values and entered into database of the results of the analysis of the behavior of the subject. Thus, within the framework of one application launch session, unambiguous dependences of the spatial position of body parts and physiological parameters of the subject on time points are formed. Also, in addition, the analysis of the displayed information and indicators of the sensors 6 in real time is carried out by specialized specialists who can stop the diagnosis of the analysis of the behavior of the subject at any time.

Thus, at the initial stage, the process of diagnosing the analysis of the behavior of the subject includes the passage by the subject of a specific scenario loaded from the application database, and the formation of the results of the analysis of the behavior of the subject in a specific scenario, in the form of unambiguous dependencies of the spatial position of body parts and physiological parameters of the subject from time points conducted by the test subject in a specific scenario. At the end of the stage, the obtained dependences corresponding to the key test parameters are fed into the comparison device to the threshold devices, and when the required parameter values are reached, from the obtained dependence relative to the reference values, control signals are generated in the form of a logical "1" (if the required parameter values are not reached, respectively, control signals in the form of "0"). Further, the data from the threshold devices are transmitted to the solver, characterized at the functional level by the logical element "AND", at the output of which an accurate assessment of the development of the required cognitive-behavioral functions of the subject is formed, namely, the logical "1" at the output of the solver corresponds to the presence of the required cognitive-behavioral functions of the subject in the framework of this scenario, "0" - their absence, Further, the information from the solver is transmitted to the visualization device 4.

If the required parameter does not exceed the threshold value, the following steps are implemented during which the above procedure is repeated, the same application from the application database is launched on the control device 3, the synchronized interactive audiovisual content is transmitted to the virtual reality device 1 and headphones 2, the subject through the virtual reality device 1 perceives audiovisual content in the form of three-dimensional graphics, its animation and sound, a similar situation is simulated, the subject at his own discretion makes decisions and performs actions with interactive virtual objects, depending on the simulated situation, using VR gloves 7, sensors 6 in real time, the spatial position of body parts and physiological parameters of the subject are recorded, the dynamics of changes in the spatial position of body parts and physiological parameters of the subject is recorded as a finite set of numerical values and entered into the database of the results of the analysis of the subject's behavior, after the end of the next stage, the arithmetic device calculates the increments of key values of the parameters of the spatial position of body parts and physiological parameters of a person in comparison with the previous stage, and also compares the above parameters with the reference values embedded in the comparison device. When at a certain stage the claimed method reaches the reference values specified in the threshold device, a control command is transmitted to the visualization device 4 to complete the implementation of the claimed method for this subject within this application (scenario). Thus, the development of the cognitive-behavioral functions of the subject for this scenario is considered complete.

The technical result of the invention is an increase in the accuracy of assessing the development of the required cognitive-behavioral functions in the subject is achieved due to the fact that in the course of analyzing the behavior of the subject within one application (scenario), a finite number of measurements of the spatial position of body parts and physiological parameters of a person are formed, which are transmitted to the device comparison, which, depending on whether the obtained characteristics exceed the threshold value or not, accurately assesses whether the required cognitive-behavioral functions of the subject have been achieved or not. In this case, the subjective role of a person in assessing the cognitive-behavioral functions of the subject is significantly reduced. In addition, the use of virtual reality tools (including VR gloves 7) within the framework of the claimed method significantly increases the reliability of the assessment obtained, due to the possibility of simulating conditions that are as close to real as possible.

Also, as additional advantages of the claimed method, it can be attributed that throughout all stages of the claimed method, the progression of the test subject is monitored within a unique scenario, due to the possibility of displaying increments of the dependencies of the spatial position of body parts and physiological parameters of the test subject within each of the stages.

The applicant implemented the claimed method in 2022. During the implementation of the claimed method, the technical result of the invention was confirmed. The accuracy of assessing the development of the required cognitive-behavioral functions in the subjects increased by 40% compared to the method of expert assessments.

An example of the implementation of the claimed method.

The subject arrives at the procedure for the development of cognitive-behavioral functions, namely the development of the skill of speed and correctness in solving exact arithmetic problems in a stressful situation, with a strong acoustic impact (in order to subsequently get a job in the military in a highly specialized profile). Initially, the subject undergoes an initial assessment of suitability and signs a voluntary agreement for the procedure. Next, the subject puts on a virtual reality device 1, headphones 2 and VR gloves 7, a position sensor in space and a pulse sensor, and a command is given from specialized specialists through the control device 3 to start the test. After that, an application from the application database is launched on the control device 3 and the interactive audiovisual content is delivered to the test subject. Interactive audiovisual content simulates the situation when you need to perform the simplest arithmetic operation of adding two-digit numbers under the influence of high-intensity audio accompaniment typical for military operations. In this case, loud sounds of explosions, screams and gunshots are heard in the headphones of the 2nd subject. A virtual object in the form of a table is placed in front of the subject, on which the arithmetic problem “58 minus 13” is written, and 10 virtual objects in the form of sheets of paper are placed in front of the subject along the perimeter of the room, displaying the options for correct answers. Under conditions of strong acoustic impact, the subject must go to a sheet of paper with the correct answer and point to it with a finger using a VR glove 7, after which the scenario is considered completed. Also, the scenario is considered completed after two minutes have elapsed from its beginning. At the same time, each sheet with an answer option is assigned a conditional virtual coordinate from 1 to 10 (the correct answer is the sheet with the coordinate "8", the virtual coordinate "0" corresponds to the case if the user could not reach any sheet with the option after two minutes). The key parameters for the test, determined by specialized specialists, are the spatial position of the test subject at the time of using the VR glove and his physiological parameter - the pulse. The threshold device contains reference values in the form of the coordinates of a sheet of paper with the correct answer and a pulse rate of 100 beats per minute. Thus, the first threshold device is configured to generate a logical "1" at the output only if there is at least one "8" value at the input; the second threshold device is configured to generate a logical "1" at the output only if there are all values at the input for the allotted time of values less than 100.

At the first attempt, the subject was unable to approach the virtual table with the arithmetic problem in the allotted time under the influence of strong acoustic noise. The first threshold device received the value "0", which does not correspond to the correct coordinate with the correct answer, the second threshold device received the value "130", which also does not correspond to the threshold value. At the output of the logical "AND", a "0" was formed, which corresponds to the absence of the required cognitive-behavioral functions of the subject in this scenario, as indicated by the corresponding inscription on the visualization device.

At the second attempt, the subject was able to approach the virtual table, read the problem and, at the same time, indicated the wrong answer. The first threshold device received the value "3", which does not correspond to the correct coordinate with the correct answer, the second threshold device received the value "125", which also does not correspond to the threshold value. At the output of the logical “AND”, “0” was formed, which corresponds to the absence of the required cognitive-behavioral functions of the subject in this scenario. At the same time, thanks to the arithmetic device on the visualization device, a positive trend in the decrease in heart rate was shown, which allowed specialists in the field to conclude that it was necessary to continue further tests due to the potential of the subject.

At the sixth attempt, the subject was able to approach the virtual table, read the problem and, at the same time, indicated the correct answer. The value "8" came to the first threshold device, which corresponds to the correct coordinate with the correct answer, the second threshold device received the value "95", which corresponds to the threshold value. At the output of the logical “AND”, “1” was formed, which corresponds to the presence of the required cognitive-behavioral functions of the subject in this scenario.

Thus, on each of the subject's six attempts, the claimed solution made it possible to give an accurate assessment of the development of the required cognitive-behavioral functions, namely, on the first five attempts to give an unambiguous assessment of the discrepancy between the cognitive-behavioral functions required, on the sixth attempt - attempts to give an unambiguous assessment of the compliance cognitive-behavioral performance required. This assessment was confirmed after the subjects passed similar tests subsequently, the first time. In addition, the claimed method contributed to the development of the required cognitive-behavioral functions of the subject in six sessions.

Also, as part of the implementation of the claimed method, it was possible to familiarize both the subject and specialized specialists with reports on his training on the visualization device 4.

By analogy with the example described above, training can be implemented (with the possibility of an accurate assessment) of stress resistance, leadership, oratory skills, motor skills, reaction speed, decision-making speed, memory skills, concentration, attention, variable, critical, creative and spatial thinking, verbal figurative imagination, etc.

Claims (3)

1. A method for assessing the cognitive-behavioral functions of the subject using virtual reality technologies, characterized in that at the initial stage, the subject is put on sensors for monitoring physiological parameters, as well as a device for virtual reality, headphones, to which electrical signals are transmitted from the control device by means of control commands, containing interactive audiovisual content that simulates a situation by using a database of applications for modeling situations to evaluate cognitive-behavioral functions, which is an interactive environment made with the ability to interact with virtual elements and accompany interactions with audiovisual effects, at the same time, data on the reaction of the subject and data from sensors are transmitted in the form of electrical signals to the visualization device, characterized in that the subject is also put on VR gloves and sensors of the spatial position of body parts, after the simulation of the situation, the measurement data of the spatial position of body parts and physiological parameters of the subject are transferred to the database of the results of the analysis of the behavior of the subject , made with the possibility of storing the indicated measurements, calculating the increments of the values of the indicated measurements during repeated simulation of the situation by the subjects and their transmission to the hardware-implemented comparison device, made in the form of a set of threshold devices, the inputs of which are connected to the database of the results of the analysis of the behavior of the subject, and the outputs are combined by the element "AND ”, while the output of the comparison device is connected to the visualization device, while by selecting a finite set of threshold devices and setting each threshold device to a threshold value characterizing the required development of the trained function or the personal quality of the subject, the comparison device is configured to compare the results of the above measurements with reference values and output of information with an assessment of the development of the required cognitive-behavioral functions in the subject. 2. The method according to claim 1, characterized in that the electrical signals of the control commands are transmitted via a cable. 3. The method according to claim. 1, characterized in that the electrical signals of the control commands are transmitted via a wireless communication network.

Images