UA117587C2 - METHOD OF COMPLEX ASSESSMENT OF OBJECTIVE AND SUBJECTIVE REACTION TO AUDIO-STIMULUS - Google Patents

Abstract

The invention relates to medicine, in particular to functional diagnostics, namely, the evaluation of both objective and subjective response to audio-video stimuli, in which ECG groups of people are recorded at rest and when viewing audio-video stimuli, 8 standard parameters of heart rhythm variability are calculated. and the symmetry of the tooth T, the linear discriminant function - LDF, which separates these states. For the non-control respondent, an ECG and an electrical signal from the transducer are recorded, reflecting the respondent's conscious attitude to the stimulus, calculating the normalized parameters for both states and LDF, concluding that no / objective response is present LDF is less / greater than zero, and the response force is considered proportional to the magnitude of LDF, conclude that there is no / subjective reaction if the rotary handle is set by the respondent in neutral / non-neutral position, k incentivize incentives: socially approving / disapproving, strong / weak based on a comparison of both types of feedback.

Description

of the respondent to the stimulus, calculate the normalized parameters divided by the average of both conditions and the LDF, conclude about the absence/presence of an objective reaction, if the LDF is less/greater than zero, and the strength of the response is considered proportional to the value of the LDF, conclude about the absence/presence of sub positive reaction, if the rotator handle is set by the respondent in a neutral/different from neutral position, classify the stimuli: socially acceptable/disapproving, strong/weak based on the comparison of both types of responses.

The invention belongs to medicine, namely to functional diagnostics, and can be used to objectify the presence and strength of the emotional response of the human body in response to a complex stimulus in the form of an audio-video stimulus.

Today, reliable objective, and even more so, quantitative assessment of a person's reaction to a certain stimulus remains an urgent problem. The need to solve such a problem appears first of all in occupational medicine and sports medicine. In these and other medical and biological fields, it is necessary to assess the impact of the complex effect of mental and physical loads on a person and his working capacity in these conditions.

The relevance lies in the fact that known evaluation methods are one-sided, that is, they evaluate some physiological aspect of the body's reaction to an audio or audio-video stimulus (AVS). In addition, emotions are quite difficult to formalize, especially to quantify.

The impact of emotional stimuli on the human body can be assessed by the change in the level of functioning of certain systems compared to the state of rest. It is known that one of the body systems that responds to external stimuli is the cardiovascular system (CSS). On this basis, it is possible to develop, on the one hand, methods of diagnosing the state of the CCS and studying its reserves, and on the other hand, methods of comprehensive assessment of the body's response to external stimuli, using quantitative parameters that describe the functioning of the CCS for the quantitative description of the response to the stimulus.

The ECG method is a widespread method of quantitative assessment of the cardiovascular system, which is currently a routine diagnostic method in clinical cardiology. It is known that the quantitative parameters of the ECG are sensitive to both types of (emotional and physical) stimuli, while the trend and direction of their changes are similar, which allows the use of the ECG to assess the body's response to various stimuli or their combination.

Experimental results on the influence of emotions on heart rate variability (HRV) parameters are also known (pe eiPesi oi etoiyop5 op 5Ppogi-i-ept rozheg 5resigit apaiuvziv oi Neap haiye mapariyu, AV.MeStaiu, M.AiKipzop, MU.Tsheg, S.Aviip, A. Makiip5, Te Ategisap u). oh Sagaiiiodu,

Mo1.76, Mo. 14, 1995, pp. 1089-1093). Here, a new method of studying the impact of emotions using HRV is proposed and it is shown that positive emotions shift the HRV spectrum into the range of medium and high frequencies. Anger, on the contrary, generates a spectrum dominated by the sympathetic nervous system.

In OA 99973 C2 | The method of assessing the functional state of the heart based on the analysis of the ECG form and

From VRS, I. Tchaikovsky, M. Budnyk, Bull. Mo 13, 20121 register an ECG for 2 minutes in one or more leads, calculate the averaged ECG curve and HRV parameters, evaluate the shape of the curve based on amplitude-time parameters, areas under the elements of the curve, coefficients of its approximation by polynomials, calculate the diagnostic criterion (DC).

The method differs in that the individual norm for the heart is determined by averaging the specified parameters for at least 5 examinations under conditions of basic exchange and full psycho-emotional and physical comfort. Next, the current state of the heart is examined, DC is calculated as the sum of the points of the specified parameters averaged over the number of parameters according to a 4-digit scale: normal (0), minor (1), moderate (2), severe (3) violations.

As a result, they compare the current state of the heart with the individual norm for a given person, and in its absence - with the universal sex-age norm and conclude that the state of the heart is normal (impaired slightly, moderately or significantly), if the DK is in the range of 0-DKeO .5 (0.55DKe1.5, 1.55DKe2.5 or 2.5:5DKe-3). When violations are detected, recommendations are given: in case of minor deviations - change the lifestyle and/or intensity/nature of work, in moderate cases - the same and consult a doctor as planned, in severe cases - immediately consult a doctor.

The advantage of OA 99973 C2 is the combination of various parameters obtained on the basis of the analysis of the shape of the averaged ECG curve and HRV parameters, the establishment of the individual norm of each person, the synthesis of the generalized DC, which allows you to detect the degree of deviation of the heart from the norm. However, this method does not involve any loads or incentives.

These shortcomings were overcome in OA 98187 C2, (AbEIV 5/0452, AbIV 5/02, 506М 3/00, Method of determining the mechanism of adaptation of the cardiovascular system to physical or psychoemotional load, I. Chaikovsky, M. Budnyk, Byul. Me8, 2012), where ECG parameters are recorded and calculated similarly to SH 541850 Method of assessing the physiological price of psycho-emotional or physical stress, I. Chaikovsky, M. Budnyk, Byul. Me 20, 20101.

It differs in that the ratio of parameters is found for the "maximum load/ rest" and "after restitution/ maximum load" states.

The essence of the method is to determine the mechanism of adaptation of the CCS to the load based on the determination of the degree of activation of various mechanisms before the increase and decrease of the load.

The conclusion is made according to the 3-digit rule, namely - the mechanism is chronotropic-dromotropic (chronotropic-inotropic or chronotropic-inotropic-dromotropic), if the average degree of activation of the dromotropic mechanism is greater (less than by more than 0.2 or less than 0.2 ) than for the isotropic mechanism.

The advantage of CA 98187 is the use of a video stimulus as a psycho-emotional load. The disadvantage is the use of standard amplitude-h-axis ECG parameters, instead of the more sensitive HRV parameters, as well as the absence of a generalized DC.

In the prototype method MO 2014/077795 A1 |(AbIV 5/16 AbIV 5/0452, BObE 19/00 "Method of determining objective reaction to audio stimulus, video stimulus and their combination", I. Tchaikovsky, Yu.

Vyrovyi, A. Taranov, M. Ketko, 20121 register ECG in at least one lead at rest and when viewing visual audio, video or AVS, calculate HRV parameters and linear discriminant function (LF). differs in that video and/or audio materials of an arbitrary nature are used as a stimulus, a study group of volunteers is examined consecutively in two states, the HRV and DF parameters are calculated, which separates the two states.

Then a person who is not part of the study group is similarly examined, for him the average HRV parameters are calculated by averaging over both states, their current values as arithmetic average values in a sliding time window, as well as standardized values of the parameters

BP as current values normalized to mean values.

Next, the generalized indicator of the psychophysiological response of the subject is calculated as the DF value for the standardized HRV parameters and a conclusion is drawn about the absence (presence) of an emotional response if the generalized indicator is less (greater) than zero. In the presence of feedback, it is considered that its strength is proportional to the value of the generalized parameter.

The advantage of the prototype is the use of more sensitive HRV parameters instead of simple amplitude-time ECG parameters and the use of generalized DC. The disadvantage of the prototype is that it allows you to determine only the objective reaction to the stimulus, while the subjective assessment is unknown.

At the same time, according to SH 541850 | Method of assessing the physiological price of psycho-emotional or physical stress, I. Tchaikovsky, M. Budnyk, Byul. Mo 20, 20101, the physiological cost of emotional stress is different for different people, so their subjective feeling of the same stimulus will also be different. Therefore, for a comprehensive, comprehensive assessment of the impact of emotions on a person, his subjective reaction should also be taken into account.

Such an approach is used, for example, in SHA 49175 О |INOYA4M 1/00, Software and hardware complex (PAK) for the study of public opinion, Yu. Vyrovyi, Bull. Mo 8, 20101, which includes means of audio and video presentations that are the subject of sociological research, means of inputting and converting motor reactions of respondents into electrical signals that quantitatively characterize the reaction of each respondent, a personal computer (PC), means of transmitting data about reactions respondents in the form of electrical signals in a PC, specialized software tools that ensure data storage and analysis.

PAK is distinguished by the fact that the means of audio and video presentations and the means of entering and converting respondents' motor reactions into electrical signals are made in the form of a set of unified software and hardware modules, the number of which is equal to the number of respondents; each module consists of a PC, a display, headphones and a converter of the motor reaction into an electrical signal; these software tools ensure the preservation of electrical signals in a digital form intended for their transmission over a computer network to which PCs are connected with the possibility of data exchange between them.

The converter of the respondent's motor response into an electrical signal consists of a linear or circular potentiometer and an ADC. At the same time, the respondent can change the position of the potentiometer motor depending on the content of the audio and video presentations.

The advantage of the device according to SH 49175) is the possibility for the respondent to quantitatively evaluate stimuli by moving the potentiometer motor. In this way, the detection and preservation in digital form of his subjective reaction is implemented. The disadvantage of SHA 491750) is that it is intended for the study of a narrow applied problem - public opinion, and not for medical diagnosis or psychophysiological testing.

The disadvantage of the known state of the art is the lack of a way to detect the presence and strength of the emotional response of the human body in response to an emotional stimulus, which would allow determining both an objective and a subjective response to the stimulus.

The novelty of the proposed invention lies in the development of means of assessing a person's subjective reaction to an emotional stimulus, which allow to detect not only the presence of a response to a stimulus, but also its strength, as a supplement to the assessment of an objective response to a stimulus. Also, the novelty consists in the application of the device OA 49175) to solve a new problem, addition and change of actions according to the prototype MO 2014/077795, which is not obvious to a specialist in this field of technology.

The invention is based on the task of developing a method of comprehensive assessment of the human body's response to emotional stress in the form of an audio-video stimulus, taking into account the objective and subjective reaction to the stimulus.

The set task is achieved by 1) additional registration of the electrical signal from the respondent by rotating the handle of a special electrical converter - rotator; 2) a conclusion about the absence or presence of a subjective psycho-emotional reaction in the respondent during the given time interval, if the rotator handle is set by the respondent in a neutral or other, different from neutral, position, respectively; 3) using a 4-gradation scale to assess the strength of the subjective reaction and its sign, that is, the negative or positive attitude of the respondent to the stimulus, namely "do not like at all", "rather dislike", "rather like", " Sprain"; 4) using a more accurate 11-point gradation scale from -5 to i-5 with a neutral position at the "0" point, or another discrete scale or a continuous scale, in which the reaction force is proportional to the angle of rotation of the rotator handle, and the negative/positive attitude to the stimulus is determined by the direction of rotation of the handle clockwise/anticlockwise; 5) the conclusion that when the objective reaction changes and there is no subjective reaction, we have a "socially acceptable stimulus"; b) the conclusion that in the absence of a subjective reaction and a strong subjective reaction we have a "socially disapproving stimulus"; 7) the conclusion that a "strong stimulus" occurs when the subjective reaction changes and there is a strong objective reaction. 8) the conclusion that in the absence of changes in the subjective reaction and a weak objective reaction, there is a "weak stimulus".

The technical result consists in the possibility of: 1) detecting the subjective reaction of the human body to an emotional audio-video stimulus; 2) quantitative assessment of the subjective reaction based on the electrical signal from the respondent; 3) compare the subjective and objective reaction to different stimuli of different types and content; 4) control of changes in time of two types (subjective and objective) reactions of the human body to

During the action of the stimulus.

The main implementation includes performing the following actions. 1) ECG registrations in the 1st lead at rest in a group of volunteers with a duration of at least 20 ECG cardiocycles with data recording in PC memory. 2) Recording of the ECG during viewing of the audio-video stimulus in the training group of volunteers with data recording in the PC memory. Episodes from feature films, 7-8 minutes long, selected from the verified database of video clips of EITATE are used as a stimulus. 3) Calculation for each volunteer of the 8 parameters of VRS and T symmetry. 4) Calculation of the linear DF that separates the two states. 5) ECG registrations consecutively in a state of rest in a person who is not part of the control group (hereinafter referred to as the respondent), similarly to clause 1. 6) Calculation of the average values of the 9 parameters specified in clause C for the respondent by averaging them over both states . 7) Calculation for the respondent of the current values of the specified VRS parameters as averaged in the selected time sliding window. 8) Calculation for the respondent of normalized parameter values as current values according to clause 7, normalized, i.e. divided by average values, according to clause 6. 9) Calculation of the generalized indicator of the respondent's psychophysiological objective reaction, as the value of DF for its normalized HRV parameters. 10) They draw a conclusion about the absence or presence of an objective psychophysiological reaction in the respondent at a certain time interval, if the generalized indicator is less or more than zero, respectively. In the presence of an objective reaction, it is considered that the strength of the reaction is proportional to the value of the generalized indicator.

In the main implementation of actions according to paragraphs 1-10 do not relate to the essence of this invention and are disclosed in detail in the prototype MO 2014/077795 and OA 49175), they are given for the purpose of illustration and understanding of the following actions that reveal the implementation of this invention.

The difference is that ECG registration in point 1 is performed using a portable intelligent electrocardiograph "Cardioplus-P" (ToV NVP "Metekol", Nizhyn,

Chernihiv region), disclosed in MO 2014/098784 JSC |(Ab1B 5/0404,, Roshgiip depegayop rogiarie ipePesitsa! eiIesigosagaiodgari, Tchaikovskyi I., Budnyk M., Vasiliev. V., Frolov Yu., Meshkov. V., bo V. Bersenov, 2014).

11) Registration of the electrical signal from the rotator (simultaneously with the ECG according to point 1), which reflects the conscious emotional attitude of the respondent to the stimulus.

The signal from the rotator is registered as follows. While watching the video stimulus, the respondent holds a device with a rotating handle (rotator) in his hands. The device has a scale that reflects emotional states - from extremely negative to extremely positive. In its basic implementation, it has 5 gradations: "not at all like", "rather not like", "indifferent", "rather like", "very like" and the device is used according to SA 49175 and ИНО4М 1/00, Software and hardware complex ( PAK) for the study of public opinion, Yu. Vyrovyi, Byul. May 8, 2010).

Before watching, the respondent is instructed that while watching, the position of the handle should reflect his attitude to what is happening on the screen, regardless of what affects the attitude of the respondent - the plot, the actors, the scenery or anything else. At the moment when the respondent feels that his attitude is changing, he should change the position of the handle to something that corresponds to his internal state. 12) Construct a curve that reflects the dynamics of the respondent's conscious attitude to the stimulus and draw a conclusion about the absence or presence of a subjective psycho-emotional reaction in the respondent at a given time interval, if the rotator handle is set by the respondent in a neutral or other, different from neutral, position, respectively. 13) In the presence of the respondent's subjective reaction, its strength and sign, i.e. negative or positive attitude to the stimulus, are evaluated using a 4-gradation scale, namely "do not like at all", "rather dislike", "rather like" , "Sprain".

All actions are performed using a PC and a computer program, with the results displayed on the display and printed out on the printer.

The obtained result makes it possible to provide recommendations on the permissible level of loads in various working conditions, especially for persons working under conditions of strong emotional load, or even stress, for example, air traffic controllers.

In addition, the proposed method can be a tool for studying the effectiveness of the influence of various audiovisual products, including in mass media, the Internet, for example, for studying the effectiveness of advertising on the target audience.

In another implementation, stimuli are classified as follows: 1) when the objective reaction changes and there is no subjective reaction, it is concluded that we have a "socially acceptable stimulus"; 2) in the absence of a subjective reaction and a strong subjective reaction, they conclude that we have a "socially disapproving stimulus"; 3) when the subjective reaction and a strong objective reaction change, they conclude that we have a "strong stimulus". 4) in the absence of changes in the subjective reaction and a weak objective reaction, they conclude that we have a "weak stimulus".

In other implementations, a more detailed 11-point scale (from -5 to "5 with a neutral state at the point "0") is used for a more accurate assessment of the strength of the subjective reaction, or another discrete scale, or a continuous scale where the strength of the reaction is proportional to the angle rotation of the rotator handle, and the negative/positive attitude to the stimulus depends on the direction of rotation of the handle - clockwise/anticlockwise.

Another advantage of this approach is that it is focused on the use of a relatively cheap electrocardiograph. But the method can also be implemented using other electrocardiographs that have recording functions in the PC memory.

The advantage of this approach is that individual average parameters are calculated for the respondent by averaging over both states. As a result, normalized parameter values are obtained that are adapted to each specific respondent, in other words, individual norms are taken into account.

In addition, the average values of the parameters, averaged over both states, are more stable.

The use of two states allows you to avoid an incorrect increase in the values of the normalized parameters in the event that the parameter in one of the states becomes close to zero.

In additional implementations, other types of devices, such as a photoplethysmograph, are used instead of an electrocardiograph for heart rate registration. At the same time, the devices may not have the function of online recording in the PC memory, but accumulate data on an external data carrier with subsequent recording in the PC memory.

In other implementations, instead of the 1st ECG lead, any other is used, the symmetry of the T wave is calculated as the ratio of the maximum derivatives on the rising/falling slopes of the T wave or in any other known way, additional HRV parameters are calculated, for example, the tension index or any another parameter.

A specific implementation of the method is described in detail for illustrative purposes only. It is clear that in practice, people experienced in cardiology and ECG data analysis can make some changes and modifications, for example, apply a different number of cardiocycles, modify LDF by changing the number of parameters or the value of its coefficients. However, we believe that both the above and other changes and modifications made without significant deviations from the present method are within the scope of this invention.

Claims (3)

FORMULA OF THE INVENTION 1. The method of comprehensive assessment of the objective and subjective reaction to an audio-video stimulus by recording the ECG in at least one lead in the subject at rest and when viewing a visual audio-video stimulus, in which a training sample is formed by examining consecutively in two states a control group of volunteers , calculation for each volunteer of heart rate variability parameters - HRV and calculation for a given group of a linear discriminant function - LDF that separates these two states, examination of the respondent, i.e. a person who is not included in the training sample, and calculation of average HRV parameters for him by averaging on both states and their current values as average arithmetic values in a sliding time window, calculation of normalized values of HRS parameters as current values divided by average values, calculation of a generalized indicator of the respondent's objective psychophysiological reaction as LDF value for normalized HRS parameters, they conclude about you the absence or presence of an objective psychophysiological reaction in the respondent at a given time interval, if the generalized indicator is less than or greater than zero, respectively, in the presence of a reaction, it is considered that its strength is proportional to the value of the generalized indicator, which differs in that the electrical signal created by the respondent is additionally recorded by rotation of the handle of a special converter - rotator; make a conclusion about the absence or presence of a subjective psycho-emotional reaction in the respondent ZO during this time interval, if the rotator handle is set by the respondent in a neutral or other, different from neutral, position, respectively; in the presence of the respondent's subjective reaction to assess its strength and sign, that is, a negative or positive attitude to the stimulus, a scale of 4 gradations is used, namely "do not like at all", "rather dislike", "rather like", " Sprain". 2. The method according to claim 1, which differs in that for a more accurate assessment of the strength of the subjective reaction, a more detailed 11-point scale from -5 to "5 with a neutral position at the point "0" or another discrete scale or continuous scale is used, in which the force of the reaction is proportional to the angle of rotation of the rotator handle, and the negative/losive attitude to the stimulus determines the direction of rotation of the handle - clockwise/anticlockwise. 3. The method according to claims 1-2, which differs in that the stimuli are classified as follows: if a rational conscious response changes, i.e. a subjective reaction, and an emotional response, i.e. an objective reaction is absent, then a "socially acceptable stimulus" occurs ; if there is no subjective reaction, and the objective reaction is strong, then the stimulus belongs to the "socially disapproving stimulus" type; if the subjective reaction and a strong objective reaction change, then a "strong stimulus" occurs, if the subjective reaction does not change and a weak objective reaction occurs, then a "weak stimulus" occurs.