KR101727940B1 - Apparatus and method for decision of psychological state using bio signals - Google Patents

Abstract

The apparatus for determining a psychological state according to an embodiment of the present invention includes a biometric signal acquisition unit for generating a first biometric signal and a second biometric signal of a user generated by a first stimulus, And a psychological state determination unit for determining the psychological state of the user based on the first and second characteristics. Here, the first bio-signal and the second bio-signal may be biomedical signals indicating changes of autonomic nerves measured from different biosensors, respectively. For example, the first living body signal may be a PPG signal measured from a pulse wave sensor, and the second living body signal may be a GSR signal measured from a skin conduction sensor.

Description

[0001] APPARATUS AND METHOD FOR DECISION OF PSYCHOLOGICAL STATE USING BIO SIGNALS [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a device and a method for determining a psychological state, and more particularly, to an apparatus and method for determining a current psychological state of a user by using a biological signal such as an electrocardiogram signal and a skin conduction signal.

Recently, development of devices that recognize human emotions and provide biofeedback in response to the development of IT technology and medical technology are being developed.

Conventional apparatuses for recognizing human emotions and psychologicals have adopted a method of judging emotion and psychology by extracting features from complex data such as voice and image. In this case, the apparatus is vulnerable to changes in surrounding dynamic environments such as a sensing range, If the subjects do not display reactive behavior, they will not be able to extract accurate data. In addition, physiological responses to emotional stimuli or psychological states have more objectivity than linguistic statements or behavioral feature extraction, and have the advantage of showing high consistency in an individual. In addition, a conventional apparatus for determining an emotion state using a bio-signal determines a user's emotional state using an electroencephalogram signal. In this case, it is difficult to apply it to a subject who has a feeling of refusal to measure an electroencephalogram signal (for example, have.

KR 10-2001-0010023

Accordingly, the present invention aims to determine the current psychological state of a user by using a plurality of biological signals such as an electrocardiogram signal and a skin conduction signal.

The purpose of this study is to determine the training stimulation based on the stress management by reflecting the current psychological state of the user.

The apparatus for determining a psychological state according to an embodiment of the present invention includes a bio-signal acquisition unit for acquiring a first bio-signal and a second bio-signal of a user generated by a first stimulus; And extracting a first feature and a second feature by analyzing the first bio-signal and the second bio-signal, respectively, and determining a psychological state of the user based on the first feature and the second feature, And the first and second bio-signals may be biomedical signals measured from biosensors that are different from each other.

In an embodiment, the first feature and the second feature may be associated with a first criterion and a second criterion for determining the psychological state, respectively.

As an embodiment, when the first vital sign is a pulse wave signal measured by a pulse wave sensor, the first characteristic is related to at least one of valence and arousal of the emotion, Is a skin conduction signal measured by a skin conduction sensor, the second characteristic may be related to arousal of emotion.

The apparatus may further include a stimulus determination unit that determines a type and a level of a second stimulus provided to the user based on the determined psychology state of the user.

In an embodiment, the first stimulus is a first hypothesis stimulus for providing the user with an interaction training according to differential learning theory (DTT), and the second hypothesis corresponds to the user's response to the first hypothesis stimulus Or a second preconditioned stimulus that is the next preconditioned stimulus of the first preconditioned stimulus.

In an embodiment, the first magnetic pole and the second magnetic pole may be a robotic magnetic pole provided by a robot.

A method for determining a psychological state according to an embodiment of the present invention includes: acquiring a first biometric signal and a second biometric signal of a user generated by a first stimulus; And analyzing the first and second bio-signals to extract a first feature and a second feature, and determining a psychological state of the user based on the first feature and the second feature The first and second biomedical signals may be biomedical signals measured from biosensors that are different from each other.

In an embodiment, the first feature and the second feature may be associated with a first criterion and a second criterion for determining the psychological state, respectively.

As an embodiment, when the first vital sign is a pulse wave signal measured by a pulse wave sensor, the first characteristic is related to at least one of valence and arousal of the emotion, Is a skin conduction signal measured by a skin conduction sensor, the second characteristic may be related to arousal of emotion.

The method may further include determining a type and a level of a second stimulus provided to the user based on the determined psychological state of the user.

In an embodiment, the first stimulus is a first hypothesis stimulus for providing the user with an interaction training according to differential learning theory (DTT), and the second hypothesis corresponds to the user's response to the first hypothesis stimulus Or a second preconditioned stimulus that is the next preconditioned stimulus of the first preconditioned stimulus.

In an embodiment, the first magnetic pole and the second magnetic pole may be a robotic magnetic pole provided by a robot.

According to the present specification, by using a plurality of bio-signals for a nervous system that automatically operates as a part of a peripheral nervous system regardless of the will of the person, the user's psychological state is determined to determine the current psychological state of the user and its change more accurately can do.

In addition, evaluation means capable of tracking the homeostatic regulation mechanism of the autonomic nervous system and physiological state and physiological change of the user using the electrocardiogram and skin conduction signal which are easier to measure than the electroencephalogram signal in the measurement of the physiological change affecting the nervous system The degree of activity of the user's nervous system on stimulation can be clearly discriminated.

In addition, by providing a training stimulus based on the stress management reflecting the current psychological state of the user, the concentration of the user (for example, an autistic child) can be effectively controlled.

In addition, by providing appropriate training stimuli using a variety of media (e.g., robots, display devices, etc.), it is possible to provide consistent and effective training compared to a method in which a person directly training a user's sociality.

FIG. 1 is a block diagram of a psychological state determining apparatus according to an embodiment of the present invention.
FIG. 2 is a conceptual diagram illustrating a process in which a psychological state determination apparatus according to an exemplary embodiment acquires a biological signal and determines a psychological state of a user.
3 is an illustration of a psychological state model according to one embodiment.
4 is a flowchart of a psychological state determination method according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings and the accompanying drawings, but the scope of the claims is not limited or limited by the embodiments.

As used herein, terms used in the present specification are selected from the general terms that are currently widely used, while taking into consideration the functions, but these may vary depending on the intention or custom of the artisan or the emergence of new techniques. Also, in certain cases, there may be a term selected by the applicant at will, in which case the meaning will be described in the description part of the corresponding specification. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

In addition, the embodiments described herein may be wholly hardware, partially hardware, partially software, or entirely software. A "unit", "module", "device", "robot" or "system" or the like in this specification refers to a computer-related entity such as hardware, a combination of hardware and software, . For example, a component, a module, a device, a robot or a system may refer to software such as an application for driving the hardware and / or the hardware constituting part or all of the platform.

In this specification, the psychological state determining apparatus refers to a device for determining a psychological state of a user by using a bio-signal measured by a user. In one embodiment, the psychological state determination apparatus may be a device for determining a psychological state of a user by analyzing a change in a user's bio-signal generated by a stimulus provided to the user. Here, the psychological state may be a psychological state of the user, for example, an emotional state such as pleasure, surprise, angryness, and the like.

FIG. 1 is a block diagram of a psychological state determining apparatus according to an embodiment of the present invention. Referring to FIG. 1, the psychological state determination apparatus 100 may include a bio-signal acquisition unit 110 and a psychological state determination unit 120. In addition, the apparatus may further include a stimulus determination unit 130 and a database 140. Here, the stimulus determination unit 130 and the database 140 may have an optional configuration.

The bio-signal acquisition unit 110 can acquire a plurality of bio-signals of the user, which are generated by the first magnetic poles, for a predetermined time (e.g., 5 minutes). In one embodiment, the bio-signal acquisition unit 110 may acquire a plurality of bio-signals of a user measured from a plurality of bio-sensors built in the psychological state determination apparatus 100. In another embodiment, the bio-signal acquisition unit 110 acquires a plurality of user's bio-signals measured from a plurality of biosensors not incorporated in the psychological state determination apparatus 100 through wired or wireless communication with the biosensor can do. Here, the biosensor may be an attachment type biosensor attached to a part of a user's body to measure a bio-signal, or a non-attachment type biosensor that does not attach to a part of a user's body but measures a bio-signal.

In this specification, the bio-signal is a signal indicating a change of the autonomic nerve (sympathetic or parasympathetic nerve), and includes an ECG (electrocardiogram) chest beat, a PPG (blood volume purge) signal, a PCG (phonocardiogram) (EEG) signal, electrical activity in nerves (galvanic skin response), SKT (skin temperture), ICG (eye muscle movement), indirectly induced breathing with pulse waves The psychological state judging apparatus 100 may use the bio-signal indicating the change of the autonomic nerve, which is easier to measure than the electroencephalogram signal, The present invention is also applicable to a user (for example, an autistic child) who has a feeling of refusal to measure an EEG signal by judging a psychological state.

In one embodiment, the first stimulus may be a first training stimulus provided by a trainee (e.g., a robot). For example, the first stimulus can be used for interaction training (eg, eye coordination, co-ordination, pointing, sharing of interests, mimicry of play behavior, facial expression response, facial expression reading) according to Discrete Time Teaching , Imaginary play training, etc.) to provide the user with training (e. G., Robots). Interaction training according to the discriminant learning theory (DTT) is a set of provision of pre-stimulation requesting the user's reaction, analysis of the user's behavior response to the pre-stimulation, and provision of subsequent stimulus to the user's behavior response Means a training method that improves the interactivity of a configured user.

In one embodiment, the plurality of bio-signals may include a first bio-signal and a second bio-signal measured from biosensors that are different from each other. For example, the first living body signal may be an electrocardiogram signal measured from an electrocardiogram sensor (e.g., a pulse wave (PPG) signal measured from a pulse wave sensor), and the second living body signal may be a skin conduction signal (E.g., a skin conduction (GSR) signal measured from a skin conduction sensor, etc.). A description of the case where the first living body signal is the PPG signal of the electrocardiogram signal and the second living body signal is the GSR signal of the skin conduction signal will be described in detail below with reference to FIG.

The psychological state determination unit 120 may determine the psychological state of the user by analyzing the first and second bio-signals according to a predetermined analysis and determination algorithm. In one embodiment, the psychological state determination unit 120 analyzes the first biometric signal and the second biometric signal to extract the first characteristic and the second characteristic, respectively. Based on the first characteristic and the second characteristic, The state can be judged.

In one embodiment, the analysis and judgment algorithm may be a predefined analysis and judgment algorithm based on a predefined or user entered psychological state model. The psychological state model used in the present specification is a model in which a general emotion state model is reconstructed as well as an emotion state model such as a Valence-Arousal (VA) dimensional model, for example, a certain qualitative state (e.g., (Eg, normal, disliked), or a model for psychological states separated by any quantitative state (eg, stable, unstable) and qualitative size (eg, upper, middle, lower).

In one embodiment, the psychological state determiner 120 may pre-process each bio-signal before extracting features from each bio-signal. For example, the psychological state determination unit 120 may perform signal preprocessing such as peak detection, noise removal, filtering, and the like.

In one embodiment, the first and second features may be associated with a first criterion and a second criterion, respectively, for psychological state determination. For example, as shown in FIG. 3, when the psychological state model is a VA-dimensional model, the first characteristic is associated with a valence of a first criterion, and the second characteristic is associated with a second characteristic, arousal ). ≪ / RTI > Herein, the incentive refers to an index indicating whether the emotion is positive or negative, and the arousal refers to the degree of arousal of the emotion, that is, an index indicating how much the user is emotionally stimulated.

3, the first area of the psychological state model indicates that the psychological state of the user is the first state (surprise), the second area indicates that the psychological state of the user is the second state 3 indicates that the psychological state of the user is the third state (distracting), the fourth region indicates that the psychological state of the user is the fourth state (excited), the fifth region indicates that the psychological state of the user is the fifth state , And the sixth region may indicate that the psychological state of the user is the sixth state (calm). The above-described psychological state model of FIG. 3 is an exemplary psychological state model, and the psychological state judgment apparatus 100 of the present specification can judge the psychological state of the user by using another psychological state model.

3, when the psychological state model is a model in which the psychological state model is divided into six regions according to the attractiveness and the arousal level, the psychological state determiner 120 extracts the attractiveness of the emotion from the first bio signal (for example, PPG signal) Extracts a first characteristic (e.g., a pulse wave propagation time) associated with the stimulus and classifies whether the attractor is positive or negative based on the extracted first characteristic (e.g., pulse wave propagation time) (High, medium, and low) of the user's current psychological state are included in the six regions described above by extracting the two characteristics (for example, the fluctuation range of the skin conductivity) You can judge your current psychological state.

For example, if the pulse wave delivery time is faster than the reference time, the psychological state determination unit 120 classifies the attracted price as positive, and if the pulse wave delivery time is slower than the reference time, have. The psychological state judging unit 120 classifies the arousal level as high when the fluctuation width of the skin conductivity is higher than the first reference width and when the fluctuation width of the skin conductivity is lower than the first reference width and is higher than the second reference width, And when the fluctuation range of the skin conductivity is lower than the second reference width, the arousal level can be classified as low. Thereafter, the psychological state determination unit 120 may determine the current psychological state of the user based on the classified incentive price and the arousal level. For example, the psychological state judging unit 120 can judge that the psychological state of the user is the fifth state (happy) when the classified attracted price is positive and the classified awakening is intermediate.

The embodiment described above is merely an example, and the psychological state judging unit 120 judges from the first feature and the second feature, based on the extracted types and characteristics of the first feature and the second feature, The current psychological state of the user can be determined. The various types and characteristics of the first and second features will be described in detail below with reference to Fig.

The stimulus determining unit 130 may determine the type and level of the second stimulus provided to the user based on the determined psychological state of the user. In one embodiment, the second stimulus may be a second training stimulus that is the next training stimulus of the first training stimulus provided by the trainee (e.g., a robot). For example, the second stimulus may be a subsequent stimulus corresponding to the user's response to the first hypothesis stimulus, provided by the trainer (e.g., robot) to provide the user with interactive training according to the differential learning theory (DTT) Or a second preconditioning which is the next preconditioning of the first preconditioning.

In one embodiment, the subsequent stimulus may be either a stimulus to provide compensation for a user's response, a stimulus to stimulate a user's response, or a stop stimulus. In one embodiment, the second pre-stimulus may be of a different or different level than the first pre-stimulus. In another embodiment, the second pre-stimulus may be a stimulus of the same type and level as the first pre-stimulus. If the psychological state model is the psychological state model of FIG. 3, an exemplary description of the subsequent stimulus and the second premature stimulus corresponding to each of the user's current psychological states is shown in Table 1 below.

Psychological state Subsequent stimulation Second premulture The first state stop - Second state Strong encouragement Induce relaxation Third state General encouragement Induce relaxation Fourth state Super reward Stress / tension Fifth state A high reward Stress / tension induction Sixth state General reward Stress / tension induction

In one embodiment, the first stimulus and the second stimulus may be a robotic stimulus provided by a robot. For example, the robot may provide a first stimulus and a second stimulus to the user under the control of the psychological state determination apparatus 100. [ Here, the robot refers to any platform programmed to be capable of interacting with a user, and is not limited to a robot having a specific shape or purpose. In one embodiment, the robot may include one or more output means (e.g., a display, a speaker, a plurality of joints) for outputting a representation of the intelligent robot to provide stimulation to the user.

If these first stimuli and second stimuli are robotic stimuli provided by the robot, then it is preferable to provide training through the therapist based on the morphological appearance (e.g., character-like robots) preferred by the user The user's participation in training can be increased. In addition, it is possible to provide the user with simple repetitive training through the gestural and stimulus configuration of the robot which is difficult for the therapist to perform.

The database 140 may store biometric signal information and user psychological state information. In one embodiment, the data base 140 stores information on the measured first bio-signal and the second bio-signal, and information on the psychological state of the user determined from the measured first bio-signal and the second bio-signal (For example, by user ID). Through this, the therapist can grasp the degree of treatment and improvement of the training situation according to the change of the psychological state of the user and analysis of the trend using the database information stored for each user, and utilize it as data that can be monitored by other therapists.

FIG. 1 is a block diagram according to one embodiment of the present invention, wherein blocks separated and shown are logically distinguishing components of the apparatus. Therefore, the components of the above-described apparatus can be mounted as one chip or as a plurality of chips according to the design of the apparatus.

FIG. 2 is a conceptual diagram illustrating a process in which a psychological state determination apparatus according to an embodiment acquires a biological signal and determines a psychological state. 2, it is assumed that the first living body signal is the PPG signal of the electrocardiogram signal and the second living body signal is the GSR signal of the skin conduction signal.

Referring to FIG. 2, the bio-signal acquisition unit 110 may acquire a PPG signal as a first bio-signal and a GSR signal as a second bio-signal for a predetermined period (for example, about 5 minutes). In this case, the pulse wave sensor can irradiate a part of the body of the user with infrared rays and measure the pulse wave (PPG), which is a variation amount of BVP (blood volume pulse), by the reflected infrared rays. In addition, the skin conduction sensor can measure the electrical conductivity (GSR) of the skin according to the voltage value measured by the power source applied to the electrode which is in contact with the wrist.

First, the psychological state determination unit 120 can preprocess the PPG signal. In one embodiment, the psychological state determiner 120 may perform preprocessing on the PPG signal by performing peak detection, noise removal, filtering, statistical calculation, and the like. Next, the psychological state determination unit 120 may extract the first feature from the PPG signal. In one embodiment, the psychological state determiner 120 may extract the first characteristic from the PPG signal through time domain analysis or frequency domain analysis on the PPG signal.

For example, as shown in Table 2 below, the psychological state determiner 120 may calculate the mean MEAN, the standard deviation SNDD, and the like of the intervals of the peaks calculated through the time domain analysis on the PPG signal, It can be extracted as a feature. The psychological state judging unit 120 judges whether the power of the low frequency region (for example, 0.04 to 0.15 Hz) (LF (low frequency region)) calculated through the frequency domain analysis (HF) of a high frequency region (e.g., 0.15 to 0.4 Hz), and a power ratio (LF / HF) of a low frequency region to a high frequency region. Here, the first feature may be associated with at least one of a first criterion (e.g., attractor) and a second criterion (e.g., arousal). For example, when SDNN and LH / HF are extracted as the first feature, SDNN is associated with attractor and LH / HF is related to attractor and awakening, so the first trait may be related to attractor and awakening. As another example, if only the SDNN is extracted as the first characteristic, the first characteristic may be associated only with the attractor.

Table 2 below shows examples of the first feature extracted through time domain analysis for the PPG signal, and Table 3 shows examples of the first feature extracted through frequency domain analysis for the PPG signal.

Variable Units Description SDNN ms Standard deviations of all NN intervals (R-R intervals) SDANN ms Standard deviation of the NN intervals in all 5min segments of the entire recording RMSSD ms The square root of the mean of the squares of differences between adjacent NN intervals SDNN index ms Mean standard deviation of all NN intervals for all 5 min segments of the entire recording SDSD ms Standard deviation of adjacent NN intervals NN50 count ms Number of pairs of adjacent NN intervals differing by more than 50 ms in the recording pNN50 % NN50 intervals divided by the total number of all NN intervals

Variable Units Description Frequency range 5 min total power ms ² The variance of NN intervals over the temporal segment approximately
≪ = 0.4 Hz VLF ms ² Power in the very low frequency range ≪ = 0.4 Hz LF ms ² Power in low frequency range 0.04-0.15 Hz LF norm - LF power in normalize units
LF / (Total power-VLF) X 100 HF ms ² Power in High frequency range
HF / (Total power-VLF) X 100 0.15-0.4 Hz HF norm - LF power in normalize units
HF / (Total power-VLF) X 100 LH / HF - Ratio LF / HF

In addition, the psychological state determiner 120 may pre-process the GSR signal. In one embodiment, the psychological state determiner 120 may perform preprocessing on the GSR signal by performing geometric and statistical calculations and the like. Next, the psychological state determiner 120 may extract the second feature from the GSR signal. In one embodiment, the psychological state determiner 120 may extract, as a second characteristic, the area, average, standard deviation, and ratio (GSR / HR) of GSR to HR calculated from the GSR signal. Here, the second characteristic may be associated with a second criterion (e.g., a degree of arousal).

3, the psychological state determiner 120 extracts a first feature (e.g., SNDD) associated with the attractiveness of the emotion from the PPG signal when the psychological state model is a model in which the psychological state model is classified according to attractiveness and alertness , And a second feature (e.g., GSR / HR) associated with the arousal awareness from the GSR signal.

The psychological state determination unit 120 classifies the extracted first feature and second feature according to a predetermined classification algorithm (e.g., "Linear Discriminant Analysis", "K-Nearest Neighbors", "Multi-SVM" And can determine the current psychological state of the user based on the classification result.

For example, when the psychological state model is the psychological state model of FIG. 3, the psychological state determination unit 120 extracts a first characteristic associated with the attractiveness of the emotion from the first biological signal, The second feature associated with the second feature is extracted and the attractor and the arousal level are numerically expressed on the basis of the values of the first feature and the second feature respectively and the quantified attractiveness and alertness are classified into the six regions of the psychological state model of Fig. The current psychological state of the user can be determined.

4 is a flowchart of a method of determining a psychological state of a user using a bio-signal according to an embodiment of the present invention (hereinafter, referred to as a psychological state determination method). In the flowchart, the description of the parts that are the same as those in the description of FIG. 1 to FIG. 3 will be omitted.

The psychological state judging method may include a step (S10) of acquiring a plurality of user's biological signals generated by the first stimulus for a preset time (e.g., 5 minutes). In one embodiment, step (S10) of acquiring a bio-signal may acquire a plurality of bio-signals of the user measured from a plurality of bio-sensors built in the psychological state determination apparatus. In another embodiment, the step (S10) of acquiring a bio-signal includes acquiring a plurality of bio-signals of the user measured from a plurality of biosensors not embedded in the psychological state determination device through wired or wireless communication with the biosensor . Here, the biosensor may be an attachment type biosensor attached to a part of a user's body to measure a bio-signal, or a non-attachment type biosensor that does not attach to a part of a user's body but measures a bio-signal.

In one embodiment, the first stimulus may be a first training stimulus provided by a trainee (e.g., a robot). For example, the first stimulus can be used in interaction training (eg, eye coordination, co-awareness, pointing, sharing of interests, mimicry of play behavior, voice response, facial expression reading, Etc.) provided to the user by the robot.

In one embodiment, the plurality of bio-signals may include a first bio-signal and a second bio-signal measured from biosensors that are different from each other. For example, the first vital signal may be a pulse wave (PPG) signal measured from a pulse wave sensor, and the second vital signal may be a skin conduction (GSR) signal measured from a skin conduction sensor. The description of the case where the first living body signal is the PPG signal and the second living body signal is the GSR signal has been described with reference to FIG. 2, and a detailed description thereof will be omitted.

(S20) of analyzing the first and second bio-signals to extract a first feature and a second feature, and determining a psychological state of the user based on the first feature and the second feature, . ≪ / RTI > The psychological state determination device can determine the psychological state of the user by analyzing the first and second bio-signals according to a pre-defined analysis and judgment algorithm.

In one embodiment, the psychological state apparatus may pre-process each bio-signal prior to extracting features from each bio-signal. For example, the psychophysical device may perform signal preprocessing such as peak detection, noise reduction, filtering, and the like.

In one embodiment, the first and second features may be associated with a first criterion and a second criterion, respectively, for psychological state determination. For example, if the psychological state model is a V-A dimensional model, the first characteristic may be associated with the valence of emotion, and the second characteristic may be associated with the arousal level of emotion. Herein, the incentive refers to an index indicating whether the emotion is positive or negative, and the arousal refers to the degree of arousal of the emotion, that is, an index indicating how much the user is emotionally stimulated.

For example, if the psychological state model is a model in which the psychological state model is divided into six regions according to the attractiveness and the arousal, the psychological state apparatus extracts a first characteristic associated with the attractiveness of emotion from the first biological signal, Extracting a second feature associated with the arousal of the emotion from the biological signal and determining, based on the values of the first feature and the second feature (e.g., the numerical values of the first feature and the second feature) It is possible to determine the current psychological state of the user by determining which of the six areas is included in the area.

The method for determining the psychological state may include determining (S30) the type and level of the second stimulus provided to the user based on the determined psychological state of the user. In one embodiment, the second stimulus may be a second training stimulus provided by the robot. For example, the second stimulus may be a subsequent stimulus or first stimulus corresponding to the user's response to the first hypothesis stimulus, provided by the robot to provide the user with interactive training according to the differential learning theory (DTT) Lt; RTI ID = 0.0 > pre-stimulation. ≪ / RTI >

In one embodiment, the subsequent stimulus may be either a stimulus to provide compensation for a user's response, a stimulus to stimulate a user's response, or a stop stimulus. In one embodiment, the second pre-stimulus may be of a different or different level than the first pre-stimulus. In another embodiment, the second pre-stimulus may be a stimulus of the same type and level as the first pre-stimulus.

In one embodiment, the first stimulus and the second stimulus may be a robotic stimulus provided by a robot. Here, the robot refers to any platform programmed to be capable of interacting with a user, and is not limited to a robot having a specific shape or purpose. In one embodiment, the robot may include at least one output means (e.g., a display, a speaker, a plurality of joints) for outputting a representation of the intelligent robot to provide stimulation to the user.

If the first stimulus and the second stimulus are robotic stimuli provided by the robot, the user (e.g., a child) may be provided with a training through a therapist based on a morphological profile (e.g., a character-shaped robot) The user participation in the training can be increased. In addition, it is possible to provide the user with simple repetitive training through the gestural and stimulus configuration of the robot which is difficult for the therapist to perform.

Such interactive training methods may be implemented in an application or implemented in the form of program instructions that may be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. Program instructions that are recorded on a computer-readable recording medium may be those that are specially designed and constructed for the present invention and are known and available to those skilled in the art of computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. A hardware device may be configured to operate as one or more software modules to perform processing in accordance with the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

In this specification, both the invention and the method invention are explained, and the description of both inventions can be supplemented as necessary.

100: psychological state determination device 110: biological signal acquisition unit
120: psychological state judgment unit 130: stimulus judgment unit
140: Database

Claims (16)

A psychological state judgment device for analyzing and treating the psychological state of autistic children by applying discriminant learning theory (DTT)
A bio-signal acquisition unit for acquiring a first bio-signal and a second bio-signal of a user generated by the first magnetic pole for a predetermined time;
A psychological state judging unit for judging the psychological state of the user on the basis of the first characteristic and the second characteristic by analyzing the first biometric signal and the second biometric signal respectively and extracting the first characteristic and the second characteristic, ; And
And a stimulus determining unit for determining a type and a level of a second stimulus provided to the user based on the determined psychological state of the user,
Wherein the first bio-signal and the second bio-signal are different biomedical signals representing changes of autonomic nerves measured from biosensors that are different from each other,
Wherein the first stimulus is a first hypothesis stimulus for providing the user with interaction training according to differential learning theory (DTT)
Wherein the second stimulus is a subsequent stimulus corresponding to the user's response to the first hypothesis stimulus or a second hypothesis stimulus that is the next hypothesis stimulus of the first hypothesis stimulus,
Wherein the psychological state determination unit is configured to determine the psychological state of the user according to the first precondition as one of the first state to the sixth state,
Wherein the second stimulus determined by the stimulus determination unit is a subsequent stimulus that is a stop stimulus when the psychological state of the user is the first state (surprise)
A second premise stimulus for inducing a subsequent stimulus or relaxation of the user, which is an encouraging stimulus of a predetermined strength or more in the second state (an anger)
And is a second premultimate stimulus that induces subsequent stimulation or relaxation, which is an encouraging stimulus of a predetermined intensity or less in the third state (distracting)
A second hypothesis stimulus that maintains a subsequent stimulus or stress or tension that is a compensating stimulus of a predetermined strength or higher in the fourth state (excited)
A second premultimate stimulus that induces a subsequent stimulus or stress or tension that is a compensating stimulus of a predetermined strength or more in the fifth state (happiness)
Is a second pre stimulus for inducing a subsequent stimulus or stress or tension which is a compensating stimulus of a predetermined intensity or less in the case of a sixth state (deposition)
A psychological state judgment system for analyzing and treating psychological state of autistic child by applying discriminant learning theory (DTT). The method according to claim 1,
Wherein the first feature and the second feature are related to a first criterion and a second criterion for determining the psychological state, respectively, and the psychological state judgment < RTI ID = 0.0 > Device. 3. The method of claim 2,
Wherein when the first vital sign is an electrocardiogram signal measured by an electrocardiographic sensor, the first characteristic is associated with at least one of a valence and arousal of the emotion,
Wherein the second feature is a function for analyzing and treating the psychological state of the autistic child by applying the discriminant learning theory (DTT), which is related to the arousal of the emotion, when the second biological signal is a skin conduction signal measured by the skin conduction sensor Psychological condition determination device. The method of claim 3,
Characterized in that the electrocardiogram signal is a pulse wave (PPG) signal and the skin conduction signal is an electrical skin reflection (GSR) signal. The psychological state for analyzing and treating the psychological state of the autistic child by applying the discriminant learning theory (DTT) Determination device. delete delete The method according to claim 1,
Wherein the first stimulus and the second stimulus are robotic stimuli provided by a robot, and applying the discriminant learning theory (DTT) to analyze and treat the psychological state of autistic children. The method according to claim 1,
And a database for storing information on the measured first biomedical signal and second biomedical signal and information on the psychological state of the user judged from the measured first biomedical signal and the second biomedical signal, , And psychological state judgment device for analyzing and treating the psychological state of autistic child by applying discriminant learning theory (DTT). A method of psychological state judgment for analyzing and treating psychological state of autistic child by applying discriminant learning theory (DTT)
Acquiring a first biometric signal and a second biometric signal of a user, which are generated by a first magnetic pole, for a predetermined time;
Analyzing the first bio-signal and the second bio-signal to extract a first feature and a second feature, and determining a psychological state of the user based on the first feature and the second feature; And
Determining a type and a level of a second stimulus provided to the user based on the determined psychological state of the user,
Wherein the first bio-signal and the second bio-signal are different biomedical signals representing changes of autonomic nerves measured from biosensors that are different from each other,
Wherein the first stimulus is a first hypothesis stimulus for providing the user with interaction training according to differential learning theory (DTT)
Wherein the second stimulus is a subsequent stimulus corresponding to the user's response to the first hypothesis stimulus or a second hypothesis stimulus that is the next hypothesis stimulus of the first hypothesis stimulus,
Wherein the step of determining the psychological state comprises the step of determining the psychological state of the user according to the first prerequisite stimulus as one of the first state to the sixth state,
Wherein the second stimulus is a subsequent stimulus that is a stop stimulus when the user's psychological state is a first state (surprise)
A second premise stimulus for inducing a subsequent stimulus or relaxation of the user, which is an encouraging stimulus of a predetermined strength or more in the second state (an anger)
And is a second premultimate stimulus that induces subsequent stimulation or relaxation, which is an encouraging stimulus of a predetermined intensity or less in the third state (distracting)
A second hypothesis stimulus that maintains a subsequent stimulus or stress or tension that is a compensating stimulus of a predetermined strength or higher in the fourth state (excited)
A second premultimate stimulus that induces a subsequent stimulus or stress or tension that is a compensating stimulus of a predetermined strength or more in the fifth state (happiness)
Is a second pre stimulus for inducing a subsequent stimulus or stress or tension which is a compensating stimulus of a predetermined intensity or less in the case of a sixth state (deposition)
A psychological state judgment method for analyzing and treating the psychological state of autistic child by applying discriminant learning theory (DTT). 10. The method of claim 9,
Wherein the first feature and the second feature are related to a first criterion and a second criterion for determining the psychological state, respectively, and the psychological state judgment < RTI ID = 0.0 > Way. 11. The method of claim 10,
Wherein when the first vital sign is an electrocardiogram signal measured by an electrocardiographic sensor, the first characteristic is associated with at least one of a valence and arousal of the emotion,
Wherein the second feature is a function for analyzing and treating the psychological state of the autistic child by applying the discriminant learning theory (DTT), which is related to the arousal of the emotion, when the second biological signal is a skin conduction signal measured by the skin conduction sensor How to judge psychological state. 12. The method of claim 11,
Characterized in that the electrocardiogram signal is a pulse wave (PPG) signal and the skin conduction signal is an electrical skin reflection (GSR) signal. The psychological state for analyzing and treating the psychological state of the autistic child by applying the discriminant learning theory (DTT) How to judge. delete delete 10. The method of claim 9,
Wherein the first stimulus and the second stimulus are robotic stimuli provided by a robot, and applying the discriminant learning theory (DTT) to analyze and treat the psychological state of autistic children. 10. The method of claim 9,
Further comprising storing information on the measured first biometric signal and second biometric signal and information on the user's psychological state judged from the first biometric signal and the second biometric signal measured for each user , And psychological state judgment method for analyzing and treating psychological state of autistic child by applying discriminant learning theory (DTT).

Images