KR20140099569A - System for inspection and treatment of infant mental disease and Method for inspection and treatment of infant mental disease - Google Patents

Abstract

The present invention relates to a system for inspecting and treating an infant mental disease and a method for inspecting and treating an infant mental disease. Specifically, biometric data of a patient, which occurs when a patient avatar and a virtual emotion agent perform a social interaction on a virtual reality, is detected and an emotional state of the patient is quantified using the detected biometric data. The quantified emotional state of the patent is used for the inspection and the treatment of the patient.

Description

TECHNICAL FIELD The present invention relates to a method and an apparatus for diagnosing and treating childhood mental disorders,

The present invention relates to an examination and treatment system for pediatric psychiatric diseases and a method for testing and treating pediatric psychiatric diseases. More particularly, the present invention relates to a method and apparatus for detecting a patient's biomedical information The present invention relates to a pediatric mental disease examination and treatment system and a method for testing and treating a child's mental disease.

In recent years, as the science and industry have developed, the number and types of mental illnesses have also been increasing. Among them, autistic spectrum disorder, attention deficit hyperactivity disorder, attention deficit hyperactivity disorder Is rapidly increasing.

As a method for treating such mental disorders, drug therapy and behavior therapy techniques are traditionally used. Recently, computerized therapy and psychiatric disease therapy using virtual reality technology are being developed. For example, several studies using virtual reality technology have been successfully performed in treating fear such as fear of heights, fear of spiders, and the like. However, such a conventional method has a problem in that it is not generalized because it is insufficient to change various conditions required for implementing a virtual environment in order to maximize the effect of treatment.

The above-described background technology is technical information that the inventor holds for the derivation of the present invention or acquired in the process of deriving the present invention, and can not necessarily be a known technology disclosed to the general public prior to the filing of the present invention.

The present invention relates to a method and apparatus for detecting a patient's biometric information that occurs when a patient avatar and a virtual emotional agent perform a social interaction in a virtual reality, quantifies the emotional state of the patient, An examination and treatment system, and a method for examination and treatment of childhood mental disorders.

The present invention provides a virtual reality realization system for realizing a virtual reality in a patient terminal by objectizing a virtual environment and controlling the patient avatar existing on the virtual reality by an input signal received from the patient terminal, And a virtual emotion agent control unit for controlling the virtual emotion agent to interact with the patient avatar on the virtual reality, and a virtual emotion agent control unit for receiving and analyzing the bio signal of the patient detected by the patient terminal And a detection data processing unit.

In the present invention, the virtual emotion agent control unit may be configured such that when the virtual emotion agent is given a signal input from the patient terminal or a predetermined stimulus or event provided by the virtual reality implementation unit, The state can be controlled to have a probability.

In the present invention, the virtual emotional agent control unit can control the virtual emotional agent to have different emotional states for the same stimulus or event, and thus to take different actions.

In the present invention, the bio-signal may be an EEG, an electroencephalogram, an electrocardiogram, an EMG, a skin conductance, Lt; / RTI > information.

In the present invention, the detection data processing unit may be provided at one side of the patient terminal or the inspection and treatment server.

In the present invention, the detection data processing unit may quantify the emotional state of the patient from the detected biometric signal of the patient.

Here, the detection data processing unit may be configured to remove noise from the detected bio-signal, to extract predetermined feature values related to the patient's emotion from the noise-removed bio-signal, to quantify the emotional state of the patient, Regression analysis can be performed using feature values.

In the present invention, the pediatric psychiatric disease examination and treatment system comprises: a detection member for extracting a biological signal of a patient; And an input / output device that receives a predetermined signal for controlling the patient avatar from a patient and transmits the signal to the examination and treatment server, and receives a signal transmitted from the examination and treatment server and outputs the signal to the patient And may further include a terminal.

In the present invention, the input / output device may include a haptic device.

In the present invention, the pediatric psychiatric examination and treatment system receives a predetermined signal for controlling the therapist avatar and transmits the signal to the examination and treatment server, receives a signal transmitted from the examination and treatment server, And the virtual reality implementing unit may control the therapist avatar on the virtual reality according to an input from the therapist terminal.

According to another aspect of the present invention, a virtual reality is provided to a patient terminal by objectizing a virtual environment by an inspection and treatment server; Controlling a patient avatar existing on the virtual reality by an input signal received from the patient terminal; Performing an interaction with a virtual emotional agent controlled by the inspection and treatment server on the virtual reality with the patient avatar; And a step of detecting and analyzing a biological signal of a patient while the virtual emotional agent and the patient avatar are interacting with each other.

In the present invention, the step of the virtual emotion agent, which is controlled by the inspection and treatment server on the virtual reality, performs an interaction with the patient avatar,

When the virtual emotional agent is given a signal input from the patient terminal or a predetermined stimulus or event provided by the examination and treatment server, the virtual emotional agent can be controlled to have a certain emotional state stochastically .

In the present invention, the virtual emotion agent may be controlled to have different emotional states for the same stimulus or event, and thus to take different actions.

In the present invention, the bio-signal may be an EEG, an electroencephalogram, an electrocardiogram, an EMG, a skin conductance, Lt; / RTI > information.

In the present invention, a step of detecting and analyzing a bio-signal of a patient while the virtual emotional agent and the patient avatar are performing an interaction may quantify the emotional state of the patient from the detected bio-signal of the patient.

The step of quantifying the emotional state of the patient includes: removing noise from the detected bio-signal; Extracting predetermined characteristic values related to a patient's emotion from the noise-removed bio-signal; And performing a regression analysis using the selected feature values.

According to the present invention, biometric information of a patient, which occurs when a patient avatar and a virtual emotional agent perform a social interaction on a virtual reality, is detected, and the emotional state of the patient is quantified using the information The effect can be obtained.

1 is a view schematically showing a child psychiatric disease examination and treatment system according to an embodiment of the present invention.
FIG. 2 is a detailed view of the examination and treatment server 100 of the childhood mental disease examination and treatment system of FIG. 1.
3 is a view schematically showing a virtual reality displayed on the patient terminal 200 or the therapist terminal 300. As shown in FIG.
FIG. 4 is a diagram showing a method for determining a valence (a degree of positivity), arousal (a degree of arousal), and a dominance (a degree related to feeling of control) that determine emotion states of a virtual emotion agent.
FIG. 5 is a flowchart schematically illustrating a method for testing and treating a childhood mental disease according to an embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which are given by way of illustration of specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, the specific shapes, structures, and characteristics described herein may be implemented by changing from one embodiment to another without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each embodiment may be varied without departing from the spirit and scope of the present invention. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be construed as encompassing the scope of the appended claims and all equivalents thereof. In the drawings, like reference numbers designate the same or similar components throughout the several views.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to facilitate a person skilled in the art to which the present invention pertains.

1 is a view schematically showing a child psychiatric disease examination and treatment system according to an embodiment of the present invention.

Referring to FIG. 1, a pediatric psychiatric disease examination and treatment system 1 according to an embodiment of the present invention includes a plurality of patient terminals 200 provided on a patient side, a plurality of therapist terminals 300 and the patient terminal 200 and the therapist terminal 300. The input signals received from the patient terminal 200 and the therapist terminal 300 are used to provide a virtual environment An inspection and treatment server 100 that controls the avatar and the therapist avatar so as to control the virtual emotional agent that interacts with the patient avatar and the therapist avatar on the virtual reality, And a communication network 400 interconnecting the plurality of patient terminals 200 and the inspection and treatment server 100.

In detail, the pediatric psychiatric examination and treatment system according to one embodiment of the present invention provides a virtual reality for the examination and treatment of a mental disease of a child, so that one or more psychiatric patients and one or more therapists simultaneously access the patient A patient avatar controlled by a therapist and a therapist avatar controlled by a therapist perform social interaction on a virtual reality. Furthermore, the present invention provides a virtual emotional agent that interacts with a patient avatar and a therapist avatar on a virtual reality, wherein the virtual emotional agent is associated with a particular emotional state when given a predetermined stimulus or event from a patient avatar, therapist avatar, , And is thus controlled to take different actions for the same stimulus or event. This will be described later in detail with reference to FIG.

Referring again to FIG. 1, the patient terminal 200 refers to a communication terminal that can use a web service in a wired / wireless communication environment and displays a virtual environment provided from the examination and treatment server 100 to a patient . For this, although not shown in the figure, the patient terminal 200 may include a three-dimensional sound reproducer for configuring a realistic virtual environment, a graphic acceleration card for enabling display of a virtual environment, and the like.

The patient terminal 200 is provided with a detection member 210 such as a biosensor and detects a biological signal of a patient such as an electroencephalogram (EEG), an electrocardiogram (ECG), an electromyograph (EMG) A skin conductance, a blood volume pulse, and a skin temparature from the patient.

The patient terminal 200 includes an input and output device 220 such as a keyboard, a mouse and a haptic device to receive a predetermined signal for controlling the patient avatar from a patient and transmit the signal to the examination and treatment server 100 And receives a signal transmitted from the inspection and treatment server 100 and outputs the signal to the patient through the input / output device 220 such as a haptic device.

The therapist terminal 300 refers to a communication terminal that can use a web service in a wired or wireless communication environment and displays a virtual environment provided from the examination and treatment server 100 to a patient. For this, although not shown in the figure, the patient terminal 200 may include a three-dimensional sound reproducer for configuring a realistic virtual environment, a graphic acceleration card for enabling display of a virtual environment, and the like.

The therapist terminal 300 includes an input / output device (not shown) such as a keyboard, a mouse, and a haptic device, receives a predetermined signal for controlling the therapist's avatar from a therapist, 100, and receives a signal transmitted from the examination and treatment server 100 and outputs the signal to a therapist through an input / output device (not shown) such as a haptic device.

The communication network 400 connects the plurality of patient terminals 200 and the therapist terminals 300 with the inspection and treatment server 100. That is, the communication network 400 refers to a communication network that provides a connection path so that the therapist terminals 300 and the patient terminals 200 can access the inspection and treatment server 100 and then transmit and receive packet data.

The examination and treatment server 100 provides a predetermined virtual environment to the patient terminal 200 and the therapist terminal 300 and transmits the virtual environment information to the patient terminal 200 and the therapist terminal 300 by input signals received from the patient terminal 200 and the therapist terminal 300. [ And controls the virtual emotional agent that interacts with the patient avatar and the therapist avatar in the virtual reality. Hereinafter, the inspection and treatment server 100 will be described in more detail.

FIG. 2 is a detailed view of the examination and treatment server 100 of the childhood mental disease examination and treatment system of FIG. 1. Referring to FIG. 2, an inspection and treatment server 100 of the pediatric psychiatric examination and treatment system according to an embodiment of the present invention includes an interface unit 110, a virtual reality implementation unit 121, a virtual emotion agent control unit 122 A detection data processing unit 123, and a database 150. [

In detail, the interface unit 110 provides a communication interface required to provide the transmission / reception signals between the examination and treatment server 100, the patient terminal 200 and the therapist terminal 300 in the form of packet data in cooperation with the communication network 400 do.

The virtual reality realization unit 121 provides a virtual reality to the patient terminal 200 and the therapist terminal 300 by objectizing the virtual environment and generates a virtual reality by input signals received from the patient terminal 200 and the therapist terminal 300 And controls the manipulation of patient avatars and therapist avatars present in the real world.

Specifically, virtual reality is a technology that allows a user to immerse himself in the world created by a computer and interact with the computer through visual, auditory, and tactile senses. Virtual reality is different from traditional display in that computer graphics, various displays, and input technologies are integrated to provide users with presence or immersion. Such a virtual reality provides a paradigm of interaction between a new human and a computer, and the user is no longer simply observing the information or image on the computer screen externally, but in the same way as manipulating his or her avatar It becomes an active participant in the produced 3D virtual world.

Accordingly, the virtual reality implementing unit 121 of the present invention provides a virtual reality to the patient terminal 200 and the therapist terminal 300, and provides a virtual space in which the avatar to be operated by each user can act . In addition, the virtual reality implementing unit 121 controls the patient avatar and the therapist avatar present on the virtual reality to be manipulated by input signals received from the patient terminal 200 and the therapist terminal 300. Furthermore, the virtual reality implementing unit 121 plays a role of enabling the patient to feel the stimulation given to the avatar in the virtual reality through the input / output device 220 of the patient terminal 200 such as a haptic device do. The virtual reality implementer 121 provides the two or three dimensional virtual reality to the patient terminal 200 and the therapist terminal 300 and outputs the virtual reality to the patient terminal 200 and the therapist terminal 300, The detailed description of the specific configuration for controlling the avatar present on the virtual reality is omitted.

Referring to FIG. 3, which schematically shows a virtual reality displayed on the patient terminal 200 or the therapist terminal 300, the virtual reality includes a therapist who is controlled by an input signal received from the therapist terminal 300, (TA), a patient avatar (PA) controlled by an input signal received from the patient terminal (200) and performing a student role, and a virtual emotion agent VA may be disposed. The therapist avatar TA, the patient avatar PA, and the virtual emotion agent VA interact with each other in the virtual reality, and the bio-signal generated from the patient is transmitted to the detection member 210 of the patient terminal 200 And to perform the examination and treatment of pediatric psychiatric diseases.

Referring again to FIG. 2, the virtual emotion agent control unit 122 controls a virtual emotion agent that interacts with the patient avatar on the virtual reality.

In detail, the virtual emotion agent referred to in the present invention means a virtual avatar that is controlled by the virtual emotion agent control unit 122 and operates in the virtual reality. In the present invention, in this virtual reality, the virtual emotional agent and the patient avatar perform social interaction according to a predetermined scenario. The therapist proceeds and controls the scenario in the virtual environment through the therapist avatar, and gives feedback to the patient avatar .

Here, the virtual emotion agent has an emotion model that imitates a human emotion generation process, and when a stimulus or an event is given, the emotion state can have a certain emotion state stochastically. Since the specific emotion state is stochastically thus, the virtual emotion agent can have a different emotion state for the same stimulus or event, and can take other actions in the interaction according to the emotion state expressed.

The combination of such a virtual emotional agent technology has the effect of enabling a more realistic treatment by enabling dynamically changing scenarios in a pediatric psychiatric disease examination and treatment, rather than according to a predetermined scenario.

In the present invention, the emotion model for the virtual emotional agent is constructed by applying fuzzy logic to Scherer's 'component process model of emotion', which is one of the emotional expression models of the human (psychological aspects) The output of the model can be first valence & arousal, second valence & arousal, dominance.

In detail, emotion has characteristics that occur in the external aspect of things, if emotions have characteristics that arise from the human internal point of view. For example, while the human characteristics of 'glad' and 'anxious' are emotions, emotions are characteristic of externalities such as 'attractive' and 'luxurious'. In the case of emotions, emotions have characteristics that occur only in the process of interacting with objects, while they may occur in the absence of objects. The most famous theories related to emotion are the basic feelings (love, joy, surprise, anger, sadness, and fear) of Ekman (1972). These five kinds of basic emotions are combined with each other, and various emotions that humans have are generated. According to Russell (2003), all human emotions can be explained by the axes of valence & arousal.

The emotional state of a virtual emotion agent is determined stochastically by two axes such as valence and arousal. Also, the action taken by the virtual emotion agent is stochastically determined from the emotion state of the virtual emotion agent.

Hereinafter, a method for determining valence (a degree of positivity), arousal (a degree of awakening), and dominance (degree of feeling of control) that determine the emotional state of a virtual emotional agent will be described in more detail with reference to FIG. 4 do.

First, among the three outputs described in the emotion state on the right side of FIG. 4, Goal / Need Relevance and Intrinsic Pleasantness are input in order to determine the output of the first valence. In the case of Goal / Need Relevance, input is classified into five fuzzy sets of VeryLow, Low, Medium, High and Very High. Intrinsic Pleasantness is divided into VeryLow, Low, Medium, High and Very High. The output valence is divided into five fuzzy sets: Very Low, Low, Medium, High, and Very High.

Based on this, the fuzzy rule for determining the first valence from Goal / Need Relevance and Intrinsic Pleasantness for goal G and event E is as follows.

IF Goal / Need Relevance (G, E) is A AND Intrinsic Pleasantness (G, E) is B

THEN FirstValence (E) is C

Here, A, B, and C are fuzzy sets of Goal / Need Relevance, Intrinsic Pleasantness, and first valence respectively.

For example, if another friend comes and takes a block of a child playing with a block, the formula is as follows.

IF Goal / Need Relevance (Play with a block, is taken away by the block) is VeryHighRelevance

AND Intrinsic Pleasantness (Play with a block, is taken away by the block) is LowIntrinsic Pleasantness

THEN FirstValence (E) is LowValence

The fuzzy rule (FirstValence (E)) that determines the first valence output from the inputs of Goal / Need Relevance and Intrinsic Pleasantness is defined as shown in Table 1 below.

Intrinsic Pleasantness V.Low Low Med High V.High Goal /
Need
Relevance V.Low Med Med Med Med Med Low Med Med Med Med Med Med V.Low Med Med Med High High V.Low Low Med High V.High V.High V.Low Low Med High V.High

That is, according to the fuzzy rule (FirstValence (E)), when another friend comes and takes a block of a child playing with a block, Goal / Need Relevance is Very High and Intrinsic Pleasantness is Low, The low value of the two input values will be the same.

The value of Goal / Need Relevance and Intrinsic Pleasantness in each case (for example, when a buddy of a child playing with a block comes and takes it away) can be determined by preliminary experimental data. The fuzzy rules for determining the output values first valence, first arousal, second valence, second arousal, and dominance are also determined by the preliminary experimental data.

Applying the same method as above, enter Goal / Need Relevance and Novelty to determine the output of First arousal. To determine the output of the second valence, input First valence and Conduciveness. To determine the output of the second arousal, input first arousal and urgency. To determine the output of the Dominance, input Control and Power.

In this way, the virtual emotional agent can have a emotional model that mimics the human emotional generation process, so that the virtual emotional agent can have a different emotional state for the same stimulus or event, So that it is possible not only to carry out a predetermined scenario but also to enable a scenario that changes dynamically in the examination and treatment of childhood mental disorders, thereby enabling a more realistic treatment to be possible.

The detection data processing unit 123 receives the bio-signals of the patient detected by the patient terminal 200 and analyzes the bio-signals.

In detail, when a stimulus or an event (for example, one of the virtual emotional agents takes away the patient avatar) is given to the patient avatar in the scenario in the virtual reality, Of the living body. The detection data processing unit 123 analyzes the bio-signals of the patient and quantifies the emotional state of the patient in a valence-arousal or valence-arousal-dominance dimension.

Here, the bio-signals of the patient detected by the detecting member 210 of the patient terminal 200 include EEG, electroencephalogram, electrocardiogram (ECG), electromyograph (EMG), skin conductance, (blood volume pulse), body temperature (skin temparature), and the like.

The detection data processing unit 123 performs a role of quantifying the emotional state of the patient based on the biometric signal of the detected patient based on the experimental data, in the valence-arousal or valence-arousal-dominance dimension.

In detail, the process of obtaining the emotion value quantified by the detection data processing unit 123 through the bio-signal detected by the patient terminal 200 may use regression analysis.

First, the detection data processing unit 123 performs pre-processing such as removing noise from the bio-signal detected by the patient terminal 200.

Next, the detection data processing unit 123 extracts features related to the emotion from the extracted bio-signals, for example, the power values of the alpha waves, the beta waves, the gamma waves, and the PR intervals of the electrocardiogram at specific positions of the brain waves.

Next, a feature associated with the emotion selected from the features selected in the above step is selected. In this case, feature selection can select only features with high correlation through cross-correlation analysis of outputs and features.

Finally, the selected features are substituted into the variable values in the following regression analysis equations to obtain valence, arousal, and dominance values, respectively.

y ₁ = w ₁₀ + w ₁₁ x ₁ + w ₁₂ x ₂ + ... + w _1n x _n

y ₂ = w ₂₀ + w ₂₁ x ₁ + w ₂₂ x ₂ + ... + w _2n x _n

y ₃ = w ₃₀ + w ₃₁ x ₁ + w ₃₂ x ₂ + ... + w _3n x _n

(x ₁ , x ₂ , ... x _n = Selected features

y ₁ = valence, y ₂ = arousal, y ₃ = dominance)

On the other hand, the therapist can diagnose and treat the mental illness by observing the emotional state of the patient. That is, the emotional state of the patient analyzed by the detection data processing unit 123 can be transmitted to the therapist terminal 300, and the therapist can diagnose the mental disease of the patient based on the analyzed emotional state of the patient, .

Although the detection data processing unit 123 is illustrated as being provided in the inspection and treatment server 100, the concept of the present invention is not limited thereto. That is, the detection data processing unit is provided on the patient terminal 200 side, and the biological signal of the patient detected by the patient terminal 200 may be directly analyzed in the detection data processing unit. The emotional state of the patient thus analyzed can be transmitted to the inspection and treatment server 100. Further, in the inspection and treatment server 100, the emotional state of the transferred patient is displayed on the patient avatar, It may also be possible to visually confirm the patient's emotional state within the treatment environment.

Alternatively, the detection data processing unit is provided on the side of the therapist terminal 300. After the biometric signal of the patient detected by the patient terminal 200 is directly transmitted to the therapist terminal 300 through the examination and treatment server 100, And may be analyzed in a detection data processing unit provided in the therapist terminal 300. In this case, the therapist can simultaneously observe the original bio-signal and the emotion state analyzed by the detection data processing unit.

Hereinafter, a method for testing and treating children's psychiatric disorders according to an embodiment of the present invention will be described.

FIG. 5 is a flowchart schematically illustrating a method for testing and treating a childhood mental disease according to an embodiment of the present invention. Referring to FIG. 5, a method for testing and treating a child's psychiatric disorder according to an embodiment of the present invention includes a step of providing a virtual reality to a patient terminal by objectizing a virtual environment by an inspection and treatment server (step S110) A step of controlling a patient avatar existing on the virtual reality by an input signal received from the terminal in operation S120, a virtual emotion agent controlled by the inspection and treatment server interacts with the patient avatar on the virtual reality (Step S130), and a bio-signal of the patient during the interaction between the virtual emotion agent and the patient avatar is detected and analyzed (step S140).

First, the virtual environment is objectified by the inspection and treatment server and a virtual reality is provided to the patient terminal (step S110). Then, the patient avatar existing on the virtual reality is controlled by the input signal received from the patient terminal (step S120).

In detail, the virtual reality implementing unit 121 of the examination and treatment server 100 provides virtual reality to the patient terminal 200 and the therapist terminal 300 by objectizing the virtual environment, and transmits the virtual reality to the patient terminal 200 and the therapist terminal 300 to control the operation of the patient avatar and the therapist avatar present on the virtual reality.

That is, in the virtual reality, a therapist avatar (TA) that is controlled by an input signal received from the therapist terminal 300 and performs a role of a teacher, and an input signal received from the patient terminal 200, A virtual emotional agent (VA) that interacts with the patient avatar (PA) and the patient avatar (PA) in virtual reality can be deployed. The therapist avatar TA, the patient avatar PA, and the virtual emotion agent VA interact with each other in the virtual reality, and the bio-signal generated from the patient is transmitted to the detection member 210 of the patient terminal 200 And to perform the examination and treatment of pediatric psychiatric diseases.

Next, the virtual emotional agent controlled by the inspection and treatment server on the virtual reality interacts with the patient avatar (step S130). In detail, in the present invention, in a virtual reality, a virtual emotional agent and a patient avatar perform social interaction according to a predetermined scenario, and a therapist uses a therapist avatar to process and control a scenario progressed in a virtual environment, .

Here, the virtual emotion agent has an emotion model that imitates a human emotion generation process, and when a stimulus or an event is given, the emotion state can have a certain emotion state stochastically. Since the specific emotion state is stochastically thus, the virtual emotion agent can have a different emotion state for the same stimulus or event, and can take other actions in the interaction according to the emotion state expressed.

The combination of such a virtual emotional agent technology has the effect of enabling a more realistic treatment by enabling dynamically changing scenarios in a pediatric psychiatric disease examination and treatment, rather than according to a predetermined scenario.

Next, the bio-signals of the patient during the interaction between the virtual emotional agent and the patient avatar are detected and analyzed (step S140).

In detail, when a stimulus or an event (for example, one of the virtual emotional agents takes away the patient avatar) is given to the patient avatar in the scenario in the virtual reality, Of the living body. The detection data processing unit 123 analyzes the bio-signals of the patient and quantifies the emotional state of the patient in a valence-arousal or valence-arousal-dominance dimension. The quantification of the emotional state of the patient in terms of valence-arousal or valence-arousal-dominance has been described in detail above, so the description thereof is omitted here.

Here, the bio-signals of the patient detected by the detecting member 210 of the patient terminal 200 include EEG, electroencephalogram, electrocardiogram (ECG), electromyograph (EMG), skin conductance, (blood volume pulse), body temperature (skin temparature), and the like.

According to the present invention, biometric information of a patient, which occurs when a patient avatar and a virtual emotional agent perform a social interaction on a virtual reality, is detected, and the emotional state of the patient is quantified using the information The effect can be obtained.

Although the present invention has been described with reference to the limited embodiments, various embodiments are possible within the scope of the present invention. It will also be understood that, although not described, equivalent means are also incorporated into the present invention. Therefore, the true scope of protection of the present invention should be defined by the following claims.

1: Pediatric mental disease examination and treatment system
100: Inspection and Remediation Server
121: Virtual Reality Implementation Department
122: virtual emotion agent control unit
123: Detection data processor
200: patient terminal
300: therapist terminal
400: communication network

Claims (16)

A virtual reality implementing unit for providing virtual reality to the patient terminal by objectizing the virtual environment and controlling the patient avatar existing on the virtual reality by the input signal received from the patient terminal; And
And a virtual emotion agent controller for controlling a virtual emotion agent that performs interaction with the patient avatar on the virtual reality,
And a detection data processing unit for receiving and analyzing the biological signals of the patient detected by the patient terminal. The method according to claim 1,
Wherein the virtual emotion agent control unit comprises:
When the virtual emotional agent is given a signal input from the patient terminal or a predetermined stimulus or event provided by the virtual reality implementer,
Wherein the virtual emotional agent controls the emotional state so that the virtual emotional agent has a certain emotional state stochastically. 3. The method of claim 2,
Wherein the virtual emotion agent control unit comprises:
Characterized in that the virtual emotional agent has a different emotional state for the same stimulus or event and thus can take a different action. The method according to claim 1,
The bio-signal may include at least one of an EEG, an electroencephalogram, an ECG, an electromyograph, an EMG, a skin conductance, a blood volume pulse, and a skin temparature Including pediatric psychiatric examination and treatment systems. The method according to claim 1,
Wherein the detection data processing unit is provided at one side of the patient terminal or the inspection and treatment server. The method according to claim 1,
Wherein the detection data processing unit quantifies the emotional state of the patient from the detected biological signal of the patient. The method according to claim 6,
The detection data processing unit may be configured to quantify the emotional state of the patient,
And extracting predetermined feature values related to a patient's emotion from the biosignals from which the noise has been removed and performing regression analysis using the selected feature values, Inspection and treatment system. 8. The method according to any one of claims 1 to 7,
The pediatric psychiatric disease screening and treatment system,
A detecting member for extracting a biological signal of a patient; And
And an input / output device that receives a predetermined signal for controlling the patient avatar from a patient and transmits the signal to the examination and treatment server, and receives the signal transmitted from the examination and treatment server and outputs the signal to the patient. Further comprising: a pediatric psychiatric examination and treatment system. 9. The method of claim 8,
Wherein the input / output device includes a haptic device. 9. The method of claim 8,
The pediatric psychiatric disease screening and treatment system,
Further comprising a therapist terminal for receiving a predetermined signal for controlling a therapist avatar and transmitting the signal to the examination and treatment server, receiving a signal transmitted from the examination and treatment server, and outputting the signal,
Wherein the virtual reality implementing unit controls the therapist avatar on the virtual reality according to an input from the therapist terminal. The virtual environment being objectized by the inspection and treatment server to provide a virtual reality to the patient terminal;
Controlling a patient avatar existing on the virtual reality by an input signal received from the patient terminal;
Performing an interaction with a virtual emotional agent controlled by the inspection and treatment server on the virtual reality with the patient avatar; And
And detecting and analyzing a biological signal of a patient while the virtual emotional agent and the patient avatar are interacting with each other. 12. The method of claim 11,
Wherein the act of interacting with the patient avatar by a virtual emotional agent controlled by the inspection and treatment server on the virtual reality comprises:
When the virtual emotional agent is given a signal input from the patient terminal or a predetermined stimulus or event provided by the inspection and treatment server, the virtual emotional agent is controlled to have a certain emotional state stochastically And a method for treating and treating childhood psychiatric disorders. 13. The method of claim 12,
Wherein the virtual emotional agent is controlled to have different emotional states for the same stimulus or event and thus to take different actions. 12. The method of claim 11,
The bio-signal may include at least one of an EEG, an electroencephalogram, an ECG, an electromyograph, an EMG, a skin conductance, a blood volume pulse, and a skin temparature Methods of testing and treating children with psychiatric disorders. 12. The method of claim 11,
Wherein the bio-signals of the patient during the interaction of the virtual emotional agent and the patient avatar are detected and analyzed,
Wherein the emotional state of the patient is quantified from the detected vital signs of the patient. 16. The method of claim 15,
Wherein quantifying the emotional state of the patient comprises:
Removing noise from the detected bio-signal;
Extracting predetermined characteristic values related to a patient's emotion from the noise-removed bio-signal; And
And performing regression analysis using the selected feature values.

Images