KR101854812B1 - Psychiatric symptoms rating scale system using multiple contents and bio-signal analysis - Google Patents

Abstract

A mental symptom evaluation system utilizing audiovisual contents and bio signal analysis is disclosed. The mental symptom evaluation system utilizing the audiovisual contents and the bio signal analysis according to the embodiment of the present invention includes an apparatus for implementing an audiovisual content selectively providing audiovisual contents including mental symptom inducing factors or mental symptoms, A biological signal detection device for detecting biological signals in real time and sharing them with each other, and sharing the data of the biological signal information; and a real-time monitoring device for detecting a change state of the biological signal, analyzing and analyzing a biological signal change pattern, And a mental symptom analysis module for outputting the evaluation results of the mental symptoms. In addition, it is possible to detect the change pattern of the biological signals of the patient or the user who has the mental symptom inducing factors or the mental symptoms related to the audiovisual contents, Analyzes and interprets the results in an objective manner. And during the hearing, the diagnostic data from a clinical interview by allowing the state to be accurately diagnosed can be used to make an objective assessment data. Diagnostic results can be used as an objective evaluation data in interviews with patients with mental symptoms in hospitals and other institutions, which can help to diagnose mental conditions accurately.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a psychological symptom evaluation system using audiovisual contents and bio-

The present invention relates to a method for diagnosing a mental symptom, and more particularly, to a method and apparatus for analyzing a biological signal change pattern of a patient or a user who includes a mental symptom inducing factor or an audiovisual content related to a mental symptom, The present invention relates to a mental symptom evaluation system that utilizes audiovisual contents and bio-signal analysis so that diagnostic data can be used as objective evaluation data in clinical interviews by allowing mental symptoms and psychological state to be accurately diagnosed.

As society becomes more complicated and competition becomes more intense, various mental symptoms such as addiction, depression, and anxiety are increasing as well as stress, smoking, and alcohol addiction. However, mental symptoms are more difficult to express than medical symptoms such as headache or pain, and it is difficult to make an objective assessment only through clinical interviews. Therefore, in order to evaluate mental symptoms, it is mostly done through clinical interviews with patients, psychiatrists or psychological counselors.

However, there are cases in which the patient deliberately conceals or exaggerates the symptoms, and in the case of children, the evaluation of the language is difficult due to the limitations of language expression. In order to compensate for this, as shown in Korean Patent Laid-Open Publication No. 10-2014-0000389 (2014.21.03, publication), an objective evaluation is performed in the form of a questionnaire or a questionnaire or through play. However, there was also a problem that the objective evaluation was distorted if the patient did not understand the contents of the questionnaire or if his /

Korean Patent Laid-Open Publication No. 10-2014-0000389 (2014.21.03, publication)

Accordingly, an object of the present invention to solve the above-mentioned problems is to provide a method and apparatus for analyzing and analyzing biological signal change patterns of a patient or a user who includes mental symptom inducing factors or auditory and visual contents related to mental symptoms, The present invention provides a mental symptom evaluation system that utilizes audiovisual contents and bio-signal analysis so that diagnostic data can be used as objective evaluation data in clinical interviews by allowing mental symptoms and psychological state to be accurately diagnosed.

According to an embodiment of the present invention, a mental symptom evaluation system using audiovisual contents and bio signal analysis includes audiovisual contents providing mental symptom inducing factors or selectively providing audiovisual contents related to mental symptoms Device, a biological signal detecting device for detecting and digitizing biological signals of a user who has come into contact with audiovisual contents in real time, and sharing data biometric signal information, and a real-time monitoring device for detecting the change state of the detected biological signals, And a mental symptom analysis module for determining a mental symptom and a psychological state of the user and outputting an evaluation result of mental symptoms.

According to the mental symptom evaluation system using the audiovisual contents and the bio signal analysis according to the embodiment of the present invention described above, the biological signal change pattern of a patient or a user who is exposed to audiovisual contents including mental symptom inducing factors or mental symptoms, It is possible to make the diagnosis data to be used as objective evaluation data in clinical interviews by making it possible to accurately diagnose mental symptoms and psychological states objectively. In this way, the diagnostic results can be used as an objective evaluation data when interviewing patients with psychiatric symptoms in the clinic or various institutions, which can help to diagnose the mental condition accurately.

In addition, it can help patients and users to evaluate mental symptoms through telemedicine at home without visiting the facility or medical clinic, and it is possible to improve various mental symptoms through analysis algorithm of image and sound containing contents Can be developed. In addition, since it is possible to evaluate the psychological condition of the audiovisual contents experience, it is effective to provide customized contents in various industrial fields.

FIG. 1 is a block diagram schematically showing the configuration of a mental symptom evaluation system using audiovisual contents and bio signal analysis according to an embodiment of the present invention.
FIG. 2 is a detailed configuration diagram of the bio-signal detection apparatus shown in FIG. 1. FIG.
FIG. 3 is a block diagram showing the mental symptom analysis module shown in FIG. 1 in detail.
4 is a flowchart sequentially illustrating a process of determining mental symptoms according to an embodiment of the present invention.
FIG. 5 is a flowchart sequentially illustrating a process of classifying and analyzing mental symptoms according to an embodiment of the present invention.
6 is a diagram for explaining a process of providing visual contents related to mental symptoms.
FIG. 7 is a diagram for explaining a process of sorting the detected bio-signal patterns morphologically and in order.
8 is a diagram for explaining a process of morphologically analyzing the detected bio-signal pattern.
FIG. 9 is a diagram for specifically explaining the process of analyzing the detected bio-signal pattern in order.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram schematically showing the configuration of a mental symptom evaluation system using audiovisual contents and bio signal analysis according to an embodiment of the present invention.

The mental symptom evaluation system shown in FIG. 1 includes an audiovisual content implementation apparatus 100 for selectively providing audiovisual contents including a mental symptom inducing factor or related to mental symptoms, real-time detection of biological signals of a user who has encountered the audiovisual contents, A living body signal detecting apparatus 200 for sharing data biometric signal information, and a controller 210 for real time monitoring of a change state of the detected biological signal, analyzing and analyzing a change pattern of the biological signal to determine a mental symptom and a psychological state of the user, And a mental symptom analysis module 300 for outputting an evaluation result on mental symptoms.

In addition, the bio-signal analysis reference data may be provided to the mental symptom analysis module 300 to support the analysis process while storing the evaluation results of the mental symptoms and mental symptoms judged by the mental symptom analysis module 300, (Not shown) to support audiovisual content that includes symptom inducers or is associated with mental symptoms.

The audiovisual contents implementation apparatus 100 displays and provides the audiovisual contents preset and selected in the mental symptom analysis module 300 so that the user can include mental symptom inducing factors or audiovisual contents related to mental symptoms. Here, the audiovisual contents related to the mental symptoms are set and classified stepwise according to the type and level of the predetermined mental symptom inducing factors. Accordingly, the audiovisual content implementing apparatus 100 provides the audiovisual contents set for the mental symptom inducing factors to the patient or the user step by step according to the control of the mental symptom analysis module 300.

Patients and users may have diverse mental symptoms related to life-threatening stress disorders as well as mental illnesses such as addiction, depression, and anxiety. In order to determine the mental symptoms, the audiovisual contents set and classified according to the kind and the level of the mental symptom inducing factors set in advance are provided step by step, and then, depending on the analysis result of the pattern change of the biological signals detected in each step, The mental symptoms are judged and the evaluation results of mental symptoms are derived.

In order to provide the visual and audio contents set and classified according to the type and level of the mental symptom inducing factors step by step, the visual and audio contents realization device 100 is constituted by a video display screen or an image display panel or a virtual reality headset or a tablet mobile communication device And an audio module composed of a sound speaker, an earphone, a headset, etc. In addition, a perfume expression module or a haptic module may be further provided to provide a smell or tactile content step by step. In particular, the audiovisual content implementing apparatus 100 may selectively utilize virtual reality, augmented reality, 3D hologram, and the like to provide more accurate contents.

FIG. 2 is a detailed configuration diagram of the bio-signal detection apparatus shown in FIG. 1. FIG.

Referring to FIG. 2, the bio-signal detection apparatus 200 shown in FIG. 2 detects biological data of a user who has encountered audiovisual contents in real time, and data, and shares the biometric signal information in the data. The bio-signal detection apparatus 200 is configured to detect a user's biological signal such as a heart rate HR, an EEG, an ECG, an EMG, a skin resistance GSR, a heart rate variability (HRV) Or the like, and then converts the analog detection signal into a digital data signal to share the biometric signal information that has been digitized.

In addition, the bio-signal detection apparatus 200 may collect eye tracking information and facial expression recognition information in addition to the bio-signal information and share the same with the mental symptom analysis module 300. The biological signal detecting apparatus 200 includes a cerebral signal measuring unit 210, a heart signal measuring unit 220, a muscle signal measuring unit 230, a skin and body temperature signal measuring unit 240, (250), and a first communication unit (260).

Specifically, the cerebral signal measuring unit 210 detects an EEG of a user who has encountered audiovisual contents in real time and measures an EEG signal in real time, and transmits the measured signal to the A / D converting unit 250 and the first communication unit 260).

The heart signal measuring unit 220 detects electrocardiogram (ECG) and HRV (heart beat variability) of the user who has encountered the audiovisual contents and measures the electrocardiogram and the heartbeat deviation signal in real time and outputs the measured signal in real time to the A / D converter 250 and the first communication unit 260. [

The muscle signal measuring unit 230 measures the EMG signal of the user who has contacted the audiovisual contents and measures the EMG signal in real time and transmits the measured signal to the A / D converting unit 250 and the first communication unit 260 do.

The skin and body temperature signal measuring unit 240 measures a skin resistance signal in real time by detecting body temperature and skin resistance GSR of a user who has encountered audiovisual contents and outputs the measured signal in real time to an A / And the first communication unit 260.

The A / D conversion unit 250 converts analog signals according to heart rate HR, EEG, ECG, EMG, skin resistance GSR, and HRV (heart beat variability) into real time digital data And provides it to the first communication unit 260.

The first communication unit 260 transmits the EEG signal, electrocardiogram, heartbeat signal, EMG signal, skin resistance, and body temperature signal to the mental symptom analysis module 300 in real time to be shared.

FIG. 3 is a block diagram showing the mental symptom analysis module shown in FIG. 1 in detail.

The mental symptom analysis module 300 shown in FIG. 3 controls the audiovisual content implementation apparatus 100 to provide the user or patient with the mental symptom inducing factors or the visual and auditory contents related to mental symptoms step by step and selectively, Simultaneously, the change state of the biological signal detected by the biological signal detection apparatus 200 in real time is monitored in real time, and the change pattern of the biological signal is analyzed and analyzed to determine the mental symptom and the psychological state of the user, Respectively.

For this, the mental symptom analysis module 300 includes an image support provision unit 310, a bio-signal pattern analysis unit 330, a bio-signal display unit 320, a mental symptom of a user or a patient, And a second communication unit 360 that is shared by the first communication unit 360 and the second communication unit 360.

Specifically, the image support provider 310 of the mental symptom analysis module 300 may provide an audiovisual content set and classified according to the type and level of the mental symptom inducing factor to the user or patient step by step and selectively, (100). In the case of the visual content of the audiovisual contents, the moving image and the still image and the text image are combined so as to be sequentially provided for the evaluation, and the various images and text may be configured in a stepwise manner according to the type and level of the mental symptoms.

Referring to Table 1 below, the bio-signal pattern analyzing unit 330 real-time monitors the change state of the bio-signal detected by the bio-signal detecting apparatus 200, and outputs the data of the bio-signal information to the bio- (Reference value) to analyze and analyze the change pattern of the bio-signal to determine the mental symptom and the psychological state of the user or the patient. At this time, the bio-signal display unit 320 digitizes the bio-signal information detected by the bio-signal detector 200 so that the user, patient, doctor, or expert can visually confirm the bio-signal information, or displays the bio-signal information in a graph or the like.

[Table 1]

On the other hand, the bio-signal pattern analyzer 330 classifies the audio-visual contents provided in accordance with the state of change of the bio-signal detected by the bio-signal detector 200, in a morphological and orderly manner, And the psychological symptoms and psychological state of the user or the patient are judged on the basis of the interpreted results and the morphological and ranking interpretations respectively. For this purpose, the bio-signal pattern analyzer 330 may be divided into a pattern classification controller 340 and a pattern analysis controller 350.

The process of determining mental symptoms in the mental symptom analysis module 300 according to the embodiment of the present invention will be described in detail as follows.

4 is a flowchart sequentially illustrating a process of determining mental symptoms according to an embodiment of the present invention.

Referring to FIG. 4, the audiovisual contents realization apparatus 100 firstly implements audiovisual contents set and classified according to the type and level of the mental symptom inducing factors in a phased manner, To the patient. The biometric signal pattern analyzer 330 detects a pattern in which the biometric signal is changed according to a change in the emotion of the user who is provided with the visual and audio contents step by step and groups the audiovisual contents provided according to the changed state of the detected biometric signal By analyzing the common content within the group, we can infer the mental symptoms and judge the mental symptoms corresponding to the reasoned thought.

Next, FIG. 5 is a flowchart sequentially illustrating a process of classifying and analyzing mental symptoms according to an embodiment of the present invention. And FIG. 6 is a diagram for explaining a process of providing visual contents related to mental symptoms.

Referring to FIG. 5, a process of classifying and analyzing a mental symptom is sequentially provided by sequentially stepping the audiovisual contents related to the determined mental symptoms after the mental symptom corresponding to the inferred accident is determined.

As shown in FIG. 6, in the case of the visual content, the moving image and the still image and the text image are combined so as to be sequentially provided for evaluation. Various images and texts are combined in stages according to the type and level of the mental symptoms Lt; / RTI > Specifically, video and still image images are presented to include factors related to mental symptoms, such as marital conflict, traffic accidents, work stress, fear of natural disasters, anger, stress, and illness. Accordingly, when grouping the audiovisual contents provided according to the change state of the bio-signal, they can be classified morphologically.

The video and still images contain key words that reflect the contents in advance, so that they can be used as a combination of key words in the bio signal analysis process. On the other hand, in a text image, each text image is provided in the form of words or phrases, simple sentences, and used as a combination of key words in the bio signal analysis process. Likewise, video and still image images are presented to include text related to factors related to mental symptoms such as marital conflict, traffic accidents, work stress, fear of natural disasters, anger, stress, illness, When grouping the audiovisual contents provided according to the change status, they can be classified morphologically.

FIG. 7 is a diagram for explaining a process of sorting the detected bio-signal patterns morphologically and in order.

As shown in FIG. 7, the bio-signal pattern analyzer 330 morphs and classifies the audiovisual contents provided according to the change state of the bio-signal detected by the bio-signal detector 200.

Specifically, the pattern classification controller 340 of the bio-signal pattern analyzer 330 groups and classifies images or text images showing similar changes in biological signal parameters such as brain waves, electrocardiograms, and heart rate during morphological classification . In ranking, the degree of increase of the sympathetic nerves between biological signals is graded, and the image and text images are grouped according to the level. In this case, the more the state is increased, the greater the degree of anxiety or psychological conflict.

Referring to FIG. 7, in the ranking, the combination of various bio-signals, which signify sympathetic nerve increase, can be classified into I, II, and III according to degree, and according to their level and grade, The image contents belonging to the group III can be judged as the group in which the change of emotion is the most severe. That is, the degree of increase of the sympathetic nerves between biological signals can be classified, and the image and text images can be grouped and classified from the highest grade to the lowest grade.

Next, the mental symptoms and the psychological state of the user or the patient are judged based on the analyzed result in the morphological and the ranking, respectively, and the morphological and the ranking interpreted respectively.

8 is a diagram for explaining a process of morphologically analyzing the detected bio-signal pattern.

Referring to FIG. 8, the pattern analysis controller 350 of the bio-signal pattern analyzer 330 combines key words representing image characteristics into image images and text image groups, which are morphologically classified, It is expressed in the enemy.

In other words, in the morphological interpretation stage, the key words including the meanings embedded in the images classified according to factors such as work stress, anger, and family discord are combined and expressed linguistically. In the example of FIG. 8, it can be seen that two groups are formed by combining images showing anger response due to work stress in the company and images related to family discord. Here, in the case of morphological interpretation, it does not mean the degree of symptom, but it can be overlapped with the ranking interpretation that reflects the severity of symptoms by grouping images having similar degree of emotional expression, or it may be a separate content have.

FIG. 9 is a diagram for specifically explaining the process of analyzing the detected bio-signal pattern in order.

Referring to FIG. 8, the pattern analysis controller 350 of the bio-signal pattern analyzer 330 combines key words representing image characteristics into image images and text image groups classified in order, It is expressed in the enemy.

According to the ranking classification information, it is possible to generate the result information related to the symptom by judging the degree of change of the emotion according to the classified I, II, and III grades by combining the levels of the various bio signal, and ranking according to the emotion change. In the example of FIG. 9, the conflict with the supervisor shows the greatest stress, the financial problem and the work load within the company are relatively less, and the degree of stress is lowest in the case of parenting or marital conflict in the family have. That is, the image related to the symptom is mainly related to the work supervisor in the company, and the result information can be confirmed.

As described above, according to the mental symptom evaluation system using the audiovisual contents and the bio signal analysis according to the embodiment of the present invention, By analyzing and interpreting the pattern of signal changes morphologically and orderly, it is possible to objectively diagnose mental symptoms and psychological state accurately, so that diagnostic data can be used as objective evaluation data in clinical interviews. In this way, the diagnostic results can be used as an objective evaluation data when interviewing patients with psychiatric symptoms in the clinic or various institutions, which can help to diagnose the mental condition accurately.

In addition, it can help patients and users to evaluate mental symptoms through telemedicine at home without visiting the facility or medical clinic, and it is possible to improve various mental symptoms through analysis algorithm of image and sound containing contents Can be developed. In addition, since it is possible to evaluate the psychological condition of the audiovisual contents experience, it is effective to provide customized contents in various industrial fields.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the following claims And changes may be made without departing from the spirit and scope of the invention.

Claims (8)

An audiovisual content implementation device that selectively provides audiovisual content that includes mental symptom inducing factors or mental symptoms;
A living body signal detecting device for detecting the living body signal of the user who has touched the audiovisual contents in real time and data and sharing the data signal of the living body signal; And
A mental symptom analysis module that monitors the change state of the detected vital sign in real time and analyzes and analyzes a change pattern of the vital sign to determine a mental symptom and a psychological state of a user and outputs an evaluation result of the mental symptom;
≪ / RTI >
Wherein the mental symptom analysis module comprises:
And a control unit for controlling the audiovisual contents realization device so that the audiovisual contents associated with the mental symptoms are selectively provided to the user or the patient in a stepwise and selective manner and at the same time, In order to utilize audiovisual contents and biological signal analysis to generate and output evaluation results of mental symptoms by judging the mental symptoms and psychological states of the user by analyzing and analyzing the change patterns of the biological signals,
Wherein the mental symptom analysis module comprises:
An image support providing device for controlling the visual and audio contents realization device so as to provide the user or the patient with the image or text image related to the mental symptom in a phased manner and selectively;
A biological signal analyzing unit for analyzing and analyzing a change pattern of a living body signal by monitoring the change state of the living body signal detected by the living body signal detecting apparatus in real time and comparing the data signal of the living body signal information with a preset living body signal analyzing reference data, A biological signal pattern analyzer for determining a mental state and a psychological state of the subject; And
A bio-signal display unit for digitizing or displaying the data-converted bio-signal information detected by the bio-signal detection apparatus by a graph or the like,
The bio-signal pattern analyzer
The image and text image, which are the audiovisual contents provided according to the change state of the biological signal detected by the biological signal detecting apparatus, are grouped and morphologically grouped according to the change of the received biological signal, A pattern classification controller for classifying the degree of increase of sympathetic nerves among the received bio-signals and classifying the images and text images in order from a high class to a low class; And
A pattern analysis control unit for verbally expressing images and text images classified morphologically and orderly in terms of morphological and orderly audiovisual contents, respectively, and verifying the mental symptoms and psychological state of the user or the patient; Containing
Mental Symptom Assessment System Utilizing Audiovisual Contents and Biological Signal Analysis.
The method according to claim 1,
The audio-visual content implementing apparatus
An image display module configured by at least one of a video display screen, an image display panel, or a virtual reality headset or a tablet mobile communication device, and an audio module composed of a sound speaker, an earphone or a headset,
A fragrance expression module or a haptic module is further provided to provide the olfactory or tactile content step by step,
A psychological symptom evaluation system using audiovisual contents and bio signal analysis, characterized by selective use of virtual reality, augmented reality, and 3D hologram.
The method according to claim 1,
The bio-signal detection device
Detecting at least one biological signal of at least one of a heart rate, an EEG, an electrocardiogram (EMG), a skin resistance, and HRV of a user who has encountered the audiovisual contents in real time, converting the analog detection signal into a digital data signal, Sharing signal information with the mental symptom analysis module,
A mental symptom evaluation system that utilizes audiovisual contents and bio signal analysis to collect eye tracking information and facial expression change analysis information of the user or a patient and share the same with the mental symptom analysis module.
The method according to claim 1,
The bio-signal detection device
A cerebral signal measuring unit for detecting an EEG of the user facing the audiovisual content and measuring an EEG signal;
A cardiac signal measuring unit for detecting electrocardiogram (ECG) and HRV (heart beat variability) of the user who has encountered the audiovisual content and measuring an electrocardiogram and a heart rate variation signal;
A muscle signal measuring unit for detecting an EMG of the user who has encountered the audiovisual content and measuring an EMG signal;
A skin and a body temperature signal measuring unit for detecting a body temperature and a skin resistance of the user who has encountered the audiovisual contents and measuring a skin resistance signal;
And mental symptom evaluation system using bio - signal analysis.
delete delete delete The method according to claim 1,
The mental symptom analysis module
Detecting a pattern in which a biological signal is changed according to a change in emotion of a user who is selectively and selectively provided with the audiovisual contents set and classified according to the type and level of a mental symptom inducing factor,
The audiovisual contents which are provided according to the changed state of the detected biological signals are grouped to analyze the common contents in the same group to deduce an accident related to the mental symptoms and to judge the mental symptoms corresponding to the inferred accident, Mental Symptom Assessment System.

Images