WO2017200244A1 - Psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis - Google Patents

Psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis Download PDF

Info

Publication number
WO2017200244A1
WO2017200244A1 PCT/KR2017/005000 KR2017005000W WO2017200244A1 WO 2017200244 A1 WO2017200244 A1 WO 2017200244A1 KR 2017005000 W KR2017005000 W KR 2017005000W WO 2017200244 A1 WO2017200244 A1 WO 2017200244A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
biosignal
bio
symptoms
user
Prior art date
Application number
PCT/KR2017/005000
Other languages
French (fr)
Korean (ko)
Inventor
신호철
이상훈
김석민
Original Assignee
신호철
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 신호철 filed Critical 신호철
Publication of WO2017200244A1 publication Critical patent/WO2017200244A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165Evaluating the state of mind, e.g. depression, anxiety
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • A61B5/02405Determining heart rate variability
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/053Measuring electrical impedance or conductance of a portion of the body
    • A61B5/0531Measuring skin impedance
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/318Heart-related electrical modalities, e.g. electrocardiography [ECG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/389Electromyography [EMG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis

Definitions

  • the present invention relates to a method for diagnosing psychiatric symptoms. Specifically, the present invention relates to an analysis of physiological and morphological patterns of patients or users who include psychotic symptoms or to audiovisual content related to mental symptoms. The present invention relates to a psychiatric symptom evaluation system using audiovisual content and biosignal analysis, which enables the diagnosis of psychological symptoms and psychological conditions to be used as an objective evaluation data during clinical interviews.
  • an object of the present invention for solving the above problems is to objectively analyze and interpret patterns of biosignal changes of patients or users including psychotic symptoms causing factors or contact with audiovisual contents related to psychotic symptoms. It is to provide a psychological evaluation system using audiovisual content and biosignal analysis, which enables the diagnosis of psychological symptoms and psychological state to be accurately diagnosed, so that the diagnostic data can be used as an objective evaluation data during the interview in the clinic.
  • Psychotic symptom evaluation system using audiovisual content and bio-signal analysis implements audiovisual content that selectively provides audiovisual content that includes psychotic symptoms or related to mental symptoms Device, a biosignal detection device which detects and biometrics a user's biosignal in contact with audio-visual content in real time and shares the data-signed biosignal information, and monitors the change state of the detected biosignal in real time and analyzes and analyzes the pattern of the biosignal change It includes a mental symptoms analysis module for determining the mental symptoms and psychological state of the user and output the evaluation results for the mental symptoms.
  • the pattern of the biosignal change of the patient or user who includes the psychotic symptoms causing factors or touches the audiovisual content related to the psychotic symptoms By analyzing and interpreting morphologically and ranking objectively, it is possible to objectively diagnose psychological symptoms and psychological conditions, so that the diagnostic data can be used as objective evaluation data during interviews in clinical practice. In this way, the diagnosis results can be used as an objective evaluation data when interviewing patients with mental symptoms in hospitals or various institutions, which can help diagnose the mental state accurately.
  • FIG. 1 is a schematic diagram showing the configuration of a psychological symptom evaluation system using audiovisual content and biosignal analysis according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating in detail the configuration of the biosignal detecting apparatus illustrated in FIG. 1.
  • FIG. 3 is a block diagram illustrating in detail the mental symptoms analysis module shown in FIG.
  • FIG. 4 is a flowchart sequentially illustrating a process of determining a mental symptom according to an embodiment of the present invention.
  • FIG. 5 is a flowchart sequentially illustrating a process of classifying and interpreting psychotic symptoms according to an exemplary embodiment of the present invention.
  • FIG. 6 is a view for explaining a process of providing visual content related to mental symptoms.
  • FIG. 7 is a diagram for describing a process of classifying the detected biosignal patterns in a morphological and ranking order.
  • FIG. 8 is a diagram for describing in detail a process of morphologically analyzing the detected biosignal pattern.
  • FIG. 9 is a diagram for describing in detail a process of analyzing the detected biosignal patterns in a rank order.
  • FIG. 1 is a schematic diagram showing the configuration of a psychological symptom evaluation system using audiovisual content and biosignal analysis according to an embodiment of the present invention.
  • the psychotic symptom evaluation system shown in FIG. 1 includes an audiovisual content implementation apparatus 100 that selectively provides audiovisual contents including psychotic symptoms causing factors or psychotic symptoms, and detects and biometrics a user's biosignal in real time.
  • the biosignal detection apparatus 200 sharing the biosignal information, which is data, and monitors the change state of the detected biosignal in real time, and analyzes and analyzes the pattern of the biosignal change to determine the mental symptoms and the psychological state of the user. It is configured to include a mental symptoms analysis module 300 for outputting the evaluation results for the mental symptoms.
  • the mental It may further include a management server (not shown) that includes the symptom-inducing factor or supports audiovisual content related to mental symptoms.
  • the audiovisual content implementing apparatus 100 displays and provides audiovisual content that is preset and selected by the mental symptom analysis module 300 so that a user may encounter audiovisual contents including a psychotic symptom-inducing factor or mental symptoms.
  • the audiovisual content related to the psychotic symptoms is set and classified step by step according to the type and level of the psychotic symptom causing factors in advance. Accordingly, the audiovisual content implementing apparatus 100 provides the audiovisual content to the patient or the user step by step to increase the level of the psychotic symptom causing factor under the control of the psychotic symptom analyzing module 300.
  • the patient or the user may have various mental symptoms related to stress disorders, as well as mental illnesses such as addiction disease, depression, and anxiety. Therefore, in order to determine the mental symptoms, the audiovisual contents set and classified according to the type and level of psychotic symptoms causing factors are provided step by step, and according to the pattern change analysis result of the bio signals detected at each stage. The mental symptoms are judged and evaluation results of the mental symptoms are derived.
  • the audiovisual content implementing apparatus 100 includes a video display screen, a video display panel, a virtual reality headset, a tablet mobile communication device, and the like. It is configured to include an image display module, and an audio module composed of a sound speaker, earphone or headset, etc.
  • the fragrance expression module or haptic module may be further provided to provide olfactory or tactile content in stages.
  • the audiovisual content implementing apparatus 100 may selectively use virtual reality, augmented reality, 3D hologram, or the like to provide more accurate content.
  • FIG. 2 is a diagram illustrating in detail the configuration of the biosignal detecting apparatus illustrated in FIG. 1.
  • the biosignal detection apparatus 200 illustrated in FIG. 2 detects and converts a biosignal of a user in contact with an audiovisual content in real time to share data.
  • the biosignal detecting apparatus 200 may include a user's biosignal, for example, heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability).
  • HR heart rate
  • ECG electrocardiogram
  • EMG electromyogram
  • GSR skin resistance
  • HRV heart rate variability
  • the biosignal detection apparatus 200 detects and converts the biosignal of the user who has encountered the audiovisual content in real time into data and shares the dataized biosignal information.
  • the biosignal detecting apparatus 200 may include a user's biosignal, for example, heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability).
  • HR heart rate
  • ECG electrocardiogram
  • EMG electromyogram
  • GSR skin resistance
  • HRV heart rate variability
  • the biosignal detecting apparatus 200 may collect eye tracking information and facial expression recognition information along with the biosignal information and share the same with the mental symptom analysis module 300.
  • the biosignal detecting apparatus 200 includes a cerebral signal measuring unit 210, a heart signal measuring unit 220, a muscle signal measuring unit 230, a skin and body temperature signal measuring unit 240, and an A / D conversion.
  • the unit 250 and the first communication unit 260 are provided.
  • biosignal detecting apparatus 200 may further include an eyeball and a face signal measuring unit 270.
  • the cerebral signal measuring unit 210 detects EEG of a user who is in contact with audiovisual content in real time, measures an EEG signal in real time, and measures the measured signal using the A / D converter 250 and the first communication unit ( 260).
  • the cardiac signal measuring unit 220 detects the electrocardiogram (ECG) and HRV (heart rate variability) of the user who is in contact with the audiovisual content, measures the electrocardiogram and heart rate signal in real time, and converts the measured signal into an A / D converter ( 250) and the first communication unit 260.
  • ECG electrocardiogram
  • HRV heart rate variability
  • the muscle signal measuring unit 230 detects EMG of the user in contact with the audiovisual content, measures the EMG signal in real time, and transmits the measured signal to the A / D converter 250 and the first communication unit 260. do.
  • the skin and body temperature signal measuring unit 240 detects the body temperature and skin resistance (GSR) of the user in contact with the audiovisual content, measures the skin resistance signal in real time, and converts the measured signal in real time into the A / D converter 250. And transmits to the first communication unit 260.
  • GSR body temperature and skin resistance
  • the eyeball and face signal measuring unit 270 detects changes in pupil size, eye movement, and facial muscles of the user in contact with audiovisual content to measure eye tracking information and facial expressions in real time, and measured eye tracking information and facial expressions in real time. The change is transmitted to the A / D converter 250 and the first communication unit 260.
  • the A / D converter 250 converts analog signals according to heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electrocardiogram (EMG), skin resistance (GSR) and HRV (heart rate variability) into real-time digital data.
  • HR heart rate
  • ECG brain wave
  • ECG electrocardiogram
  • EMG electrocardiogram
  • GSR skin resistance
  • HRV heart rate variability
  • the A / D converter 250 may include heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability), eye tracking information, and facial expression change.
  • HR heart rate
  • ECG electrocardiogram
  • EMG electromyogram
  • GSR skin resistance
  • HRV heart rate variability
  • eye tracking information and facial expression change.
  • the analog signal is converted into real-time digital data and provided to the first communication unit 260.
  • the first communication unit 260 transmits EEG signals, ECG and heart rate signals, EMG signals, skin resistance, and body temperature signals to the psychological symptom analysis module 300 to be shared in real time.
  • the first communication unit 260 transmits EEG signals, electrocardiograms and heart rate signals, EMG signals, skin resistance and body temperature signals, eye tracking information, and facial expression changes to the psychological symptom analysis module 300 to be shared in real time.
  • FIG. 3 is a block diagram illustrating in detail the mental symptoms analysis module shown in FIG.
  • the psychological symptom analysis module 300 illustrated in FIG. 3 controls the audiovisual content implementing apparatus 100 to provide the user or patient with the audiovisual contents including the psychotic symptom causing factors or the mental symptoms in a stepwise manner and selectively.
  • the audiovisual content implementing apparatus 100 controls the audiovisual content implementing apparatus 100 to provide the user or patient with the audiovisual contents including the psychotic symptom causing factors or the mental symptoms in a stepwise manner and selectively.
  • monitoring the state of change of the bio-signals detected by the bio-signal detection apparatus 200 in real time and analyzes and interprets the change pattern of the bio-signals to determine the mental symptoms and psychological state of the user to evaluate the psychological symptoms Create and print
  • the mental symptom analysis module 300 transmits the image support providing unit 310, the biosignal pattern analysis unit 330, the biosignal display unit 320, the mental symptoms and psychological state determination results of the user or patient to the inside and the outside. It may be configured to include a second communication unit 360 to share.
  • the image support providing unit 310 of the psychotic symptom analysis module 300 implements audiovisual contents to provide the user or patient with staged and selectively provided audiovisual contents set and classified according to the type and level of the mental symptom inducing factor.
  • Control 100 In the case of visual content among audiovisual contents, a video, a still image image, and a text image are combined to be sequentially provided for evaluation, but various images and texts may be combined in stages according to the types and levels of mental symptoms.
  • the biosignal pattern analysis unit 330 monitors the change state of the biosignals detected by the biosignal detection apparatus 200 in real time, and sets the biosignal information in advance to set biosignal analysis reference data. By comparing with (Reference value), it analyzes and interprets the change pattern of the biosignal to determine the mental symptoms and psychological state of the user or patient.
  • the biosignal display unit 320 digitizes or displays the graphicized biosignal information detected by the biosignal detection apparatus 200 so as to be visually confirmed by a user, a patient, a doctor, or an expert.
  • the biosignal pattern analyzer 330 classifies audiovisual contents provided in accordance with the state of change of the biosignal detected by the biosignal detection apparatus 200 in form and rank, and then forms and ranks them. By interpreting each form, the psychological symptoms and psychological state of the user or patient are judged based on the results of the analysis.
  • the biosignal pattern analyzer 330 may be divided into a pattern classification controller 340 and a pattern analysis controller 350.
  • FIG. 4 is a flowchart sequentially illustrating a process of determining a mental symptom according to an embodiment of the present invention.
  • a user may selectively and selectively set audiovisual content set and classified according to the type and level of a mental symptom-causing factor under the control of the psychotic symptom analysis module 300.
  • the biosignal pattern analyzer 330 detects a pattern in which a biosignal is changed according to a user's emotional change in which audiovisual content is provided in stages, and groups the audiovisual contents provided in accordance with a change state of the detected biosignal. By analyzing common content within the group, inferences related to mental symptoms are inferred and mental symptoms corresponding to the inferred accidents are judged.
  • FIG. 5 is a flowchart sequentially illustrating a process of classifying and interpreting mental symptoms according to an exemplary embodiment of the present invention.
  • 6 is a view for explaining a process of providing visual content related to mental symptoms.
  • a video, a still image image, and a text image are combined to be sequentially provided for evaluation, but various images and texts are combined in stages according to types and levels of mental symptoms.
  • the moving image and the still image are presented to include contents related to factors related to mental symptoms such as marital conflict, traffic accident, work stress, fear of natural disaster, anger, stress, illness, and the like.
  • Moving images and still images include key words that reflect the contents in the dictionary so that they can be used as a combination of key words in the biosignal analysis process.
  • each text image is provided in the form of a word, a clause, or a simple sentence, and is used as a combination of key words in the biosignal analysis process.
  • videos and still images are presented to include text related to factors associated with mental symptoms, such as marital conflict, traffic accidents, work stress, fear of natural disasters, anger, stress, illness, etc.
  • FIG. 7 is a diagram for describing a process of classifying the detected biosignal patterns in a morphological and ranking order.
  • the biosignal pattern analysis unit 330 classifies audiovisual contents that have been provided according to the change state of the biosignal detected by the biosignal detection apparatus 200 in form and rank.
  • the pattern classification control unit 340 of the biosignal pattern analysis unit 330 classifies and classifies image or text images that show similar changes in biosignal variables such as EEG, ECG, and heart rate. .
  • biosignal variables such as EEG, ECG, and heart rate.
  • ranking classification the degree of sympathetic nerve increase between biological signals is graded, and the image and text images are grouped in the order of high level to low level according to the level. In this case, the more severe the increased state, the more severe anxiety or psychological conflict can be judged.
  • the combinations of various biosignals which indicate an increase in sympathetic nerves, may be classified into grades I, II, and III according to the degree, and the class III is most increased according to the level and grade.
  • the image contents belonging to group III can be judged to be the group with the most emotional change.
  • the degree of increase of the sympathetic nerve between the biological signals can be graded to classify the image image and the text image from high to low grade.
  • the psychiatric symptoms and psychological state of the user or patient are judged based on the results of morphological and ranking analysis.
  • FIG. 8 is a diagram for describing in detail a process of morphologically analyzing the detected biosignal pattern.
  • the pattern analysis control unit 350 of the biosignal pattern analysis unit 330 combines key words representing image characteristics into grouped image and text image groups to form a property of a group. As an enemy.
  • linguistic expressions are made by combining key words including meanings inherent in the classified images according to factors such as work stress, anger, and family discord.
  • FIG. 8 it can be seen that two groupings are performed by an image combination showing anger response due to work stress in a company and an image combination related to family discord.
  • morphological interpretation it does not mean the degree of symptom, but may be duplicated or separate from the ranking interpretation reflecting the severity of symptoms by grouping images having similar emotional expression levels. have.
  • FIG. 9 is a diagram for describing in detail a process of analyzing the detected biosignal patterns in a rank order.
  • the pattern analysis control unit 350 of the biosignal pattern analysis unit 330 combines key words meaning image characteristics into video image and text image groups classified in rank order to express the attribute of the group. As an enemy.
  • the degree of emotion change is determined for each of the classified I, II, and III grades by combining the levels of various biological signals according to the ranking classification information, and the result information related to the symptoms may be generated in the order of the grade according to the emotion change.
  • the conflict with the boss shows the greatest stress
  • the financial problems and the heavy workload in the company are relatively less
  • the stress level is lowest for the problems of parenting or marital conflict in the family. have. That is, the image related to the symptom can be mainly determined to be related to the boss in the company, and the result information can be confirmed.
  • the biometrics of a patient or a user who includes the psychiatric symptom-inducing factor or encounters the audiovisual content related to the psychiatric symptoms By analyzing and interpreting signal change patterns in a morphological and orderly manner, it is possible to objectively diagnose psychological symptoms and psychological states so that diagnostic data can be used as an objective evaluation data during clinical interviews. In this way, the diagnosis results can be used as an objective evaluation data when interviewing patients with mental symptoms in hospitals or various institutions, which can help diagnose the mental state accurately.
  • the audio-visual content implementation device that selectively provides the audio-visual content that includes the psychotic symptoms or associated with the psychotic symptoms, the user of the audiovisual content
  • a biosignal detection apparatus for detecting and realizing biosignal data in real time and sharing the data of the biosignal information, and monitoring the change state of the detected biosignal in real time and analyzing and interpreting the pattern of the biosignal change to analyze the user's mental symptoms and mental state.
  • a mental symptom analysis module that outputs evaluation results of mental symptoms, and includes patterns of changes in the biosignal patterns of patients or users who include psychotic factors or come into contact with audiovisual contents related to mental symptoms.
  • the diagnostic data from a clinical interview by allowing the state to be accurately diagnosed can be used to make an objective assessment data.
  • the results of the diagnosis can be used as objective evaluation data in interviews with patients with psychiatric symptoms in hospitals and various institutions, which can help to accurately diagnose the mental state and can be used in the overall medical industry.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Veterinary Medicine (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Psychiatry (AREA)
  • Cardiology (AREA)
  • Psychology (AREA)
  • Physiology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Dermatology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis is disclosed. The present invention analyzes and interprets, in a morphological and ranked manner, bio-signal change patterns of patients or users who have been exposed to audio-visual content comprising psychiatric symptom-inducing factors or relating to psychiatric symptoms so as to objectively and accurately diagnose psychiatric symptoms and psychological states, thereby enabling diagnosis data to be utilized as objective evaluation data in clinical interviews.

Description

시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템Psychosymmetry Evaluation System Using Audiovisual Contents and Biosignal Analysis
본 발명은 정신증상 진단 방식에 관한 것으로, 상세하게는 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접한 환자나 사용자의 생체 신호 변화 패턴을 형태적, 순위적으로 분석하고 해석하여 객관적으로 정신증상과 심리상태가 정확하게 진단될 수 있도록 함으로써, 진단 자료가 임상에서의 면담시 객관적인 평가 자료로 활용될 수 있도록 한 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템에 관한 것이다.The present invention relates to a method for diagnosing psychiatric symptoms. Specifically, the present invention relates to an analysis of physiological and morphological patterns of patients or users who include psychotic symptoms or to audiovisual content related to mental symptoms. The present invention relates to a psychiatric symptom evaluation system using audiovisual content and biosignal analysis, which enables the diagnosis of psychological symptoms and psychological conditions to be used as an objective evaluation data during clinical interviews.
사회가 복잡해지고 경쟁이 치열해지면서 스트레스나 흡연이나 음주 중독뿐 아니라, 게임 중독 등의 중독 질환, 우울증, 불안 장애 등 다양한 정신 증상들이 증가하고있는 추세이다. 그러나 정신 증상은 두통이나 통증 등 내과적 증상보다 표현하기가 어렵고 임상 면담만으로는 객관적인 평가가 어렵다. 이에 따라, 정신 증상의 평가를 위해서는 주로 임상에서 환자와 정신과 전문의 혹은 심리상담사 등과의 면담과 설문 과정을 통해 대부분 이루어지고 있다. As society becomes more complex and competitive, various mental symptoms such as addiction diseases such as game addiction, depression and anxiety disorder, as well as stress, smoking and drinking addiction are increasing. However, mental symptoms are more difficult to express than medical symptoms such as headache or pain, and objective evaluation is difficult by clinical interview alone. Accordingly, the evaluation of mental symptoms is mostly done through interviews and questionnaires with patients and psychiatrists or psychological counselors in clinical practice.
그러나 환자가 증상을 일부러 숨기거나 과장하는 경우가 있고, 소아의 경우 언어 표현의 한계 등으로 객관적인 평가가 어려워지는 경우가 있다. 이를 보완하기 위해서 대한민국 공개특허공보 제10-2014-0000389호(2014.21.03, 공보)에 제시된 바와 같이, 문진표나 설문지 형태 혹은 놀이를 통한 객관적 평가가 병행되고 있다. 하지만 이 또한 환자가 설문지의 내용을 이해하지 못하거나, 병원이나 시설의 특수성으로 자신의 증상을 행동으로 적절히 표현하지 못하면 역시 객관적 평가가 왜곡되는 문제가 있었다.However, the patient may hide or exaggerate the symptoms deliberately, and in children, objective evaluation may be difficult due to the limitation of language expression. To compensate for this, as disclosed in Korean Patent Laid-Open Publication No. 10-2014-0000389 (2014.21.03, publication), an objective evaluation through a questionnaire or questionnaire form or play is performed in parallel. However, there was also a problem that the objective evaluation was distorted if the patient did not understand the contents of the questionnaire or if the symptoms of the hospital or the facility did not properly express their symptoms in action.
따라서, 상기와 같은 문제점을 해결하기 위한 본 발명의 목적은 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접한 환자나 사용자의 생체 신호 변화 패턴을 형태적, 순위적으로 분석하고 해석하여 객관적으로 정신증상과 심리상태가 정확하게 진단될 수 있도록 함으로써, 진단 자료가 임상에서의 면담시 객관적인 평가 자료로 활용될 수 있도록 한 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템을 제공하는 것이다.Accordingly, an object of the present invention for solving the above problems is to objectively analyze and interpret patterns of biosignal changes of patients or users including psychotic symptoms causing factors or contact with audiovisual contents related to psychotic symptoms. It is to provide a psychological evaluation system using audiovisual content and biosignal analysis, which enables the diagnosis of psychological symptoms and psychological state to be accurately diagnosed, so that the diagnostic data can be used as an objective evaluation data during the interview in the clinic.
상기와 같은 목적을 달성하기 위한 본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템은 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 선택적으로 제공하는 시청각 콘텐츠 구현 장치, 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유하는 생체신호 검출장치, 및 검출되는 생체신호의 변화 상태를 실시간 모니터링하고 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함과 아울러 정신 증상에 대한 평가결과를 출력하는 정신증상 분석모듈을 포함한다.Psychotic symptom evaluation system using audiovisual content and bio-signal analysis according to an embodiment of the present invention for achieving the above object implements audiovisual content that selectively provides audiovisual content that includes psychotic symptoms or related to mental symptoms Device, a biosignal detection device which detects and biometrics a user's biosignal in contact with audio-visual content in real time and shares the data-signed biosignal information, and monitors the change state of the detected biosignal in real time and analyzes and analyzes the pattern of the biosignal change It includes a mental symptoms analysis module for determining the mental symptoms and psychological state of the user and output the evaluation results for the mental symptoms.
상기에서 설명한 본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템에 의하면, 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접한 환자나 사용자의 생체 신호 변화 패턴을 형태적, 순위적으로 분석하고 해석하여 객관적으로 정신증상과 심리상태가 정확하게 진단될 수 있도록 함으로써, 진단 자료가 임상에서의 면담시 객관적인 평가 자료로 활용될 수 있도록 할 수 있다. 이렇게, 진단 결과가 병의원이나 여러 기관에서 정신증상을 가진 환자와의 면담시 객관적 평가 자료로 활용됨으로써 정확한 정신적 상태 진단에 도움을 줄 수 있다. According to the psychological symptom evaluation system using the audiovisual content and the biosignal analysis according to the embodiment of the present invention described above, the pattern of the biosignal change of the patient or user who includes the psychotic symptoms causing factors or touches the audiovisual content related to the psychotic symptoms By analyzing and interpreting morphologically and ranking objectively, it is possible to objectively diagnose psychological symptoms and psychological conditions, so that the diagnostic data can be used as objective evaluation data during interviews in clinical practice. In this way, the diagnosis results can be used as an objective evaluation data when interviewing patients with mental symptoms in hospitals or various institutions, which can help diagnose the mental state accurately.
또한, 환자나 사용자가 시설이나 병의원에 방문하지 않고 가정에서 원격 진료를 통한 정신증상의 평가를 도울 수 있으며, 이미지 및 음향이 포함된 콘텐츠의 분석 알고리듬을 통해 다양한 정신 증상을 호전시킬 수 있는 치료방법의 개발이 가능하다. 아울러, 시청각 콘텐츠 체험에 대한 심리적 상태 평가가 가능하기 때문에 다양한 산업 분야에서 맞춤형 콘텐츠 제공에 도움을 줄 수 있는 효과가 있다.In addition, it can help patients or users to assess mental symptoms through remote medical care at home without visiting the facility or hospital, and can improve various mental symptoms through an analysis algorithm of contents including image and sound. Development is possible. In addition, since it is possible to evaluate the psychological state of the audiovisual content experience, there is an effect that can help to provide customized content in various industries.
도 1은 본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템 구성을 개략적으로 나타낸 구성도이다. 1 is a schematic diagram showing the configuration of a psychological symptom evaluation system using audiovisual content and biosignal analysis according to an embodiment of the present invention.
도 2는 도 1에 도시된 생체신호 검출장치 구성을 세부적으로 나타낸 구성도이다. FIG. 2 is a diagram illustrating in detail the configuration of the biosignal detecting apparatus illustrated in FIG. 1.
도 3은 도 1에 도시된 정신증상 분석모듈을 세부적으로 나타낸 구성 블록도이다. 3 is a block diagram illustrating in detail the mental symptoms analysis module shown in FIG.
도 4는 본 발명의 실시 예에 따른 정신증상을 판단하는 과정을 순차적으로 나타낸 순서도이다. 4 is a flowchart sequentially illustrating a process of determining a mental symptom according to an embodiment of the present invention.
도 5는 본 발명의 실시 예에 따른 정신증상을 분류하고 해석하는 과정을 순차적으로 나타낸 순서도이다. 5 is a flowchart sequentially illustrating a process of classifying and interpreting psychotic symptoms according to an exemplary embodiment of the present invention.
도 6은 정신증상과 관련된 시각적인 콘텐츠 제공 과정을 설명하기 위한 도면이다. 6 is a view for explaining a process of providing visual content related to mental symptoms.
도 7은 검출된 생체신호 패턴을 형태적이고 순위적으로 분류하는 과정을 설명하기 위한 도면이다. FIG. 7 is a diagram for describing a process of classifying the detected biosignal patterns in a morphological and ranking order.
도 8은 검출된 생체신호 패턴을 형태적으로 해석하는 과정을 구체적으로 설명하기 위한 도면이다. 8 is a diagram for describing in detail a process of morphologically analyzing the detected biosignal pattern.
도 9는 검출된 생체신호 패턴을 순위적으로 해석하는 과정을 구체적으로 설명하기 위한 도면이다.9 is a diagram for describing in detail a process of analyzing the detected biosignal patterns in a rank order.
이하, 본 발명의 실시 예를 첨부한 도면들을 참조하여 상세히 설명하기로 한다. Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
도 1은 본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템 구성을 개략적으로 나타낸 구성도이다. 1 is a schematic diagram showing the configuration of a psychological symptom evaluation system using audiovisual content and biosignal analysis according to an embodiment of the present invention.
도 1에 도시된 정신증상 평가 시스템은 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 선택적으로 제공하는 시청각 콘텐츠 구현장치(100), 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유하는 생체신호 검출장치(200), 및 검출되는 생체신호의 변화 상태를 실시간 모니터링하고 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함과 아울러 정신증상에 대한 평가결과를 출력하는 정신증상 분석모듈(300)을 포함하여 구성된다. The psychotic symptom evaluation system shown in FIG. 1 includes an audiovisual content implementation apparatus 100 that selectively provides audiovisual contents including psychotic symptoms causing factors or psychotic symptoms, and detects and biometrics a user's biosignal in real time. The biosignal detection apparatus 200 sharing the biosignal information, which is data, and monitors the change state of the detected biosignal in real time, and analyzes and analyzes the pattern of the biosignal change to determine the mental symptoms and the psychological state of the user. It is configured to include a mental symptoms analysis module 300 for outputting the evaluation results for the mental symptoms.
또한, 정신 증상 분석모듈(300)에 생체신호 분석 기준 데이터를 제공하여 분석 과정을 지원하면서도 정신 증상 분석모듈(300)에서 판단된 정신증상 및 정신증상에 대한 평가결과를 저장함과 아울러, 상기의 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 지원하는 관리 서버(미도시)를 더 포함하기도 한다. In addition, while supporting the analysis process by providing the bio-signal analysis reference data to the mental symptom analysis module 300, while storing the evaluation results of the mental symptoms and mental symptoms determined in the mental symptom analysis module 300, the mental It may further include a management server (not shown) that includes the symptom-inducing factor or supports audiovisual content related to mental symptoms.
시청각 콘텐츠 구현장치(100)는 사용자가 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접할 수 있도록 정신증상 분석모듈(300)에서 미리 설정 및 선택된 시청각 콘텐츠를 표시 및 제공한다. 여기서, 정신증상과 관련된 시청각 콘텐츠는 미리 설정된 정신증상 유발 요인의 종류 및 수위에 따라 단계적으로 설정 및 분류되어 있다. 이에, 시청각 콘텐츠 구현장치(100)는 정신증상 분석모듈(300)의 제어에 따라 정신증상 유발 요인의 종류별로 그 수위가 높아지도록 설정된 시청각 콘텐츠를 단계적으로 환자나 사용자에게 제공하게 된다. The audiovisual content implementing apparatus 100 displays and provides audiovisual content that is preset and selected by the mental symptom analysis module 300 so that a user may encounter audiovisual contents including a psychotic symptom-inducing factor or mental symptoms. Here, the audiovisual content related to the psychotic symptoms is set and classified step by step according to the type and level of the psychotic symptom causing factors in advance. Accordingly, the audiovisual content implementing apparatus 100 provides the audiovisual content to the patient or the user step by step to increase the level of the psychotic symptom causing factor under the control of the psychotic symptom analyzing module 300.
환자나 사용자는 중독 질환이나 우울증, 불안 등의 정신 질환뿐 아니라 생활 속 스트레스 질환 등과 관련된 다양한 정신 증상을 가지고 있을 수 있다. 이에, 해당 정신 증상을 판단하기 위해 미리 설정된 정신증상 유발 요인의 종류 및 수위에 따라 설정 및 분류된 시청각 콘텐츠를 단계적으로 제공한 후, 각 단계별로 검출되는 생체 신호의 패턴 변화 분석 결과에 따라서는 해당 정신 증상을 판단하고 정신증상에 대한 평가결과를 도출하게 된다. The patient or the user may have various mental symptoms related to stress disorders, as well as mental illnesses such as addiction disease, depression, and anxiety. Therefore, in order to determine the mental symptoms, the audiovisual contents set and classified according to the type and level of psychotic symptoms causing factors are provided step by step, and according to the pattern change analysis result of the bio signals detected at each stage. The mental symptoms are judged and evaluation results of the mental symptoms are derived.
정신증상 유발 요인의 종류 및 수위에 따라 설정 및 분류된 시청각 콘텐츠를 단계적으로 제공하기 위해 시청각 콘텐츠 구현장치(100)는 영상 표시 스크린이나 영상 표시패널, 또는 가상현실 헤드셋이나 태블릿 이동 통신기기 등으로 구성되는 영상 표시모듈, 및 사운드 스피커나 이어폰 또는 헤드셋 등으로 구성되는 오디오 모듈을 포함하여 구성되며, 이와 더불어 향기 발현 모듈이나 햅틱 모듈 등이 더 구비되어 후각이나 촉각적인 콘텐츠 또한 단계적으로 제공할 수도 있다. 특히, 시청각 콘텐츠 구현장치(100)는 더욱 정확한 콘텐츠를 제공하기 위해 가상현실(virtual reality) 혹은 증강현실(augmented reality), 3D 홀로그램 등이 선택적으로 활용될 수도 있다. In order to provide the audiovisual contents set and classified according to the types and levels of psychotic symptoms, the audiovisual content implementing apparatus 100 includes a video display screen, a video display panel, a virtual reality headset, a tablet mobile communication device, and the like. It is configured to include an image display module, and an audio module composed of a sound speaker, earphone or headset, etc. In addition, the fragrance expression module or haptic module may be further provided to provide olfactory or tactile content in stages. In particular, the audiovisual content implementing apparatus 100 may selectively use virtual reality, augmented reality, 3D hologram, or the like to provide more accurate content.
도 2는 도 1에 도시된 생체신호 검출장치 구성을 세부적으로 나타낸 구성도이다. FIG. 2 is a diagram illustrating in detail the configuration of the biosignal detecting apparatus illustrated in FIG. 1.
도 2를 참조하면, 도 2에 도시된 생체신호 검출장치(200)는 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유한다. 이러한 생체신호 검출장치(200)는 사용자의 생체 신호, 예를 들어 심박수(HR), 뇌파(EEG), 심전도(ECG), 근전도(EMG), 피부 저항도(GSR), HRV(심 박 변이도) 등과 같은 생체신호를 실시간 검출한 후, 아날로그의 검출 신호를 디지털 데이터 신호로 데이터화 하여 데이터화된 생체신호 정보를 공유한다.Referring to FIG. 2, the biosignal detection apparatus 200 illustrated in FIG. 2 detects and converts a biosignal of a user in contact with an audiovisual content in real time to share data. The biosignal detecting apparatus 200 may include a user's biosignal, for example, heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability). After real-time detection of a biosignal such as the like, the analog detection signal is converted into a digital data signal to share the data of the biosignal information.
또한, 생체신호 검출장치(200)는 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유한다. 이러한 생체신호 검출장치(200)는 사용자의 생체 신호, 예를 들어 심박수(HR), 뇌파(EEG), 심전도(ECG), 근전도(EMG), 피부 저항도(GSR), HRV(심 박 변이도) 동공 크기, 안구 움직임, 안면 근육의 변화 등 적어도 하나의 생체 신호를 실시간 검출한 후, 아날로그의 검출 신호를 디지털 데이터 신호로 데이터화 하여 데이터화된 생체신호 정보를 공유한다.In addition, the biosignal detection apparatus 200 detects and converts the biosignal of the user who has encountered the audiovisual content in real time into data and shares the dataized biosignal information. The biosignal detecting apparatus 200 may include a user's biosignal, for example, heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability). After detecting at least one biosignal such as pupil size, eye movement, facial muscle changes, etc. in real time, the analog detection signal is converted into a digital data signal to share the data.
또한, 생체신호 검출장치(200)는 생체신호 정보와 더불어 안구추적(Eye Tracking) 정보와 표정변화 분석(Facial Expression Recognition) 정보를 수집하여 정신증상 분석모듈(300)과 공유하기도 한다. 이를 위해, 생체신호 검출장치(200)는 대뇌 신호 측정부(210), 심장 신호 측정부(220), 근육 신호 측정부(230), 피부 및 체온 신호 측정부(240), 및 A/D 변환부(250), 제 1 통신부(260)를 구비하여 구성된다. In addition, the biosignal detecting apparatus 200 may collect eye tracking information and facial expression recognition information along with the biosignal information and share the same with the mental symptom analysis module 300. To this end, the biosignal detecting apparatus 200 includes a cerebral signal measuring unit 210, a heart signal measuring unit 220, a muscle signal measuring unit 230, a skin and body temperature signal measuring unit 240, and an A / D conversion. The unit 250 and the first communication unit 260 are provided.
또한, 생체신호 검출장치(200)는 안구 및 안면 신호 측정부(270)를 더 포함할 수 있다.In addition, the biosignal detecting apparatus 200 may further include an eyeball and a face signal measuring unit 270.
구체적으로, 대뇌 신호 측정부(210)는 시청각 콘텐츠를 접한 사용자의 뇌파(EEG)를 실시간 검출하여 실시간으로 뇌파 신호를 측정하고, 측정된 신호를 A/D 변환부(250) 및 제 1 통신부(260)로 전송한다. In detail, the cerebral signal measuring unit 210 detects EEG of a user who is in contact with audiovisual content in real time, measures an EEG signal in real time, and measures the measured signal using the A / D converter 250 and the first communication unit ( 260).
심장 신호 측정부(220)는 시청각 콘텐츠를 접한 사용자의 심전도(ECG) 및 HRV(심박변이도)를 검출하여 실시간으로 심전도 및 심박변이 신호를 측정하고, 실시간으로 측정된 신호를 A/D 변환부(250) 및 제 1 통신부(260)로 전송한다. The cardiac signal measuring unit 220 detects the electrocardiogram (ECG) and HRV (heart rate variability) of the user who is in contact with the audiovisual content, measures the electrocardiogram and heart rate signal in real time, and converts the measured signal into an A / D converter ( 250) and the first communication unit 260.
근육 신호 측정부(230)는 시청각 콘텐츠를 접한 사용자의 근전도(EMG)를 검출하여 실시간으로 근전도 신호를 측정하고, 측정된 신호를 A/D 변환부(250) 및 제 1 통신부(260)로 전송한다. The muscle signal measuring unit 230 detects EMG of the user in contact with the audiovisual content, measures the EMG signal in real time, and transmits the measured signal to the A / D converter 250 and the first communication unit 260. do.
피부 및 체온 신호 측정부(240)는 시청각 콘텐츠를 접한 사용자의 체온과 피부 저항도(GSR)를 검출하여 실시간으로 피부 저항 신호를 측정하고, 실시간으로 측정된 신호를 A/D 변환부(250) 및 제 1 통신부(260)로 전송한다. The skin and body temperature signal measuring unit 240 detects the body temperature and skin resistance (GSR) of the user in contact with the audiovisual content, measures the skin resistance signal in real time, and converts the measured signal in real time into the A / D converter 250. And transmits to the first communication unit 260.
안구 및 안면 신호 측정부(270)는 시청각 콘텐츠를 접한 사용자의 동공 크기, 안구 움직임 및 안면 근육의 변화를 검출하여 실시간으로 안구 추적 정보 및 표정 변화를 측정하고, 실시간으로 측정된 안구 추적 정보 및 표정 변화를 A/D 변환부(250) 및 제 1 통신부(260)로 전송한다.The eyeball and face signal measuring unit 270 detects changes in pupil size, eye movement, and facial muscles of the user in contact with audiovisual content to measure eye tracking information and facial expressions in real time, and measured eye tracking information and facial expressions in real time. The change is transmitted to the A / D converter 250 and the first communication unit 260.
A/D 변환부(250)는 심박수(HR), 뇌파(EEG), 심전도(ECG), 근전도(EMG), 피부 저항도(GSR), HRV(심박변이도)에 따른 아날로그 신호를 실시간 디지털 데이터로 변환하여 제 1 통신부(260)로 제공한다. The A / D converter 250 converts analog signals according to heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electrocardiogram (EMG), skin resistance (GSR) and HRV (heart rate variability) into real-time digital data. The conversion is provided to the first communication unit 260.
또한, A/D 변환부(250)는 심박수(HR), 뇌파(EEG), 심전도(ECG), 근전도(EMG), 피부 저항도(GSR), HRV(심박변이도), 안구 추적 정보 및 표정 변화에 따른 아날로그 신호를 실시간 디지털 데이터로 변환하여 제 1 통신부(260)로 제공한다.In addition, the A / D converter 250 may include heart rate (HR), brain wave (EEG), electrocardiogram (ECG), electromyogram (EMG), skin resistance (GSR), HRV (heart rate variability), eye tracking information, and facial expression change. The analog signal is converted into real-time digital data and provided to the first communication unit 260.
제 1 통신부(260)는 뇌파 신호, 심전도 및 심박변이 신호, 근전도 신호, 피부 저항 및 체온 신호를 정신증상 분석모듈(300)로 실시간 전송하여 공유되도록 한다. The first communication unit 260 transmits EEG signals, ECG and heart rate signals, EMG signals, skin resistance, and body temperature signals to the psychological symptom analysis module 300 to be shared in real time.
또한, 제 1 통신부(260)는 뇌파 신호, 심전도 및 심박변이 신호, 근전도 신호, 피부 저항 및 체온 신호, 안구 추적 정보 및 표정 변화를 정신증상 분석모듈(300)로 실시간 전송하여 공유되도록 한다.In addition, the first communication unit 260 transmits EEG signals, electrocardiograms and heart rate signals, EMG signals, skin resistance and body temperature signals, eye tracking information, and facial expression changes to the psychological symptom analysis module 300 to be shared in real time.
도 3은 도 1에 도시된 정신증상 분석모듈을 세부적으로 나타낸 구성 블록도이다. 3 is a block diagram illustrating in detail the mental symptoms analysis module shown in FIG.
도 3에 도시된 정신증상 분석모듈(300)은 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 단계적이면서도 선택적으로 사용자나 환자에게 제공하도록 시청각 콘텐츠 구현장치(100)를 제어함과 아울러, 이와 동시에 실시간으로 생체신호 검출장치(200)에서 검출되는 생체신호의 변화 상태를 실시간 모니터링하고, 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함으로써 정신증상에 대한 평가결과를 생성 및 출력한다. The psychological symptom analysis module 300 illustrated in FIG. 3 controls the audiovisual content implementing apparatus 100 to provide the user or patient with the audiovisual contents including the psychotic symptom causing factors or the mental symptoms in a stepwise manner and selectively. At the same time, in real-time monitoring the state of change of the bio-signals detected by the bio-signal detection apparatus 200 in real time, and analyzes and interprets the change pattern of the bio-signals to determine the mental symptoms and psychological state of the user to evaluate the psychological symptoms Create and print
이를 위해, 정신증상 분석모듈(300)은 이미지 지원 제공부(310), 생체신호 패턴 분석부(330), 생체신호 표시부(320), 사용자나 환자의 정신증상 및 심리상태 판단 결과를 내외부로 전송하여 공유하는 제 2 통신부(360)를 포함하여 구성될 수 있다. To this end, the mental symptom analysis module 300 transmits the image support providing unit 310, the biosignal pattern analysis unit 330, the biosignal display unit 320, the mental symptoms and psychological state determination results of the user or patient to the inside and the outside. It may be configured to include a second communication unit 360 to share.
구체적으로, 정신증상 분석모듈(300)의 이미지 지원 제공부(310)는 정신증상 유발 요인의 종류 및 수위에 따라 설정 및 분류된 시청각 콘텐츠를 단계적이면서도 선택적으로 사용자나 환자에게 제공하도록 시청각 콘텐츠 구현장치(100)를 제어한다. 시청각 콘텐츠 중 시각 콘텐츠의 경우는 동영상 및 정지 영상 이미지와 텍스트 이미지가 조합되어 평가를 위해 순차적으로 제공되도록 형성되되 정신 증상의 종류와 수위에 따른 단계별로 다양한 영상과 텍스트가 조합되어 구성될 수 있다. In detail, the image support providing unit 310 of the psychotic symptom analysis module 300 implements audiovisual contents to provide the user or patient with staged and selectively provided audiovisual contents set and classified according to the type and level of the mental symptom inducing factor. Control 100. In the case of visual content among audiovisual contents, a video, a still image image, and a text image are combined to be sequentially provided for evaluation, but various images and texts may be combined in stages according to the types and levels of mental symptoms.
하기의 표 1을 참조하면, 생체신호 패턴 분석부(330)는 생체신호 검출장치(200)에서 검출되는 생체신호의 변화 상태를 실시간 모니터링하고, 데이터화된 생체신호 정보를 미리 설정된 생체신호 분석 기준 데이터(참고치)와 비교 분석함으로써 생체신호의 변화 패턴을 분석 및 해석하여 사용자나 환자의 정신증상 및 심리상태를 판단하게 된다. 이때, 생체신호 표시부(320)는 사용자나 환자 또는 의사나 전문가들이 시각적으로 확인할 수 있도록 생체신호 검출장치(200)에서 검출되는 데이터화된 생체신호 정보 수치화하거나 그래프 등으로 표시한다. Referring to Table 1 below, the biosignal pattern analysis unit 330 monitors the change state of the biosignals detected by the biosignal detection apparatus 200 in real time, and sets the biosignal information in advance to set biosignal analysis reference data. By comparing with (Reference value), it analyzes and interprets the change pattern of the biosignal to determine the mental symptoms and psychological state of the user or patient. In this case, the biosignal display unit 320 digitizes or displays the graphicized biosignal information detected by the biosignal detection apparatus 200 so as to be visually confirmed by a user, a patient, a doctor, or an expert.
[표 1]TABLE 1
Figure PCTKR2017005000-appb-I000001
Figure PCTKR2017005000-appb-I000001
한편, 생체신호 패턴 분석부(330)는 생체신호 검출장치(200)에서 검출되는 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 형태적, 순위적으로 각각 분류한 다음, 형태적, 순위적으로 각각 해석하여 형태적, 순위적으로 각각 해석된 결과를 토대로 사용자나 환자의 정신증상 및 심리상태를 판단하게 된다. 이를 위해, 생체신호 패턴 분석부(330)는 패턴 분류 제어부(340) 및 패턴 해석 제어부(350)로 구분되어 구성될 수 있다. Meanwhile, the biosignal pattern analyzer 330 classifies audiovisual contents provided in accordance with the state of change of the biosignal detected by the biosignal detection apparatus 200 in form and rank, and then forms and ranks them. By interpreting each form, the psychological symptoms and psychological state of the user or patient are judged based on the results of the analysis. To this end, the biosignal pattern analyzer 330 may be divided into a pattern classification controller 340 and a pattern analysis controller 350.
이와 같이 구성된 본 발명의 실시 예에 따른 정신증상 분석모듈(300)에서의 정신 증상 판단 과정을 구체적으로 살펴보면 다음과 같다. Looking at the psychological symptoms determination process in the psychological symptoms analysis module 300 according to an embodiment of the present invention configured as described above are as follows.
도 4는 본 발명의 실시 예에 따른 정신 증상을 판단하는 과정을 순차적으로 나타낸 순서도이다. 4 is a flowchart sequentially illustrating a process of determining a mental symptom according to an embodiment of the present invention.
도 4를 참조하면, 먼저 시청각 콘텐츠 구현장치(100)에서는 정신증상 분석모듈(300)에서의 제어에 따라 정신증상 유발 요인의 종류 및 수위에 따라 설정 및 분류된 시청각 콘텐츠를 단계적이면서도 선택적으로 사용자나 환자에게 제공한다. 이에 생체신호 패턴 분석부(330)에서는 시청각 콘텐츠를 단계적으로 제공받는 사용자의 감정 변화에 따라 생체 신호가 변화되는 패턴을 검출하고, 검출되는 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 그룹화하여 동일 그룹 내에 공통 내용을 분석함으로써 정신 증상에 관련한 사고를 추론하고 추론된 사고에 해당되는 정신 증상을 판단한다. Referring to FIG. 4, first, in an audiovisual content implementing apparatus 100, a user may selectively and selectively set audiovisual content set and classified according to the type and level of a mental symptom-causing factor under the control of the psychotic symptom analysis module 300. To the patient. Accordingly, the biosignal pattern analyzer 330 detects a pattern in which a biosignal is changed according to a user's emotional change in which audiovisual content is provided in stages, and groups the audiovisual contents provided in accordance with a change state of the detected biosignal. By analyzing common content within the group, inferences related to mental symptoms are inferred and mental symptoms corresponding to the inferred accidents are judged.
다음으로, 도 5는 본 발명의 실시 예에 따른 정신 증상을 분류하고 해석하는 과정을 순차적으로 나타낸 순서도이다. 그리고 도 6은 정신 증상과 관련된 시각적인 콘텐츠 제공 과정을 설명하기 위한 도면이다. Next, FIG. 5 is a flowchart sequentially illustrating a process of classifying and interpreting mental symptoms according to an exemplary embodiment of the present invention. 6 is a view for explaining a process of providing visual content related to mental symptoms.
도 5를 참조하여 정신 증상을 분류하고 해석하는 과정을 살펴보면, 추론된 사고에 해당되는 정신 증상을 판단된 이후에는 판단된 정신증상과 각각 관련된 시청각 콘텐츠가 단계별로 순차 제공된다. Looking at the process of classifying and interpreting the mental symptoms with reference to FIG. 5, after the mental symptoms corresponding to the inferred accident are determined, audiovisual contents related to the determined mental symptoms are sequentially provided step by step.
도 6과 같이, 시청각 콘텐츠 중 시각 콘텐츠의 경우는 동영상 및 정지 영상 이미지와 텍스트 이미지가 조합되어 평가를 위해 순차적으로 제공되도록 형성되되 정신 증상의 종류와 수위에 따른 단계별로 다양한 영상과 텍스트가 조합되어 구성될 수 있다. 구체적으로, 동영상 및 정지 영상 이미지에는 정신 증상 요인과 관련된 요인, 즉 부부갈등, 교통사고, 업무 스트레스, 자연재해에 따른 두려움, 분노, 스트레스, 질병 등과 관련된 내용이 포함되도록 제시된다. 이에, 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 그룹화할 때, 형태적으로 분류할 수 있다. As shown in FIG. 6, in the case of visual content among audiovisual contents, a video, a still image image, and a text image are combined to be sequentially provided for evaluation, but various images and texts are combined in stages according to types and levels of mental symptoms. Can be configured. Specifically, the moving image and the still image are presented to include contents related to factors related to mental symptoms such as marital conflict, traffic accident, work stress, fear of natural disaster, anger, stress, illness, and the like. Thus, when grouping the audiovisual contents provided according to the change state of the bio-signal, it can be classified formally.
동영상 및 정지 영상 이미지에는 사전에 내용을 반영하는 핵심 단어를 포함하고 있어 생체신호 분석 과정에서 핵심 단어의 조합으로 활용되도록 한다. 반면, 텍스트 이미지에서는 각 텍스트 이미지는 단어나 절, 간단한 문장 형태로 제공되며 생체신호 분석 과정에서 핵심 단어의 조합으로 활용된다. 마찬가지로, 동영상 및 정지 영상 이미지에 정신 증상 요인과 관련된 요인, 즉 부부갈등, 교통사고, 업무 스트레스, 자연재해에 따른 두려움, 분노, 스트레스, 질병 등과 관련된 내용의 텍스트가 포함되도록 제시되어, 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 그룹화할 때, 형태적으로 분류할 수 있다. Moving images and still images include key words that reflect the contents in the dictionary so that they can be used as a combination of key words in the biosignal analysis process. On the other hand, in the text image, each text image is provided in the form of a word, a clause, or a simple sentence, and is used as a combination of key words in the biosignal analysis process. Similarly, videos and still images are presented to include text related to factors associated with mental symptoms, such as marital conflict, traffic accidents, work stress, fear of natural disasters, anger, stress, illness, etc. When grouping the audiovisual contents which have been provided according to the change state, it can be classified formally.
도 7은 검출된 생체신호 패턴을 형태적이고 순위적으로 분류하는 과정을 설명하기 위한 도면이다. FIG. 7 is a diagram for describing a process of classifying the detected biosignal patterns in a morphological and ranking order.
도 7과 같이, 생체신호 패턴 분석부(330)는 생체신호 검출장치(200)에서 검출되는 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 형태적, 순위적으로 각각 분류한다. As illustrated in FIG. 7, the biosignal pattern analysis unit 330 classifies audiovisual contents that have been provided according to the change state of the biosignal detected by the biosignal detection apparatus 200 in form and rank.
구체적으로, 생체신호 패턴 분석부(330)의 패턴 분류 제어부(340)에서는 형태적인 분류시에는 뇌파, 심전도, 심박수 등 생체신호 변수들 간에 비슷한 양상의 변화를 보이는 영상 혹은 텍스트 이미지들을 그룹화하여 분류한다. 그리고 순위적인 분류시에는 생체 신호간 교감신경의 증가 정도를 등급화하여 그 수위에 따라 높은 등급에서부터 낮은 등급 순으로 영상이미지 및 텍스트 이미지끼리 그룹화한다. 이때는 증가된 상태가 심할수록 불안 혹은 심리적 갈등이 심한 상태인 것으로 판단 가능하다. In detail, the pattern classification control unit 340 of the biosignal pattern analysis unit 330 classifies and classifies image or text images that show similar changes in biosignal variables such as EEG, ECG, and heart rate. . In the case of ranking classification, the degree of sympathetic nerve increase between biological signals is graded, and the image and text images are grouped in the order of high level to low level according to the level. In this case, the more severe the increased state, the more severe anxiety or psychological conflict can be judged.
도 7을 참조하면, 순위적인 분류시에는 교감 신경 증가를 의미하는 여러 생체 신호의 조합을 정도에 따라 I, II, III 등급으로 분류할 수 있으며, 그 수위와 등급에 따라 III급이 가장 증가한 형태에서 III군에 속해있는 이미지 내용들이 감정의 변화가 가장 심한 그룹임을 판단할 수 있다. 즉, 생체 신호간 교감신경의 증가 정도를 등급화하여 높은 등급에서 부터 낮은 등급 순으로 영상이미지 및 텍스트 이미지끼리 그룹화하여 분류할 수 있다. Referring to FIG. 7, in the classification, the combinations of various biosignals, which indicate an increase in sympathetic nerves, may be classified into grades I, II, and III according to the degree, and the class III is most increased according to the level and grade. The image contents belonging to group III can be judged to be the group with the most emotional change. In other words, the degree of increase of the sympathetic nerve between the biological signals can be graded to classify the image image and the text image from high to low grade.
다음으로는 형태적, 순위적으로 각각 해석하여 형태적, 순위적으로 각각 해석된 결과를 토대로 사용자나 환자의 정신증상 및 심리상태를 판단하게 된다. Next, the psychiatric symptoms and psychological state of the user or patient are judged based on the results of morphological and ranking analysis.
도 8은 검출된 생체신호 패턴을 형태적으로 해석하는 과정을 구체적으로 설명하기 위한 도면이다. 8 is a diagram for describing in detail a process of morphologically analyzing the detected biosignal pattern.
도 8을 참조하면, 생체신호 패턴 분석부(330)의 패턴 해석 제어부(350)에서는 형태적으로 분류된 영상이미지 및 텍스트 이미지 그룹들에 이미지 특성을 의미하는 핵심 단어들을 조합하여 그룹의 속성을 언어적으로 표현한다. Referring to FIG. 8, the pattern analysis control unit 350 of the biosignal pattern analysis unit 330 combines key words representing image characteristics into grouped image and text image groups to form a property of a group. As an enemy.
다시 말해, 형태적인 해석 단계에서는 업무 스트레스나 분노, 가정 불화 등의 요인에 따라 각각 분류된 이미지에 각각 내재된 의미를 포함하는 핵심 단어들을 조합하여 언어적으로 표현하게 된다. 도 8의 예시를 보면, 회사에서의 업무 스트레스로 인한 분노 반응을 보이는 이미지 조합과 가정 불화와 관련 있는 이미지 조합으로 2개의 그룹화가 이루어짐을 확인할 수 있다. 여기서, 형태적인 해석의 경우, 증상의 정도를 의미하는 것이 아니고, 비슷한 감정 표현 정도를 가진 이미지들끼리를 그룹화시켜 증상의 심각도를 반영하는 순위적 해석과 중복이 될 수도 있고 별개의 내용이 될 수도 있다. In other words, in the form of interpretation, linguistic expressions are made by combining key words including meanings inherent in the classified images according to factors such as work stress, anger, and family discord. Referring to the example of FIG. 8, it can be seen that two groupings are performed by an image combination showing anger response due to work stress in a company and an image combination related to family discord. Here, in the case of morphological interpretation, it does not mean the degree of symptom, but may be duplicated or separate from the ranking interpretation reflecting the severity of symptoms by grouping images having similar emotional expression levels. have.
도 9는 검출된 생체신호 패턴을 순위적으로 해석하는 과정을 구체적으로 설명하기 위한 도면이다. 9 is a diagram for describing in detail a process of analyzing the detected biosignal patterns in a rank order.
도 8을 참조하면, 생체신호 패턴 분석부(330)의 패턴 해석 제어부(350)에서는 순위적으로 분류된 영상이미지 및 텍스트 이미지 그룹들에 이미지 특성을 의미하는 핵심 단어들을 조합하여 그룹의 속성을 언어적으로 표현한다. Referring to FIG. 8, the pattern analysis control unit 350 of the biosignal pattern analysis unit 330 combines key words meaning image characteristics into video image and text image groups classified in rank order to express the attribute of the group. As an enemy.
순위적인 분류 정보에 따라 여러 생체 신호의 수위를 조합하여 분류된 I, II, III 등급별로 감정의 변화 정도를 판단하되, 감정 변화에 따른 등급 순으로 증상과 관련된 결과 정보를 생성할 수 있다. 도 9의 예시를 보면, 직장상사와의 갈등이 가장 큰 스트레스를 보이고 있으며 금전적 문제와 회사내 업무 과중은 상대적으로 덜했으며, 가족내의 육아 혹은 부부 갈등의 문제에 대해서는 스트레스 정도가 가장 낮음을 알 수 있다. 즉, 증상과 관련된 이미지는 주로 회사 내에서의 직장 상사와 관련된 내용임을 판단하여 그 결과 정보를 확인할 수 있다. The degree of emotion change is determined for each of the classified I, II, and III grades by combining the levels of various biological signals according to the ranking classification information, and the result information related to the symptoms may be generated in the order of the grade according to the emotion change. In the example of FIG. 9, the conflict with the boss shows the greatest stress, the financial problems and the heavy workload in the company are relatively less, and the stress level is lowest for the problems of parenting or marital conflict in the family. have. That is, the image related to the symptom can be mainly determined to be related to the boss in the company, and the result information can be confirmed.
이상에서 상술한 바와 같이, 본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템에 의하면, 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접한 환자나 사용자의 생체 신호 변화 패턴을 형태적, 순위적으로 분석하고 해석하여 객관적으로 정신증상과 심리상태가 정확하게 진단될 수 있도록 함으로써, 진단 자료가 임상에서의 면담시 객관적인 평가 자료로 활용될 수 있도록 할 수 있다. 이렇게, 진단 결과가 병의원이나 여러 기관에서 정신증상을 가진 환자와의 면담시 객관적 평가 자료로 활용됨으로써 정확한 정신적 상태 진단에 도움을 줄 수 있다. As described above, according to the psychiatric symptom evaluation system using the audiovisual content and the biosignal analysis according to an embodiment of the present invention, the biometrics of a patient or a user who includes the psychiatric symptom-inducing factor or encounters the audiovisual content related to the psychiatric symptoms By analyzing and interpreting signal change patterns in a morphological and orderly manner, it is possible to objectively diagnose psychological symptoms and psychological states so that diagnostic data can be used as an objective evaluation data during clinical interviews. In this way, the diagnosis results can be used as an objective evaluation data when interviewing patients with mental symptoms in hospitals or various institutions, which can help diagnose the mental state accurately.
또한, 환자나 사용자가 시설이나 병의원에 방문하지 않고 가정에서 원격 진료를 통한 정신증상의 평가를 도울 수 있으며, 이미지 및 음향이 포함된 콘텐츠의 분석 알고리듬을 통해 다양한 정신 증상을 호전시킬 수 있는 치료방법의 개발이 가능하다. 아울러, 시청각 콘텐츠 체험에 대한 심리적 상태 평가가 가능하기 때문에 다양한 산업 분야에서 맞춤형 콘텐츠 제공에 도움을 줄 수 있는 효과가 있다. In addition, it can help patients or users to assess mental symptoms through remote medical care at home without visiting the facility or hospital, and can improve various mental symptoms through an analysis algorithm of contents including image and sound. Development is possible. In addition, since it is possible to evaluate the psychological state of the audiovisual content experience, there is an effect that can help to provide customized content in various industries.
상기에서는 본 발명의 실시 예를 참조하여 설명하였지만, 해당 기술 분야에서 통상의 지식을 가진 자라면 하기의 특허 청구의 범위에 기재된 본 발명의 사상 및 영역으로부터 벗어나지 않는 범위 내에서 본 발명을 다양하게 수정 및 변경시킬 수 있음을 이해할 수 있을 것이다.Although the above has been described with reference to embodiments of the present invention, those skilled in the art may variously modify the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. And can be changed.
본 발명의 실시 예에 따른 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템은 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 선택적으로 제공하는 시청각 콘텐츠 구현 장치, 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유하는 생체신호 검출장치, 및 검출되는 생체신호의 변화 상태를 실시간 모니터링하고 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함과 아울러 정신 증상에 대한 평가결과를 출력하는 정신증상 분석모듈을 포함하는바, 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 접한 환자나 사용자의 생체 신호 변화 패턴을 형태적, 순위적으로 분석하고 해석하여 객관적으로 정신증상과 심리상태가 정확하게 진단될 수 있도록 함으로써, 진단 자료가 임상에서의 면담시 객관적인 평가 자료로 활용될 수 있도록 할 수 있다. 진단 결과가 병의원이나 여러 기관에서 정신증상을 가진 환자와의 면담시 객관적 평가 자료로 활용됨으로써 정확한 정신적 상태 진단에 도움을 줄 수 있으며, 의료산업 전반적인 분야에서 이용될 수 있다.Psychotic symptom evaluation system using audio-visual content and bio-signal analysis according to an embodiment of the present invention, the audio-visual content implementation device that selectively provides the audio-visual content that includes the psychotic symptoms or associated with the psychotic symptoms, the user of the audiovisual content A biosignal detection apparatus for detecting and realizing biosignal data in real time and sharing the data of the biosignal information, and monitoring the change state of the detected biosignal in real time and analyzing and interpreting the pattern of the biosignal change to analyze the user's mental symptoms and mental state. And a mental symptom analysis module that outputs evaluation results of mental symptoms, and includes patterns of changes in the biosignal patterns of patients or users who include psychotic factors or come into contact with audiovisual contents related to mental symptoms. Analyzing and interpreting rankings to objectively And during the hearing, the diagnostic data from a clinical interview by allowing the state to be accurately diagnosed can be used to make an objective assessment data. The results of the diagnosis can be used as objective evaluation data in interviews with patients with psychiatric symptoms in hospitals and various institutions, which can help to accurately diagnose the mental state and can be used in the overall medical industry.

Claims (9)

  1. 정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 선택적으로 제공하는 시청각 콘텐츠 구현 장치; An audiovisual content implementation device for selectively providing audiovisual content including a psychotic symptom-inducing factor or psychotic symptoms;
    상기 시청각 콘텐츠를 접한 사용자의 생체신호를 실시간 검출하여 데이터화하고 데이터화된 생체신호 정보를 공유하는 생체신호 검출장치; 및 A biosignal detection device for detecting and realizing a biosignal of a user in contact with the audiovisual content in real time and sharing the dataized biosignal information; And
    상기 검출되는 생체신호의 변화 상태를 실시간 모니터링하고 상기 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함과 아울러 정신 증상에 대한 평가결과를 출력하는 정신증상 분석모듈; A mental symptom analysis module for real-time monitoring of the changed state of the detected biosignal, analyzing and interpreting the pattern of change of the biosignal to determine a mental symptom and a psychological state of the user, and outputting an evaluation result for the mental symptom;
    을 포함하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptoms evaluation system using audiovisual content and bio-signal analysis comprising a.
  2. 제 1 항에 있어서,The method of claim 1,
    상기 시청각 콘텐츠 구현장치는 The audiovisual content implementing device
    영상 표시 스크린이나 영상 표시패널, 또는 가상현실 헤드셋이나 태블릿 이동 통신기기 중 적어도 어느 하나로 구성되는 영상 표시모듈, 및 사운드 스피커나 이어폰 또는 헤드셋으로 구성되는 오디오 모듈을 포함하여 구성되되, It includes a video display screen or a video display panel, or a video display module composed of at least one of a virtual reality headset or a tablet mobile communication device, and an audio module composed of sound speakers, earphones or headset,
    향기 발현 모듈이나 햅틱 모듈이 더 구비되어 후각이나 촉각적인 콘텐츠 또한 단계적으로 제공하며, The fragrance expression module or haptic module is further provided to provide olfactory or tactile content in stages.
    가상현실(virtual reality) 혹은 증강현실(augmented reality), 3D 홀로그램이 선택적으로 활용되는 것을 특징으로 하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychological evaluation system using audiovisual content and biosignal analysis, characterized in that virtual reality or augmented reality, 3D hologram is selectively used.
  3. 제 1 항에 있어서,The method of claim 1,
    상기 생체신호 검출장치는 The biological signal detection device
    상기 시청각 콘텐츠를 접한 사용자의 심박수, 뇌파(EEG), 심전도, 근전도(EMG), 피부 저항도, HRV 중 적어도 하나의 생체신호를 실시간 검출하고 아날로그의 검출신호를 디지털 데이터 신호로 데이터화 하여 데이터화된 생체신호 정보를 상기 정신증상 분석모듈과 공유 정보를 공유함과 아울러, At least one bio-signal of a user's heart rate, EEG, electrocardiogram, electrocardiogram (EMG), skin resistance and HRV in contact with the audio-visual content is detected in real time, and the analogized detection signal is converted into a digital data signal to make the data biometric. In addition to sharing the signal information and sharing information with the mental symptoms analysis module,
    상기 사용자나 환자의 안구추적 정보와 표정변화 분석 정보를 수집하여 상기 정신증상 분석모듈과 공유하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptom evaluation system using the audio-visual content and bio-signal analysis to collect the eye tracking information and facial expression analysis analysis information of the user or patient and share with the mental symptom analysis module.
  4. 제 1 항에 있어서, The method of claim 1,
    상기 생체신호 검출장치는 The biological signal detection device
    상기 시청각 콘텐츠를 접한 상기 사용자의 뇌파(EEG)를 검출하여 뇌파 신호를 측정하는 대뇌 신호 측정부; A cerebral signal measuring unit configured to measure an EEG signal by detecting an electroencephalogram (EEG) of the user in contact with the audiovisual content;
    상기 시청각 콘텐츠를 접한 상기 사용자의 심전도(ECG) 및 HRV(심박변이도)를 검출하여 심전도 및 심박변이 신호를 측정하는 심장 신호 측정부; A cardiac signal measuring unit configured to detect an electrocardiogram (ECG) and HRV (heart rate variability) of the user in contact with the audiovisual content and measure an electrocardiogram and a heart rate variance signal;
    상기 시청각 콘텐츠를 접한 상기 사용자의 근전도(EMG)를 검출하여 근전도 신호를 측정하는 근육 신호 측정부; Muscle signal measuring unit for measuring the EMG signal by detecting the EMG of the user in contact with the audio-visual content;
    상기 시청각 콘텐츠를 접한 상기 사용자의 체온과 피부 저항도를 검출하여 피부 저항 신호를 측정하는 피부 및 체온 신호 측정부;A skin and body temperature signal measuring unit configured to measure a skin resistance signal by detecting a body temperature and skin resistance of the user in contact with the audiovisual content;
    를 포함하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptoms evaluation system using audiovisual content and bio-signal analysis comprising a.
  5. 제 1 항에 있어서,The method of claim 1,
    상기 정신증상 분석모듈The mental symptom analysis module
    정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 단계적이면서도 선택적으로 사용자나 환자에게 제공하도록 시청각 콘텐츠 구현장치를 제어함과 아울러, 동시에 실시간으로 생체신호 검출장치에서 검출되는 생체신호의 변화 상태를 실시간 모니터링하고, 생체신호의 변화 패턴을 분석 및 해석하여 사용자의 정신증상 및 심리상태를 판단함으로써 정신증상에 대한 평가결과를 생성 및 출력하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. In addition to controlling the audio-visual content implementation device to provide the user or patient with gradual and selective audio-visual content including or causing psychotic symptoms, at the same time, the bio-signal detection device detects the change state of the bio-signal detected in real time. Psychotic symptom evaluation system using audio-visual content and bio-signal analysis to generate and output evaluation results on mental symptoms by real-time monitoring and analyzing and interpreting patterns of changes in biological signals to determine mental symptoms and psychological state of users.
  6. 제 5 항에 있어서, The method of claim 5,
    상기 정신증상 분석모듈은 The mental symptoms analysis module
    정신증상 유발 요인이 포함되거나 정신증상과 관련된 시청각 콘텐츠를 단계적이면서도 선택적으로 사용자나 환자에게 제공하도록 시청각 콘텐츠 구현장치를 제어하는 이미지 지원 제공부; An image support providing unit configured to control an audiovisual content implementing apparatus to provide audiovisual contents including psychotic symptoms causing factors or psychotic symptoms related to mental symptoms to a user or a patient in a stepwise manner;
    상기 생체신호 검출장치에서 검출되는 생체신호의 변화 상태를 실시간 모니터링하고, 데이터화된 생체신호 정보를 미리 설정된 생체신호 분석 기준 데이터와 비교 분석함으로써 생체신호의 변화 패턴을 분석 및 해석하여 상기 사용자나 환자의 정신증상 및 심리상태를 판단하는 생체신호 패턴 분석부; Real-time monitoring of the change state of the bio-signals detected by the bio-signal detecting apparatus, and comparing and analyzing the data-signed bio-signal information with a predetermined bio-signal analysis reference data to analyze and interpret the change pattern of the bio-signals to A biosignal pattern analyzer for determining mental symptoms and mental states;
    상기 생체신호 검출장치에서 검출되는 데이터화된 생체신호 정보 수치화하거나 그래프 등으로 표시하는 생체신호 표시부; A biosignal display unit which digitizes or displays graphs of the data-formed biosignal information detected by the biosignal detection apparatus;
    를 포함하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptoms evaluation system using audiovisual content and bio-signal analysis comprising a.
  7. 제 6 항에 있어서,The method of claim 6,
    상기 생체신호 패턴 분석부는 The biosignal pattern analysis unit
    상기 생체신호 검출장치에서 검출되는 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 형태적, 순위적으로 각각 분류하는 패턴 분류 제어부; 및 A pattern classification controller which classifies the audiovisual contents provided in accordance with the state of change of the biosignals detected by the biosignal detection apparatus in terms of form and rank; And
    상기 형태적, 순위적으로 각각 분류된 시청각 콘텐츠들을 형태적, 순위적으로 각각 해석하여 형태적, 순위적으로 각각 해석된 결과를 토대로 사용자나 환자의 정신증상 및 심리상태를 판단하는 패턴 해석 제어부; A pattern analysis control unit which analyzes the audiovisual contents classified according to the morphological and ranking forms in the form and the ranking, respectively, and determines the mental symptoms and the psychological state of the user or the patient based on the morphological and ranking analysis results;
    를 포함하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptoms evaluation system using audiovisual content and bio-signal analysis comprising a.
  8. 제 5 항에 있어서,The method of claim 5,
    상기 정신증상 분석모듈은 The mental symptoms analysis module
    정신증상 유발 요인의 종류 및 수위에 따라 설정 및 분류된 상기 시청각 콘텐츠를 단계적이면서도 선택적으로 제공받는 사용자의 감정 변화에 따라 생체 신호가 변화되는 패턴을 검출하고, Detecting a pattern in which a biosignal is changed according to a user's emotional change in which the audio-visual content set and classified according to the type and level of a psychotic symptom-causing factor is provided stepwise and selectively,
    상기 검출되는 생체신호의 변화 상태에 따라 제공되었던 시청각 콘텐츠들을 그룹화하여 동일 그룹 내에 공통 내용을 분석함으로써 정신증상에 관련한 사고를 추론하고 추론된 사고에 해당되는 정신 증상을 판단하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템.Audio-visual content and bio-signal analysis for inferring thoughts related to mental symptoms and determining mental symptoms corresponding to inferred accidents by grouping the audio-visual contents provided according to the detected state of the bio-signals and analyzing common contents in the same group. Symptom evaluation system using
  9. 제 1 항에 있어서, The method of claim 1,
    상기 생체신호 검출장치는 The biological signal detection device
    상기 시청각 콘텐츠를 접한 상기 사용자의 뇌파(EEG)를 검출하여 뇌파 신호를 측정하는 대뇌 신호 측정부; A cerebral signal measuring unit configured to measure an EEG signal by detecting an electroencephalogram (EEG) of the user in contact with the audiovisual content;
    상기 시청각 콘텐츠를 접한 상기 사용자의 심전도(ECG) 및 HRV(심박변이도)를 검출하여 심전도 및 심박변이 신호를 측정하는 심장 신호 측정부; A cardiac signal measuring unit configured to detect an electrocardiogram (ECG) and HRV (heart rate variability) of the user in contact with the audiovisual content and measure an electrocardiogram and a heart rate variance signal;
    상기 시청각 콘텐츠를 접한 상기 사용자의 근전도(EMG)를 검출하여 근전도 신호를 측정하는 근육 신호 측정부; Muscle signal measuring unit for measuring the EMG signal by detecting the EMG of the user in contact with the audio-visual content;
    상기 시청각 콘텐츠를 접한 상기 사용자의 체온과 피부 저항도를 검출하여 피부 저항 신호를 측정하는 피부 및 체온 신호 측정부;A skin and body temperature signal measuring unit configured to measure a skin resistance signal by detecting a body temperature and skin resistance of the user in contact with the audiovisual content;
    상기 시청각 콘텐츠를 접한 상기 사용자의 동공 크기, 안구 움직임 및 안면 근육의 변화를 검출하여 안구 추적 정보 및 표정 변화를 측정하는 안구 및 안면 신호 측정부;An eye and face signal measuring unit configured to measure eye tracking information and facial expression changes by detecting changes in pupil size, eye movement, and facial muscles of the user in contact with the audiovisual content;
    를 포함하는 시청각 콘텐츠와 생체신호 분석을 활용한 정신증상 평가 시스템. Psychotic symptoms evaluation system using audiovisual content and bio-signal analysis comprising a.
PCT/KR2017/005000 2016-05-18 2017-05-15 Psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis WO2017200244A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160060993A KR101854812B1 (en) 2016-05-18 2016-05-18 Psychiatric symptoms rating scale system using multiple contents and bio-signal analysis
KR10-2016-0060993 2016-05-18

Publications (1)

Publication Number Publication Date
WO2017200244A1 true WO2017200244A1 (en) 2017-11-23

Family

ID=60325269

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/005000 WO2017200244A1 (en) 2016-05-18 2017-05-15 Psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis

Country Status (2)

Country Link
KR (1) KR101854812B1 (en)
WO (1) WO2017200244A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102035173B1 (en) 2017-12-13 2019-10-22 이모션코리아 주식회사 Management system of image for healing stress and management method using the same
KR20200103397A (en) * 2019-02-25 2020-09-02 주식회사 룩시드랩스 A System and Method For Taking Care Of Personal Health and Mental Using Virtual Reality Device Mounting Biosignal Sensors
KR102277894B1 (en) * 2020-07-31 2021-07-16 임시원 Psychology consultation method capable of tracking psychological changes by providing personalized image
KR102454752B1 (en) * 2020-10-22 2022-10-17 (주)나연테크 Sound classification system reflecting changes in brain waves according to sleep-induction sound classification, and sound classification method, and program stored in medium for executing sound classification method
KR20230090095A (en) * 2021-12-14 2023-06-21 한국전자기술연구원 Mental and physical stability system using vehicle and its service method
KR20230112197A (en) * 2022-01-19 2023-07-27 이화여자대학교 산학협력단 Method and apparatus for controlling anxiety using virtual reality

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040000932A (en) * 2002-06-26 2004-01-07 삼성전자주식회사 Apparatus and method for inducing emotion
JP2005348872A (en) * 2004-06-09 2005-12-22 Nippon Hoso Kyokai <Nhk> Feeling estimation device and feeling estimation program
KR20060048367A (en) * 2004-06-22 2006-05-18 소니 가부시끼 가이샤 Bio-information processing apparatus and video/sound reproduction apparatus
JP2009183346A (en) * 2008-02-04 2009-08-20 Technos Japan:Kk Mental condition varying device
KR20130094555A (en) * 2012-02-16 2013-08-26 충남대학교산학협력단 Emotion induction system regularited emotion intensity level and inducing emotion method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040000932A (en) * 2002-06-26 2004-01-07 삼성전자주식회사 Apparatus and method for inducing emotion
JP2005348872A (en) * 2004-06-09 2005-12-22 Nippon Hoso Kyokai <Nhk> Feeling estimation device and feeling estimation program
KR20060048367A (en) * 2004-06-22 2006-05-18 소니 가부시끼 가이샤 Bio-information processing apparatus and video/sound reproduction apparatus
JP2009183346A (en) * 2008-02-04 2009-08-20 Technos Japan:Kk Mental condition varying device
KR20130094555A (en) * 2012-02-16 2013-08-26 충남대학교산학협력단 Emotion induction system regularited emotion intensity level and inducing emotion method thereof

Also Published As

Publication number Publication date
KR20170130207A (en) 2017-11-28
KR101854812B1 (en) 2018-05-04

Similar Documents

Publication Publication Date Title
WO2017200244A1 (en) Psychiatric symptom evaluation system utilizing audio-visual content and bio-signal analysis
Dadebayev et al. EEG-based emotion recognition: Review of commercial EEG devices and machine learning techniques
Khezri et al. Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals
Gill-Thwaites The Sensory Modality Assessment Rehabilitation Technique-a tool for assessment and treatment of patients with severe brain injury in a vegetative state
Sharma et al. Objective measures, sensors and computational techniques for stress recognition and classification: A survey
WO2017200243A1 (en) System for ameliorating mental illness utilizing virtual reality supported content and result of bio-signal analysis
Marchetti et al. Covert visuospatial attention orienting in a brain-computer interface for amyotrophic lateral sclerosis patients
McFarland et al. BCI in practice
Barnea et al. Effect of neurofeedback on hemispheric word recognition
Sarà et al. Complexity loss in physiological time series of patients in a vegetative state
Khedher et al. Predicting learners’ performance using EEG and eye tracking features
Rahman et al. Enhancing biofeedback-driven self-guided virtual reality exposure therapy through arousal detection from multimodal data using machine learning
Cavallo et al. Mood classification through physiological parameters
Rajwal et al. Convolutional neural network-based EEG signal analysis: A systematic review
WO2023012818A1 (en) A non-invasive multimodal screening and assessment system for human health monitoring and a method thereof
Alqahtani et al. ECG-based affective computing for difficulty level prediction in intelligent tutoring systems
Othmani et al. EEG-based neural networks approaches for fatigue and drowsiness detection: A survey
Altıntop et al. A novel approach for detection of consciousness level in comatose patients from EEG signals with 1-D convolutional neural network
Samal et al. Role of machine learning and deep learning techniques in EEG-based BCI emotion recognition system: a review
Pan et al. Brain–computer interfaces for awareness detection, auxiliary diagnosis, prognosis, and rehabilitation in patients with disorders of consciousness
Hernández et al. The contribution of event-related potentials to the understanding of sign language processing and production in the brain: Experimental evidence and future directions
Hollenstein et al. The ZuCo benchmark on cross-subject reading task classification with EEG and eye-tracking data
Kanagasabai et al. Brain-computer interface learning system for Quadriplegics
WO2023140467A1 (en) Method and device for controlling anxiety level using virtual reality
WO2021040206A1 (en) Customized-type sleep management method and system

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17799602

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17799602

Country of ref document: EP

Kind code of ref document: A1