WO2017193589A1 - 一种基于虚拟现实交互技术与脑功能实时监测技术的设备 - Google Patents

一种基于虚拟现实交互技术与脑功能实时监测技术的设备 Download PDF

Info

Publication number
WO2017193589A1
WO2017193589A1 PCT/CN2016/111388 CN2016111388W WO2017193589A1 WO 2017193589 A1 WO2017193589 A1 WO 2017193589A1 CN 2016111388 W CN2016111388 W CN 2016111388W WO 2017193589 A1 WO2017193589 A1 WO 2017193589A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
virtual reality
module
user
interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/111388
Other languages
English (en)
French (fr)
Inventor
徐向民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to US15/735,067 priority Critical patent/US20180177426A1/en
Publication of WO2017193589A1 publication Critical patent/WO2017193589A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/377—Electroencephalography [EEG] using evoked responses
    • A61B5/378—Visual stimuli
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/026—Measuring blood flow
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb
    • A61B5/1126—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb using a particular sensing technique
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/163—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state by tracking eye movement, gaze, or pupil change
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316—Modalities, i.e. specific diagnostic methods
    • A61B5/369—Electroencephalography [EEG]
    • A61B5/372—Analysis of electroencephalograms
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4884—Other medical applications inducing physiological or psychological stress, e.g. applications for stress testing
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7225—Details of analogue processing, e.g. isolation amplifier, gain or sensitivity adjustment, filtering, baseline or drift compensation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7275—Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00—Medical imaging apparatus involving image processing or analysis
    • A61B2576/02—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part
    • A61B2576/026—Medical imaging apparatus involving image processing or analysis specially adapted for a particular organ or body part for the brain
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A61B5/0245—Measuring pulse rate or heart rate by using sensing means generating electric signals, i.e. ECG signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7246—Details of waveform analysis using correlation, e.g. template matching or determination of similarity
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/742—Details of notification to user or communication with user or patient; User input means using visual displays
    • A61B5/7445—Display arrangements, e.g. multiple display units

Definitions

  • the invention relates to the field of medical field and intelligent device, and particularly relates to a device based on virtual reality interaction technology and brain function real-time monitoring technology.
  • Virtual reality interaction technology has developed rapidly in recent years. It gives users an immersive experience, and in addition to visual perception, it also has auditory perception, tactile perception, motion perception, and even taste, smell, and perception. The ideal virtual reality should have the perceptual function that everyone has. Virtual reality technology is not only used for entertainment, but also has high value in medical care. Many teams have used virtual reality technology to make medical attempts.
  • the virtual reality interaction technology provides a new means and method for human brain science research.
  • the present invention applies virtual reality interaction technology to brain function monitoring and research, and the user can use the invention to monitor the mental health state of the individual, and In the course of diagnosis and treatment of mental illness, the present invention can provide more objective data and auxiliary information, and in the brain science research, the present invention also provides new research means.
  • the object of the invention is to provide a device based on virtual reality interaction technology and brain function real-time monitoring technology, which provides a user with specific virtual reality content to induce mood fluctuations through virtual reality interaction technology, and collects interactive behavior data and brain wave brain blood.
  • the physiological data such as flow are analyzed and analyzed by data processing, and the feedback effect of the user is obtained.
  • the device can provide users with brain function related data and brain function health assessment results, which is convenient for long-term recording and observation, and realizes brain function monitoring.
  • a device based on virtual reality interaction technology and brain function real-time monitoring technology comprising a virtual reality interaction module, a human body data acquisition module, a data synchronization module, and a data processing analysis control module;
  • the virtual reality interaction module provides the virtual reality content to induce the user's emotional change, collects the interaction behavior data of the user, and sends the collected data to the data synchronization module;
  • the human body data acquisition module collects real-time physiological physical sign data of the user, and sends the collected data to the data synchronization module;
  • the data synchronization module synchronously processes the user's real-time interactive behavior data and physiological physical condition data, and sends the synchronized data to the data processing analysis control module;
  • the data processing analysis control module processes the original physiological sign data, compares the physiological sign data, the interactive behavior data with the normal data, and obtains the response state of the user brain to the current virtual reality content according to the similarity degree of the comparative analysis. And controlling the virtual reality interaction module to present new virtual reality content, inducing the user's emotional changes to enter the next round of detection, and then looping until all the virtual reality content provided is tested;
  • the normal data refers to the normal population Physiological sign data and interactive behavior data when subjected to the same virtual reality content.
  • the interaction behavior data includes an eye movement, a head motion, a voice or a hand motion.
  • physiological sign data collected by the human body data acquisition module includes brain wave, cerebral blood flow, pulse, electrocardiogram or electrophysiological physical sign data.
  • the processing of the original physiological sign data by the data processing analysis control module includes sampling, quantization, encoding, filtering, or formatting.
  • the virtual reality interaction module can provide an immersive experience for the user, and has the functions of displaying, including but not limited to, virtual reality content display and interactive behavior monitoring.
  • the module can provide users with specific virtual reality interactions and induce users to generate specific mood swings.
  • the user's interaction behavior data will be collected, including but not limited to eye movements, head movements, voice, and hand movements.
  • the human body data acquisition module collects physiological physical data of the user when interacting with the virtual reality interaction module in real time, including but not limited to brain wave, cerebral blood flow, pulse, electrocardiogram, myoelectric and other physiological signs data.
  • the data synchronization module provides data synchronization services for the physiological sign data collected in real time and the interactive behavior data collected in real time, and the data is handed over to the data processing analysis control module.
  • the data processing analysis control module has control functions including, but not limited to, data processing functions, data analysis functions, and virtual reality interaction modules.
  • the module performs data processing on the received physiologically-physical data and interactive behavior data, wherein the processing content includes but is not limited to sampling, quantization, encoding, filtering, and unified format.
  • the module compares the collected physiological sign data with the expected normal data (physiological sign data of the normal population when receiving the same virtual reality content), and simultaneously analyzes the interactive behavior data, and the two analyze the user's brain together. Functional status.
  • the module controls the virtual reality interactive content according to the physiological state data of the user and the interaction data.
  • the device based on the virtual reality interaction technology and the brain function real-time monitoring technology can communicate with the local server or the remote server to realize functions such as data storage, data analysis, result display, remote control, etc., and the doctor can provide medical services to the user remotely.
  • the present invention includes at least the following advantages:
  • the invention provides a convenient brain function monitoring device, which is suitable for home and hospital, and provides an immersive experience for the user by means of virtual reality interaction technology, so that the user accepts the artificial mental influence and generates specific emotions, and these controllable influences With predictable mood swings, a new approach to brain function monitoring is provided.
  • the device is simple to use, and the ordinary user can use the device to perform self-brain health monitoring on the device, which is beneficial for people to deeply understand the individual's health condition, and in the medical diagnosis and treatment, the device contributes to the diagnosis and rehabilitation of mental and psychological problems. It can improve the accuracy of diagnosis, save medical resources, improve the level of diagnosis and treatment, help to form standards and guidelines for diagnosis and treatment, and make the diagnosis and treatment of mental illness more standard and more standardized.
  • the device provides a new research method, which is helpful to find relevant markers and related mechanisms, thereby improving the health improvement of the observed.
  • FIG. 1 is an apparatus for real-time monitoring technology based on virtual reality interaction technology and brain function in an embodiment.
  • the device based on the virtual reality interaction technology and the brain function real-time monitoring technology mainly includes four modules: a virtual reality interaction module, a human body data acquisition module, a data synchronization module, and a data processing analysis control module.
  • the virtual reality interaction module has at least a virtual reality content display function and an interactive behavior monitoring function, and the user needs to wear the device while ensuring safety. After the wearing is completed, the virtual reality interaction module can provide a specific under the control of the user or the doctor.
  • the virtual reality content induces the user to generate specific mood fluctuations through the immersive virtual reality interactive content, wherein the controller of the device can be a remotely controlled doctor because the device supports connecting to the remote server.
  • the virtual reality interaction module monitors all interaction behaviors of the user and collects interaction behavior data, including but not limited to eye movements, head movements, voices, and hand movements. .
  • the physiological sign data collection module also collects the physiological physiological data of the user in real time, including but not limited to brain waves, cerebral blood flow, pulse, electrocardiogram, and myoelectricity. Used to analyze the user's mood swings.
  • the data synchronization module simultaneously accepts the collected physiological sign data and interactive behavior data, and synchronizes the two for subsequent processing analysis.
  • the synchronized physiological sign data and the interactive behavior data are passed to the data processing analysis control module.
  • the data processing analysis control module has control functions including, but not limited to, data processing functions, data analysis functions, and virtual reality interaction modules.
  • the module performs data processing on physiological sign data and interactive behavior data, wherein the processing content includes but is not limited to sampling, quantization, encoding, filtering, and format unification.
  • the module compares the collected physiological sign data with the expected normal data (physiological sign data of the normal population when receiving the same virtual reality content), analyzes the data difference, and simultaneously analyzes the interaction behavior data. Combine the two to analyze the user's brain function status.
  • the interoperability of the device is also reflected in the analysis of the physiological physical data and the interaction behavior data of the user, which may affect the interactive content of the virtual reality.
  • the module may be based on the physiological physical data of the user and The analysis result of the interaction data controls the virtual reality interaction content.
  • the device can be connected to the server (the server can be a local server or a remote server), data and analysis results can be stored in the server, and the server can also control the operation of the device.
  • This device has the ability to connect to a remote server, which also makes telemedicine possible. Doctors can remotely observe the user's status and provide medical services to the user.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Psychiatry (AREA)
  • Physiology (AREA)
  • Psychology (AREA)
  • Cardiology (AREA)
  • Hospice & Palliative Care (AREA)
  • Social Psychology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Developmental Disabilities (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Educational Technology (AREA)
  • Signal Processing (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pulmonology (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Hematology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Power Engineering (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

一种基于虚拟现实交互技术与脑功能实时监测技术的设备，它涉及医疗领域、智能设备领域，它包含虚拟现实交互模块、人体数据采集模块、数据同步模块、数据处理分析控制模块。虚拟现实交互模块负责提供特定的虚拟现实内容诱发使用者的特定情绪并采集使用者与虚拟现实模块的交互行为数据，人体数据采集模块负责采集使用者的生理体征数据，数据同步模块对实时采集的生理体征数据和交互行为数据进行同步处理，数据处理分析控制模块负责对原始的生理体征数据进行分析处理，结合大数据技术最终得到使用者的脑功能健康状态。本方案操作方便、灵活，便于科研也可用于使用者自评，有利于节约医疗资源，提高诊疗水平。

Description

一种基于虚拟现实交互技术与脑功能实时监测技术的设备
技术领域
本发明涉及医疗领域、智能设备领域，具体涉及一种基于虚拟现实交互技术与脑功能实时监测技术的设备。
背景技术
虚拟现实交互技术在近年来得到快速发展，它给使用者沉浸式的体验，并且具有除视觉感知之外，还具备听觉感知、触觉感知、运动感知，甚至还包括味觉、嗅觉、感知等。理想的虚拟现实应该具有一切人所具有的感知功能。虚拟现实技术不仅仅用在娱乐方面，在医疗方面也具有较高的价值，已有多个团队利用虚拟现实技术在医疗方面做了尝试。
人类对脑科学的研究一直没有停止过，但由于人脑的复杂使得研究有一定的困难。而且随着社会的快速发展，人们承受的压力也越来越大，各种精神心理问题困扰着越来越多的人，但人们缺少手段去认识到自身更为内在的健康状态，其中就包括脑功能的健康状态，等到发现时病状已经较为严重了。
虚拟现实交互技术为人类脑科学研究提供了新的手段和方法，本发明将虚拟现实交互技术应用到脑功能监测与研究方面，使用者能够使用本发明对个人的脑功能健康状态进行监测，并且在精神疾病的诊疗过程中，本发明能够提供更为客观的数据和辅助信息，而在脑科学研究发面，本发明也提供了新的研究手段。
发明内容
发明的目的是提供一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其通过虚拟现实交互技术给使用者提供特定的虚拟现实内容诱发情绪波动，采集其交互行为数据和脑电波脑血流等生理体征数据并进行数据处理分析，分析得到使用者的反馈效果。该设备可以给使用者提供脑功能相关的数据和脑功能的健康状况评估结果，便于长期记录与观察，实现脑功能的监测。
本发明所采用的技术方案如下。
一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其包括虚拟现实交互模块、人体数据采集模块、数据同步模块、数据处理分析控制模块；
虚拟现实交互模块，提供虚拟现实内容诱发使用者的情绪变化，同时采集使用者的交互行为数据并将采集到的数据发送到数据同步模块；
人体数据采集模块，采集使用者实时的生理体征数据，并将采集到的数据发送到数据同步模块；
数据同步模块，对使用者实时的交互行为数据和生理体征数据进行同步处理，并将同步后的数据发送到数据处理分析控制模块；
数据处理分析控制模块，对原始的生理体征数据进行处理，并将生理体征数据、交互行为数据与正常的数据进行对比分析，根据对比分析的相似程度得到使用者大脑对当前虚拟现实内容的反应状态，并控制虚拟现实交互模块呈现新的虚拟现实内容，诱发使用者的情绪变化进入下一轮检测，依此循环直到所提供的所有虚拟现实内容测试完毕；所述正常的数据是指正常人群在接受相同虚拟现实内容影响时的生理体征数据和交互行为数据。
进一步地，所述交互行为数据包括眼部动作、头部动作、语音或手部动作。
进一步地，人体数据采集模块采集的生理体征数据包括脑电波、脑血流、脉搏、心电或肌电生理体征数据。
进一步地，数据处理分析控制模块对原始的生理体征数据的处理包括抽样、量化、编码、滤波或格式统一。
其中虚拟现实交互模块能为使用者提供沉浸式体验，它具有包括但不限于虚拟现实内容显示功能，交互行为监测功能。该模块能为使用者提供特定虚拟现实交互内容并诱发使用者产生特定的情绪波动。在交互过程中，使用者的交互行为数据将会被采集，其中包括但不仅限于眼部动作、头部动作、语音、手部动作。
人体数据采集模块实时采集使用者在与虚拟现实交互模块交互时的生理体征数据，包括但不限于脑电波、脑血流、脉搏、心电、肌电等生理体征数据。
数据同步模块为所实时采集的生理体征数据和实时采集的交互行为数据提供数据同步服务，将数据交由数据处理分析控制模块。
数据处理分析控制模块具有包括但不限于数据处理功能，数据分析功能，虚拟现实交互模块控制功能。该模块对接受到的经过同步处理后的生理体征数据和交互行为数据进行数据处理，其中处理内容包括但不限于抽样、量化、编码、滤波、格式统一。该模块对将采集到的生理体征数据与预期的正常数据（正常人群在接受相同虚拟现实内容影响时的生理体征数据）作对比分析，并且同时分析交互行为数据，两者结合分析使用者的脑功能状态。在使用者使用该设备时，该模块会根据使用者的生理体征数据变化状态以及交互数据控制虚拟现实交互内容。
基于虚拟现实交互技术与脑功能实时监测技术的设备可与本地服务器或远程服务器进行通信，实现数据存储、数据分析、结果展示，远程控制等功能，医生可以远程为使用者提供医疗服务。
与现有技术相比，本发明至少包括以下有益之处：
本发明提供一种方便使用的脑功能监测设备，适用于家庭与医院，借助虚拟现实交互技术给予使用者沉浸式体验，使使用者接受人为的精神影响并产生特定的情绪，这些可控的影响与可预期的情绪波动，提供了对脑功能监测的新方法。本设备使用简单，普通使用者可以使用该设备对自身做脑功能的健康监测，有利于人们深入了解个人的健康状况，而在医疗诊疗方面，该设备有助于精神心理问题的诊断及康复，可以提高诊断的准确性，同时节约医疗资源，提高诊疗水平，有助于形成诊疗标准与指南，让精神疾病的诊疗更加标准，更加规范。而在脑科学研究反面，该设备提供了新的研究方法，有利于找到相关标志物及相关机制，进而提高被观察者健康改善的效果。
附图说明
图1为实施例中一种基于虚拟现实交互技术与脑功能实时监测技术的设备。
具体实施方式
以下结合附图对本发明的具体实施作进一步说明。
如图1，基于虚拟现实交互技术与脑功能实时监测技术的设备，主要包括4个模块:虚拟现实交互模块、人体数据采集模块、数据同步模块以及数据处理分析控制模块。
虚拟现实交互模块至少具备虚拟现实内容显示功能以及交互行为监测功能，使用者需在保证安全的情况下佩戴本设备，佩戴完成后，虚拟现实交互模块即可在使用者或者医生的控制下提供特定的虚拟现实内容，通过沉浸式虚拟现实交互内容诱发使用者产生特定的情绪波动，其中由于本设备支持连接远程服务器，因此本设备的控制者可以是远程控制的医生。使用者在整个交互过程中，虚拟现实交互模块会对使用者所有的交互行为进行监测，并采集交互行为数据，其中交互行为数据包括但不限于眼部动作、头部动作、语音、手部动作。
在使用者与虚拟现实交互内容进行交互的过程中，生理体征数据采集模块也在实时采集使用者的生理体征数据，其中包括但不仅限于脑电波、脑血流、脉搏、心电、肌电，以用来分析使用者的情绪波动情况。
由于生理体征数据与交互行为数据都是实时采集的，并且交互行为与生理体征数据的变化有着一定的联系，因此两种数据的同步处理也是该设备的关键环节。数据同步模块同时接受所采集的生理体征数据和交互行为数据，并对两者做同步处理便于随后的处理分析。
同步后的生理体征数据与交互行为数据交由数据处理分析控制模块。数据处理分析控制模块具有包括但不限于数据处理功能，数据分析功能，虚拟现实交互模块控制功能。该模块对生理体征数据和交互行为数据进行数据处理，其中处理内容包括但不限于抽样、量化、编码、滤波、格式统一。数据处理之后，该模块将采集到的生理体征数据与预期的正常数据（正常人群在接受相同虚拟现实内容影响时的生理体征数据）作对比，分析数据的差异性，并且同时分析交互行为数据，结合两者分析使用者的脑功能状态。本设备的可交互性还体现在使用者的生理体征数据与交互行为数据的分析结果会对虚拟现实交互内容产生影响，在使用者使用本设备时，该模块会根据使用者的生理体征数据及交互数据的分析结果控制虚拟现实交互内容。
本设备可与服务器连接（服务器可以是本地服务器也可以是远程服务器），数据与分析结果都可以储存在服务器中，服务器也可控制本设备的运行。本设备具备连接远程服务器的能力，这也让远程医疗成为可能，医生可以远程观察使用者的状态，为使用者提供医疗服务。

Claims (4)

  1. 一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其特征在于：包括虚拟现实交互模块、人体数据采集模块、数据同步模块、数据处理分析控制模块；
    虚拟现实交互模块，提供虚拟现实内容诱发使用者的情绪变化，同时采集使用者的交互行为数据并将采集到的数据发送到数据同步模块；
    人体数据采集模块，采集使用者实时的生理体征数据，并将采集到的数据发送到数据同步模块；
    数据同步模块，对使用者实时的交互行为数据和生理体征数据进行同步处理，并将同步后的数据发送到数据处理分析控制模块；
    数据处理分析控制模块，对原始的生理体征数据进行处理，并将生理体征数据、交互行为数据与正常的数据进行对比分析，根据对比分析的相似程度得到使用者大脑对当前虚拟现实内容的反应状态，并控制虚拟现实交互模块呈现新的虚拟现实内容，诱发使用者的情绪变化进入下一轮检测，依此循环直到所提供的所有虚拟现实内容测试完毕；所述正常的数据是指正常人群在接受相同虚拟现实内容影响时的生理体征数据和交互行为数据。
  2. 根据权利要求1所述的一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其特征在于所述交互行为数据包括眼部动作、头部动作、语音或手部动作。
  3. 根据权利要求1所述的一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其特征在于人体数据采集模块采集的生理体征数据包括脑电波、脑血流、脉搏、心电或肌电生理体征数据。
  4. 根据权利要求1所述的一种基于虚拟现实交互技术与脑功能实时监测技术的设备，其特征在于数据处理分析控制模块对原始的生理体征数据的处理包括抽样、量化、编码、滤波或格式统一。
PCT/CN2016/111388 2016-05-10 2016-12-21 一种基于虚拟现实交互技术与脑功能实时监测技术的设备 Ceased WO2017193589A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/735,067 US20180177426A1 (en) 2016-05-10 2016-12-21 Device Based on Virtual Reality Interactive Technology and Real-time Monitoring Technology of Brain Function

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610304124.8 2016-05-10
CN201610304124.8A CN105852831A (zh) 2016-05-10 2016-05-10 一种基于虚拟现实交互技术与脑功能实时监测技术的设备

Publications (1)

Publication Number Publication Date
WO2017193589A1 true WO2017193589A1 (zh) 2017-11-16

Family

ID=56630627

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/111388 Ceased WO2017193589A1 (zh) 2016-05-10 2016-12-21 一种基于虚拟现实交互技术与脑功能实时监测技术的设备

Country Status (3)

Country Link
US (1) US20180177426A1 (zh)
CN (1) CN105852831A (zh)
WO (1) WO2017193589A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114640699A (zh) * 2022-02-17 2022-06-17 华南理工大学 基于vr角色扮演游戏交互的情绪诱发监测系统

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105852831A (zh) * 2016-05-10 2016-08-17 华南理工大学 一种基于虚拟现实交互技术与脑功能实时监测技术的设备
TWI589274B (zh) * 2016-07-05 2017-07-01 da-quan Ye 心理臨床應用的虛擬實境系統
CN106355010A (zh) * 2016-08-30 2017-01-25 深圳市臻络科技有限公司 一种自助认知评估的装置和方法
CN107123019A (zh) * 2017-03-28 2017-09-01 华南理工大学 一种基于生理数据与情绪识别的vr购物推荐系统及方法
CN107248356A (zh) * 2017-07-11 2017-10-13 李家美 失语者智能语音系统（无听力障碍）
CN108281190A (zh) * 2018-02-07 2018-07-13 苏州中科先进技术研究院有限公司 一种用于康复辅助的系统、及其康复辅助方法和装置
CN108478224A (zh) * 2018-03-16 2018-09-04 西安电子科技大学 基于虚拟现实与脑电的紧张情绪检测系统及检测方法
CN109116744A (zh) * 2018-08-03 2019-01-01 徐州迈步网络科技有限公司 一种智能家居系统
CN109215804B (zh) * 2018-10-09 2023-10-31 华南理工大学 基于虚拟现实技术与生理参数检测的精神类疾病辅助诊断系统
CN109621151A (zh) * 2018-12-12 2019-04-16 上海玺翎智能科技有限公司 一种虚拟现实vr+听觉统合治疗儿童自闭症及评估方法
CN110008874B (zh) * 2019-03-25 2021-05-18 联想(北京)有限公司 数据处理方法及其装置、计算机系统及可读介质
CN110192861A (zh) * 2019-06-14 2019-09-03 广州医科大学附属肿瘤医院 一种智能辅助脑功能实时检测系统
US11562661B2 (en) 2021-01-14 2023-01-24 Sheila Hall Absolute teaching device
CN114399290A (zh) * 2022-01-19 2022-04-26 贵州东彩供应链科技有限公司 一种基于物联网平台实现动物体征数据分析与监管系统
CN118266928B (zh) * 2024-05-31 2024-08-27 杭州虚之实科技有限公司 一种用于虚拟现实的眼动数据采集与分析一体化系统
CN119889635B (zh) * 2025-03-26 2025-06-13 华中科技大学同济医学院附属同济医院 一种基于vr技术的模拟诊断系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184661A (zh) * 2011-03-17 2011-09-14 南京大学 儿童孤独症语言训练系统及基于物联网的集中训练中心
CN203480511U (zh) * 2013-08-07 2014-03-12 青岛赛博凯尔信息技术有限公司 社交恐惧症虚拟现实治疗系统
CN104392110A (zh) * 2014-11-04 2015-03-04 宝鸡数字人信息科技有限公司 人体生理数据可视化监测、分析和评估方法和系统
CN105279387A (zh) * 2015-11-17 2016-01-27 东南大学 一种面向孤独症谱系障碍儿童的执行功能评测与训练系统
CN105852831A (zh) * 2016-05-10 2016-08-17 华南理工大学 一种基于虚拟现实交互技术与脑功能实时监测技术的设备

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020068825A (ko) * 2001-02-23 2002-08-28 학교법인 한양학원 가상 현실과 바이오 피드백을 이용한 집중력 향상 시스템및 방법
KR100429706B1 (ko) * 2001-02-23 2004-05-03 학교법인 한양학원 웹 기반의 집중력 향상 서비스 방법 및 시스템
EP2062206A4 (en) * 2006-09-07 2011-09-21 Procter & Gamble METHOD FOR MEASURING EMOTIVE REACTIONS AND SELECTION PREFERENCES
US20090298025A1 (en) * 2007-05-09 2009-12-03 Oregon Health & Science University Object recognition testing tools and techniques for measuring cognitive ability and cognitive impairment
US8392250B2 (en) * 2010-08-09 2013-03-05 The Nielsen Company (Us), Llc Neuro-response evaluated stimulus in virtual reality environments
TWI482108B (zh) * 2011-12-29 2015-04-21 Univ Nat Taiwan To bring virtual social networks into real-life social systems and methods

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102184661A (zh) * 2011-03-17 2011-09-14 南京大学 儿童孤独症语言训练系统及基于物联网的集中训练中心
CN203480511U (zh) * 2013-08-07 2014-03-12 青岛赛博凯尔信息技术有限公司 社交恐惧症虚拟现实治疗系统
CN104392110A (zh) * 2014-11-04 2015-03-04 宝鸡数字人信息科技有限公司 人体生理数据可视化监测、分析和评估方法和系统
CN105279387A (zh) * 2015-11-17 2016-01-27 东南大学 一种面向孤独症谱系障碍儿童的执行功能评测与训练系统
CN105852831A (zh) * 2016-05-10 2016-08-17 华南理工大学 一种基于虚拟现实交互技术与脑功能实时监测技术的设备

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114640699A (zh) * 2022-02-17 2022-06-17 华南理工大学 基于vr角色扮演游戏交互的情绪诱发监测系统

Also Published As

Publication number Publication date
CN105852831A (zh) 2016-08-17
US20180177426A1 (en) 2018-06-28

Similar Documents

Publication Publication Date Title
WO2017193589A1 (zh) 一种基于虚拟现实交互技术与脑功能实时监测技术的设备
Abibullaev et al. Deep learning in EEG-based BCIs: A comprehensive review of transformer models, advantages, challenges, and applications
CN114847950A (zh) 基于虚拟现实的注意力评估与训练系统、方法及存储介质
Bekele et al. Design of a virtual reality system for affect analysis in facial expressions (VR-SAAFE); application to schizophrenia
CN105893780A (zh) 基于vr交互与脑电波及脑血流监测的精神心理评估方法
CN106388793A (zh) 基于vr技术与生理体征监测的老年痴呆症辅助治疗系统
CN102184661A (zh) 儿童孤独症语言训练系统及基于物联网的集中训练中心
CN106407733A (zh) 基于虚拟现实场景脑电信号的抑郁症风险筛查系统和方法
CN105975780A (zh) 一种基于虚拟现实交互技术的机器问诊系统
CN105700689A (zh) 基于镜像虚拟和Skinner强化学习的个性化MI-EEG训练与采集方法
US20220000426A1 (en) Multi-modal brain-computer interface based system and method
CN110123283A (zh) 一种远程中医切脉系统
Gudiño-Mendoza et al. Detecting the intention to move upper limbs from electroencephalographic brain signals
CN113035000A (zh) 一种面向中枢整合康复治疗技术的虚拟现实训练系统
CN106020472A (zh) 一种基于下肢不同抬起幅度运动想象的脑机接口系统
CN111529888A (zh) Vr心理放松系统
CN120746376A (zh) 一种用于评估实习医护人员输液操作的方法及系统
CN115671706A (zh) 一种用于认知障碍的vr游戏训练系统
Lim et al. Impact of mixed reality-based rehabilitation on muscle activity in lower-limb amputees: An EMG analysis
WO2019179480A1 (zh) 一种基于虚拟现实、可进行远程诊疗精神治疗的监控方法
CN120656752A (zh) 基于人工智能的智慧医疗信息交互系统
Xing et al. The development of EEG-based brain computer interfaces: potential and challenges
CN106406510A (zh) 一种实时监控视频诱导的运动想象bci系统
Simeoni A methodological framework for the real-time adaptation of classifiers for non-invasive brain-computer interfaces towards the control of home automation systems
Chung et al. A Framework for Treatment of Autism Using Affective Computing.

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 15735067

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16901544

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 14.03.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16901544

Country of ref document: EP

Kind code of ref document: A1