WO2024108669A1 - System and method for wakeful state detection - Google Patents

System and method for wakeful state detection Download PDF

Info

Publication number
WO2024108669A1
WO2024108669A1 PCT/CN2022/137869 CN2022137869W WO2024108669A1 WO 2024108669 A1 WO2024108669 A1 WO 2024108669A1 CN 2022137869 W CN2022137869 W CN 2022137869W WO 2024108669 A1 WO2024108669 A1 WO 2024108669A1
Authority
WO
WIPO (PCT)
Prior art keywords
detection
target
signal
information
motion
Prior art date
Application number
PCT/CN2022/137869
Other languages
French (fr)
Chinese (zh)
Inventor
张钰林
王枫
王立平
Original Assignee
深圳先进技术研究院
中国科学院深圳理工大学(筹)
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳先进技术研究院, 中国科学院深圳理工大学(筹) filed Critical 深圳先进技术研究院
Publication of WO2024108669A1 publication Critical patent/WO2024108669A1/en

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

Provided is a system and method for wakeful state detection. The system comprises: a physiological index detection apparatus (10) configured to generate a physiological detection result of a target physiological index; a body posture detection apparatus (20) configured to generate a posture detection result of the body posture; an athletic ability detection apparatus (30) configured to generate an athletic ability detection result of athletic information; a stimulation response detection apparatus (40) configured to generate a stimulation response detection result of the target stimulation signal; an emotional response detection apparatus (50) configured to generate an emotional response detection result of an emotion behavior characterization; a behavior pattern detection apparatus (60) configured to generate a behavior pattern detection result of a behavior pattern; and a wakeful state evaluation apparatus (70) configured to determine and display the wakeful state of the target detection subject on the basis of the physiological detection result, the posture detection result, the athletic ability detection result, the stimulation response detection result, the behavior pattern detection result, and the emotional response detection result.

Description

觉醒状态检测系统及方法Awake state detection system and method
本申请要求在2022年11月25日提交中国专利局、申请号为202211493320.6的中国专利申请的优先权,该申请的全部内容通过引用结合在本申请中。This application claims priority to the Chinese patent application filed with the China Patent Office on November 25, 2022, with application number 202211493320.6, the entire contents of which are incorporated by reference into this application.
技术领域Technical Field
本申请涉及生物医学信号处理技术领域,例如涉及一种觉醒状态检测系统及方法。The present application relates to the technical field of biomedical signal processing, for example, to a wakefulness state detection system and method.
背景技术Background technique
个体维持良好的觉醒状态,并对有害刺激做出恰当的防御行为对于个体生存和物种繁衍都极为重要。然而,在应激、神经精神疾病及极端环境下,例如深海、深空、极地等,个体基本生命活动和大脑觉醒状态极易受到影响,从而影响任务执行,甚至难以应对生存威胁。It is extremely important for individuals to maintain a good state of wakefulness and take appropriate defensive actions against harmful stimuli for both individual survival and species reproduction. However, under stress, neuropsychiatric diseases and extreme environments, such as the deep sea, deep space, and polar regions, individuals' basic life activities and brain wakefulness are easily affected, thus affecting task execution and even making it difficult to cope with threats to survival.
特殊脑状态的调控机制一直是人类尚未完全认识的重要前沿科学问题之一。以全身麻醉所诱发的脑状态为例,其导致的觉醒及意识消失和恢复的神经机制,是神经科学和临床研究中重要内容。The regulatory mechanism of special brain states has always been one of the important frontier scientific issues that humans have not yet fully understood. Taking the brain state induced by general anesthesia as an example, the neural mechanism of awakening, loss of consciousness and recovery caused by it is an important content in neuroscience and clinical research.
相关技术中,普遍采用单一指标作为觉醒状态的判断标准。首先,由于大脑功能是一个整体状态,单一指标并不能完全反映大脑的整体活动水平和功能状态,因此无论是在科学研究,还是临床诊疗中,都难以快速对觉醒状态做出准确判断;其次,运用该标准对觉醒状态进行判断,往往容易因误判而导致血氧不足、气道阻塞和二次插管等,存在安全风险。In related technologies, a single indicator is generally used as the criterion for judging the state of wakefulness. First, since brain function is an overall state, a single indicator cannot fully reflect the overall activity level and functional state of the brain. Therefore, it is difficult to quickly and accurately judge the state of wakefulness in both scientific research and clinical diagnosis and treatment. Secondly, using this standard to judge the state of wakefulness is often prone to misjudgment, resulting in hypoxia, airway obstruction, and secondary intubation, which poses a safety risk.
发明内容Summary of the invention
本申请提供了一种觉醒状态检测系统及方法,以解决觉醒状态判断不准确的技术问题。The present application provides a wakefulness state detection system and method to solve the technical problem of inaccurate wakefulness state judgment.
本申请提供了一种觉醒状态检测系统,该系统包括:生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置、行为模式检测装置和觉醒状态评价装置;其中,所述生理指标检测装置,设置为采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给所述觉醒状态评价装置;所述身体姿态检测装置,设置为对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态 评价装置;所述运动能力检测装置,设置为对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置;所述情绪反应检测装置,设置为对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置;所述行为模式检测装置,设置为对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置;所述刺激响应检测装置,设置为基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号;所述觉醒状态评价装置,设置为基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述行为模式检测结果和所述情绪反应检测结果来确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。The present application provides a wakefulness state detection system, which includes: a physiological indicator detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, an emotional response detection device, a behavior pattern detection device and a wakefulness state evaluation device; wherein the physiological indicator detection device is configured to collect target physiological indicators of a target detection object, generate physiological detection results corresponding to the target physiological indicators, and send the physiological detection results to the wakefulness state evaluation device; the body posture detection device is configured to detect the body posture of the target detection object, generate a posture detection result corresponding to the body posture, and send the posture detection result to the wakefulness state evaluation device. Evaluation device; the motor ability detection device is configured to detect the motor information of the target detection object, generate a motor ability detection result corresponding to the motor information, and send the motor ability detection result to the wakefulness evaluation device; the emotional response detection device is configured to detect the emotional information of the target detection object, generate an emotional response detection result corresponding to the emotional information, and send the emotional response detection result to the wakefulness evaluation device; the behavior pattern detection device is configured to detect the behavior structure and switching mode of the target detection object, generate a behavior pattern detection result corresponding to the behavior phenotype, and send the behavior pattern detection result to the wakefulness evaluation device; the stimulus response detection device is configured to generate a stimulus response detection result corresponding to the target stimulus signal based on the response information of the target detection object to the target stimulus signal, and send the stimulus response detection result to the wakefulness evaluation device, wherein the target stimulus signal includes a harmful stimulus signal; the wakefulness evaluation device is configured to determine the wakefulness of the target detection object based on the received physiological detection result, the posture detection result, the motor ability detection result, the stimulus response detection result, the behavior pattern detection result, and the emotional response detection result, and display the wakefulness.
本申请提供了一种觉醒状态检测方法,该方法应用于觉醒状态检测系统,所述觉醒状态检测系统包括生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、行为模式检测装置、情绪反应检测装置和觉醒状态评价装置;其中,该觉醒状态检测方法包括:通过所述生理指标检测装置,采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给所述觉醒状态评价装置;通过所述身体姿态检测装置,对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置;通过所述运动能力检测装置,对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置;通过所述情绪反应检测装置,对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置;通过所述刺激响应检测装置,基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号;通过所述行为模式检测装置,对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置;通过所述觉醒状态评价装置,基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述行为模式检测结果和所述情绪反应检测结果确定所述目标检测对象的觉醒状态,并 展示所述觉醒状态。The present application provides a method for detecting a wakefulness state, which is applied to a wakefulness state detection system, wherein the wakefulness state detection system includes a physiological indicator detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, a behavior pattern detection device, an emotional response detection device, and a wakefulness state evaluation device; wherein the method for detecting a wakefulness state includes: collecting target physiological indicators of a target detection object through the physiological indicator detection device, generating physiological detection results corresponding to the target physiological indicators, and sending the physiological detection results to the wakefulness state evaluation device; detecting the body posture of the target detection object through the body posture detection device, generating a posture detection result corresponding to the body posture, and sending the posture detection result to the wakefulness state evaluation device; detecting the motion information of the target detection object through the motor ability detection device, generating a motor ability detection result corresponding to the motion information, and sending the motor ability detection result to the wakefulness state evaluation device; detecting the target physiological indicators of a target detection object through the physiological indicator detection device, generating a physiological detection result corresponding to the target physiological indicators, and sending the physiological detection result to the wakefulness state evaluation device; The reaction detection device detects the emotional information of the target detection object, generates an emotional reaction detection result corresponding to the emotional information, and sends the emotional reaction detection result to the wakefulness state evaluation device; through the stimulus response detection device, based on the response information of the target detection object to the target stimulus signal, generates a stimulus response detection result corresponding to the target stimulus signal, and sends the stimulus response detection result to the wakefulness state evaluation device, wherein the target stimulus signal includes a harmful stimulus signal; through the behavior pattern detection device, the behavior structure and switching pattern of the target detection object are detected, and a behavior pattern detection result corresponding to the behavior phenotype is generated, and the behavior pattern detection result is sent to the wakefulness state evaluation device; through the wakefulness state evaluation device, the wakefulness state of the target detection object is determined based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the behavior pattern detection results and the emotional reaction detection results, and the wakefulness state is displayed.
本申请提供了一种电子设备,所述电子设备包括:至少一个处理器;以及与所述至少一个处理器通信连接的存储器;其中,所述存储器存储有可被所述至少一个处理器执行的计算机程序,所述计算机程序被所述至少一个处理器执行,以使所述至少一个处理器能够执行本申请任一实施例所述的觉醒状态检测方法。The present application provides an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the wakefulness state detection method described in any embodiment of the present application.
本申请提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机指令,所述计算机指令用于使处理器执行时实现本申请任一实施例所述的觉醒状态检测方法。The present application provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a processor to implement the wakefulness state detection method described in any embodiment of the present application when executed.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。The following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
图1是根据本申请实施例提供的一种觉醒状态检测系统的结构示意图;FIG1 is a schematic diagram of the structure of a wakefulness state detection system provided according to an embodiment of the present application;
图2是根据本申请实施例的觉醒状态检测系统所适用的工作原理图;FIG2 is a working principle diagram of the wakefulness state detection system according to an embodiment of the present application;
图3是根据本申请实施例提供的一种觉醒状态检测方法的流程示意图;FIG3 is a flow chart of a method for detecting a wakefulness state according to an embodiment of the present application;
图4是实现本申请实施例的觉醒状态检测方法的电子设备的结构示意图。FIG. 4 is a schematic diagram of the structure of an electronic device that implements the awakening state detection method according to an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only embodiments of a part of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.
需要说明的是,本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
图1为本申请实施例提供的一种觉醒状态检测系统的结构示意图。该觉醒 状态检测系统可以采用硬件和/或软件的形式实现。Fig. 1 is a schematic diagram of the structure of a wakefulness state detection system provided in an embodiment of the present application. The wakefulness state detection system can be implemented in the form of hardware and/or software.
如图1所示,该觉醒状态检测系统包括生理指标检测装置10、身体姿态检测装置20、运动能力检测装置30、刺激响应检测装置40、情绪反应检测装置50、行为模式检测模块60、和觉醒状态评价装置70。生理指标检测装置10,设置为采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给觉醒状态评价装置70;身体姿态检测装置20,设置为对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给觉醒状态评价装置70;运动能力检测装置30,设置为对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给觉醒状态评价装置70;情绪反应检测装置40,设置为对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给觉醒状态评价装置70;刺激响应检测装置50,设置为基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给觉醒状态评价装置70,其中,所述目标刺激信号包括伤害性刺激信号;行为模式检测装置60,设置为对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给觉醒状态评价装置70;觉醒状态评价装置70,设置为基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述情绪反应检测结果和所述行为模式检测结果确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。As shown in FIG1 , the wakefulness state detection system includes a physiological indicator detection device 10, a body posture detection device 20, a motor ability detection device 30, a stimulus response detection device 40, an emotional response detection device 50, a behavior pattern detection module 60, and a wakefulness state evaluation device 70. The physiological indicator detection device 10 is configured to collect target physiological indicators of a target detection object, generate physiological detection results corresponding to the target physiological indicators, and send the physiological detection results to the wakefulness state evaluation device 70; the body posture detection device 20 is configured to detect the body posture of the target detection object, generate a posture detection result corresponding to the body posture, and send the posture detection result to the wakefulness state evaluation device 70; the motor ability detection device 30 is configured to detect the motion information of the target detection object, generate a motor ability detection result corresponding to the motion information, and send the motor ability detection result to the wakefulness state evaluation device 70; the emotional response detection device 40 is configured to detect the emotional information of the target detection object, generate an emotional response detection result corresponding to the emotional information, and send the emotional response detection result to the wakefulness state evaluation device 70. state evaluation device 70; a stimulus response detection device 50, which is configured to generate a stimulus response detection result corresponding to the target stimulation signal based on the response information of the target detection object to the target stimulation signal, and send the stimulus response detection result to the wakefulness state evaluation device 70, wherein the target stimulation signal includes a harmful stimulation signal; a behavior pattern detection device 60, which is configured to detect the behavior structure and switching pattern of the target detection object, generate a behavior pattern detection result corresponding to the behavior phenotype, and send the behavior pattern detection result to the wakefulness state evaluation device 70; the wakefulness state evaluation device 70 is configured to determine the wakefulness state of the target detection object based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the emotional response detection results and the behavior pattern detection results, and display the wakefulness state.
本申请实施例的技术方案,通过在觉醒状态检测系统设置生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置、行为模式检测装置和觉醒状态评价装置,构建了一套完整的、多维度的觉醒状态的检测体系。能够通过生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置以及行为模式检测装置,分别对生理指标、身体姿态、运动、刺激响应、情绪和行为的多维度的指标检测,进而,通过觉醒状态评价装置综合生理检测结果、姿态检测结果、运动能力检测结果、刺激响应检测装置、情绪反应检测结果和行为模式检测结果进行综合分析,更为全面的检测目标检测对象的觉醒状态,解决了单一指标判断觉醒状态不准确的技术问题,提升对觉醒状态的检测精准度,为研究觉醒和意识状态的神经机制提供一种科学有效的检测手段。The technical solution of the embodiment of the present application, by setting up a physiological index detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, an emotional response detection device, a behavior pattern detection device and an awakening state evaluation device in the awakening state detection system, constructs a complete, multi-dimensional awakening state detection system. Through the physiological index detection device, the body posture detection device, the motor ability detection device, the stimulus response detection device, the emotional response detection device and the behavioral pattern detection device, the multi-dimensional indicators of physiological indicators, body posture, movement, stimulus response, emotion and behavior can be detected respectively. Then, through the awakening state evaluation device, the physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection device, the emotional response detection results and the behavioral pattern detection results are comprehensively analyzed, and the awakening state of the target detection object is more comprehensively detected, which solves the technical problem of inaccurate judgment of the awakening state by a single indicator, improves the detection accuracy of the awakening state, and provides a scientific and effective detection method for studying the neural mechanism of awakening and consciousness state.
在本申请实施例中,觉醒状态评价装置70,设置为可以将接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测 结果、所述情绪反应检测结果和所述行为模式检测结果在时间维度上进行对齐,进而将同一时间段内的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述情绪反应检测结果和所述行为模式检测结果进行量化,得到每个检测结果对应的单维度评价指标,再对多个检测结果对应的单维度评价指标进行加权融合处理,得到用于指示所述目标检测对象的觉醒状态的综合指标,进而将该综合指标与不同的觉醒状态对应的指标范围进行匹配,以确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。In an embodiment of the present application, the wakefulness state evaluation device 70 is configured to align the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the emotional reaction detection results and the behavioral pattern detection results in the time dimension, and then quantify the physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the emotional reaction detection results and the behavioral pattern detection results in the same time period to obtain a single-dimensional evaluation index corresponding to each detection result, and then perform weighted fusion processing on the single-dimensional evaluation indicators corresponding to multiple detection results to obtain a comprehensive index for indicating the wakefulness state of the target detection object, and then match the comprehensive index with the indicator range corresponding to different wakefulness states to determine the wakefulness state of the target detection object and display the wakefulness state.
示例性地,生理指标检测装置10包括体温检测模块、血压检测模块、心率检测模块、呼吸频率检测模块以及血氧饱和度检测模块中的至少一个。需要说明的是,生理指标检测装置10可以支持多指标检测的多模态检测设备,例如是可以设置为检测体温、血压、心率、呼吸频率以及血氧饱和度等两项或两项以上的生理指标的检测装置。在本申请实施例中,目标检测对象的身体姿态的检测可以通过对目标检测对象的视频信息分析得到。可选地,身体姿态检测装置20包括视频采集模块和姿态分析模块。所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的视频信息,并将所述视频信息发送给姿态分析模块;所述姿态分析模块,设置为通过所述视频信息和预设的人工智能算法对所述目标检测对象的姿态进行识别,以得到所述目标检测对象的姿态检测结果,并将所述姿态检测结果发送给觉醒状态评价装置,其中,所述姿态检测结果包括骨架形态信息和/或身体高度信息。Exemplarily, the physiological index detection device 10 includes at least one of a body temperature detection module, a blood pressure detection module, a heart rate detection module, a respiratory rate detection module, and a blood oxygen saturation detection module. It should be noted that the physiological index detection device 10 can support a multi-modal detection device for multi-index detection, for example, a detection device that can be set to detect two or more physiological indicators such as body temperature, blood pressure, heart rate, respiratory rate, and blood oxygen saturation. In an embodiment of the present application, the detection of the body posture of the target detection object can be obtained by analyzing the video information of the target detection object. Optionally, the body posture detection device 20 includes a video acquisition module and a posture analysis module. The video acquisition module is configured to collect video information of the target detection object in a free activity or external stimulation state, and send the video information to the posture analysis module; the posture analysis module is configured to identify the posture of the target detection object through the video information and a preset artificial intelligence algorithm to obtain the posture detection result of the target detection object, and send the posture detection result to the awakening state evaluation device, wherein the posture detection result includes skeleton morphology information and/or body height information.
在本申请实施例中,对目标对象进行运动检测的方式可以有多种,相应地,运动能力检测装置的结构也可以有多种。In the embodiment of the present application, there may be multiple ways to perform motion detection on the target object, and accordingly, there may be multiple structures of the motion ability detection device.
示例性地,运动能力检测装置可以通过对目标检测对象的视频信息进行运动能力分析得到目标检测对象的运动能力检测结果。可选地,运动能力检测装置30包括视频采集模块和运动分析模块。所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给行为分析模块;所述行为分析模块,设置为通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的行为进行分析,以得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给觉醒状态评价装置70,其中,所述运动能力检测结果包括身体偏转角度信息、运动距离信息以及运动速度信息等信息中的至少一种。Exemplarily, the motor ability detection device can obtain the motor ability detection result of the target detection object by performing motor ability analysis on the video information of the target detection object. Optionally, the motor ability detection device 30 includes a video acquisition module and a motion analysis module. The video acquisition module is configured to capture the behavior video of the target detection object in a free activity or external stimulation state, and send the behavior video to the behavior analysis module; the behavior analysis module is configured to analyze the behavior of the target detection object in different states through the behavior video and a preset artificial intelligence algorithm to obtain the motor ability detection result of the target detection object, and send the motor ability detection result to the awakening state evaluation device 70, wherein the motor ability detection result includes at least one of the information such as body deflection angle information, movement distance information and movement speed information.
在本申请实施例中,人工智能算法可以是预先训练的神经网络模型、深度学习算法以及机器学习算法中的至少一种。In an embodiment of the present application, the artificial intelligence algorithm may be at least one of a pre-trained neural network model, a deep learning algorithm, and a machine learning algorithm.
作为本申请实施例的另一可选技术方案,在上述多个技术方案的基础上,运动能力检测装置30可包括运动检测模块和运动分析模块。示例性地,所述运 动检测模块包括肌电信号采集模块、实验跑台测试模块和转棒仪测试模块中的至少一个。所述肌电信号采集模块,设置为采集目标检测对象的肌电信号,将所述肌电信号作为第一运动检测信号,并将所述第一运动检测信号发送给所述运动分析模块。所述实验跑台测试模块,设置为对所述目标检测对象进行跑步测试,并将跑步测试数据作为第二运动检测信号,并将所述第二运动检测信号发送给所述运动分析模块。所述转棒仪测试模块,设置为对所述目标检测对象进行测试,并将转棒仪测试数据作为第三运动检测信号,并将所述第三运动检测信号发送给所述运动分析模块。所述运动分析模块,设置为对接收到的运动检测信号进行分析,得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给觉醒状态评价装置70,其中,所述运动检测信号包括所述第一运动检测信号,第二运动检测信号以及第三运动检测信号中的至少一种,所述运动能力检测结果包括所述目标检测对象的肌肉力量指标、耐力指标、协调性指标以及平衡力指标等指标中的至少一种。As another optional technical solution of the embodiment of the present application, on the basis of the above-mentioned multiple technical solutions, the athletic ability detection device 30 may include a motion detection module and a motion analysis module. Exemplarily, the motion detection module includes at least one of an electromyographic signal acquisition module, an experimental treadmill test module and a rotarod test module. The electromyographic signal acquisition module is configured to acquire the electromyographic signal of the target detection object, use the electromyographic signal as the first motion detection signal, and send the first motion detection signal to the motion analysis module. The experimental treadmill test module is configured to perform a running test on the target detection object, use the running test data as the second motion detection signal, and send the second motion detection signal to the motion analysis module. The rotarod test module is configured to test the target detection object, use the rotarod test data as the third motion detection signal, and send the third motion detection signal to the motion analysis module. The motion analysis module is configured to analyze the received motion detection signal, obtain the motion ability detection result of the target detection object, and send the motion ability detection result to the wakefulness state evaluation device 70, wherein the motion detection signal includes at least one of the first motion detection signal, the second motion detection signal and the third motion detection signal, and the motion ability detection result includes at least one of the muscle strength index, endurance index, coordination index and balance index of the target detection object.
所述运动分析模块可通过对接收到的所述肌电信号进行分析,得到所述目标检测对象的肌肉力量指标。所述运动分析模块可通过对接收到的所述跑步测试数据进行分析,得到所述目标检测对象的肌肉力量指标和耐力指标。所述运动分析模块可通过对接收到的所述转棒仪测试数据进行分析,得到所述目标检测对象的协调性指标和平衡力指标。The motion analysis module can obtain the muscle strength index of the target detection object by analyzing the received electromyographic signal. The motion analysis module can obtain the muscle strength index and endurance index of the target detection object by analyzing the received running test data. The motion analysis module can obtain the coordination index and balance index of the target detection object by analyzing the received rotarod test data.
示例性地,情绪反应检测装置40可包括视频采集模块和情绪分析模块。所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的视频信息,并将所述视频信息发送给情绪分析模块;所述情绪分析模块,设置为通过所述视频信息和预设的人工智能算法对所述目标检测对象在不同状态下的情绪反应进行分析,以得到所述目标检测对象的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置。情绪反应检测结果可以包括悲伤、痛苦、平静或害怕等情绪中的至少一种。此外,情绪反应检测结果可以包括情绪发生时间、情绪转换时间以及情绪持续时间中的至少一种。Exemplarily, the emotional response detection device 40 may include a video acquisition module and an emotional analysis module. The video acquisition module is configured to acquire video information of the target detection object in a free activity or external stimulation state, and send the video information to the emotional analysis module; the emotional analysis module is configured to analyze the emotional response of the target detection object in different states through the video information and a preset artificial intelligence algorithm to obtain the emotional response detection result of the target detection object, and send the emotional response detection result to the awakening state evaluation device. The emotional response detection result may include at least one of the emotions such as sadness, pain, calmness or fear. In addition, the emotional response detection result may include at least one of the emotion occurrence time, emotion conversion time and emotion duration.
对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给觉醒状态评价装置70。The emotional information of the target detection object is detected, an emotional response detection result corresponding to the emotional information is generated, and the emotional response detection result is sent to the wakefulness state evaluation device 70.
行为是大脑状态最直接的外在表征,利用数据驱动的精细行为分析,可以一定程度上反映出大脑的内在状态。Behavior is the most direct external representation of the brain's state. Using data-driven sophisticated behavioral analysis can reflect the brain's internal state to a certain extent.
类似地,可以通过对目标检测对象的视频信息进行行为模式分析得到目标检测对象的行为模式检测结果。可选地,所述行为模式检测装置60包括行为视频采集模块和行为分析模块,其中,所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给 行为分析模块;所述行为分析模块,设置为通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的行为结果和切换模式进行分析,以得到所述目标检测对象的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置,其中,所述行为模式检测结果包括行为动作种类信息、动作发生频率信息、行为状态转移信息以及行为模式切换信息等信息中的至少一种。Similarly, the behavior pattern detection result of the target detection object can be obtained by performing behavior pattern analysis on the video information of the target detection object. Optionally, the behavior pattern detection device 60 includes a behavior video acquisition module and a behavior analysis module, wherein the video acquisition module is configured to acquire the behavior video of the target detection object in a free activity or external stimulation state, and send the behavior video to the behavior analysis module; the behavior analysis module is configured to analyze the behavior results and switching modes of the target detection object in different states through the behavior video and a preset artificial intelligence algorithm to obtain the behavior pattern detection result of the target detection object, and send the behavior pattern detection result to the wakefulness state evaluation device, wherein the behavior pattern detection result includes at least one of the information such as behavior action type information, action frequency information, behavior state transition information, and behavior pattern switching information.
可选地,刺激响应检测装置50包括刺激单元、响应信息采集单元和响应结果检测单元。所述刺激单元,设置为响应于刺激触发指令,生成目标刺激信号,将所述目标刺激信号作用于所述目标刺激对象,其中,所述目标刺激信号包括中的视觉刺激信号、嗅觉刺激信号、感觉刺激信号和听觉刺激信号中的至少一种;所述响应信息采集单元,设置为采集所述目标检测对象响应所述目标刺激信号的响应信息,并将所述响应信息发送给所述响应结果检测单元;所述响应结果检测单元,设置为根据所述响应信息生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给觉醒状态评价装置70。Optionally, the stimulus response detection device 50 includes a stimulus unit, a response information collection unit, and a response result detection unit. The stimulus unit is configured to generate a target stimulus signal in response to a stimulus trigger instruction, and apply the target stimulus signal to the target stimulus object, wherein the target stimulus signal includes at least one of a visual stimulus signal, an olfactory stimulus signal, a sensory stimulus signal, and an auditory stimulus signal; the response information collection unit is configured to collect response information of the target detection object in response to the target stimulus signal, and send the response information to the response result detection unit; the response result detection unit is configured to generate a stimulus response detection result corresponding to the target stimulus signal according to the response information, and send the stimulus response detection result to the wakefulness state evaluation device 70.
刺激单元可以根据实际需求生成目标刺激信号,例如可以是多模态感知觉刺激信号。刺激单元可以设置有用户操作部件和显示部件。用户操作部件可以是至少由刺激参数设置按钮及刺激开始按钮和/或刺激停止按钮组成物理式操控部件;也可以是支持刺激参数设置和刺激触发的触控式操作部件。The stimulation unit can generate a target stimulation signal according to actual needs, for example, a multimodal sensory stimulation signal. The stimulation unit can be provided with a user operation component and a display component. The user operation component can be a physical control component consisting of at least a stimulation parameter setting button and a stimulation start button and/or a stimulation stop button; or it can be a touch-operated component that supports stimulation parameter setting and stimulation triggering.
示例性地,所述响应信息可以包括目标检测对象针对所述目标刺激信号的反应潜伏期、反应强度及反应时长等信息中的至少一种。Exemplarily, the response information may include at least one of information such as a reaction latency, reaction intensity, and reaction duration of the target detection object to the target stimulation signal.
在上述多个技术方案的基础上,觉醒状态检测系统还可以通过脑部活动分析目标检测对象的觉醒状态。可选地,觉醒状态检测系统还包括脑电信号检测装置。所述脑电信号检测装置,设置为对所述目标检测对象的脑电信号进行检测,生成与所述皮层脑电信号对应的脑电检测结果,并将所述脑电检测结果发送给觉醒状态评价装置70;觉醒状态评价装置70,还设置为基于所述脑电检测结果更新所述目标检测对象的所述觉醒状态。On the basis of the above-mentioned multiple technical solutions, the wakefulness state detection system can also analyze the wakefulness state of the target detection object through brain activity. Optionally, the wakefulness state detection system also includes an EEG signal detection device. The EEG signal detection device is configured to detect the EEG signal of the target detection object, generate an EEG detection result corresponding to the cortical EEG signal, and send the EEG detection result to the wakefulness state evaluation device 70; the wakefulness state evaluation device 70 is also configured to update the wakefulness state of the target detection object based on the EEG detection result.
所述脑电信号检测装置包括脑电信号采集模块、神经元信号采集模块和脑电检测模块,其中,所述脑电信号采集模块,设置为采集所述目标检测对象的皮层脑电信号,将所述皮层脑电信号发送给所述脑电检测模块;所述神经元信号采集模块,设置为获取所述目标检测对象的皮层下脑区的神经活动信息及活性变化信息,将所述神经活动信息及所述活性变化信息发送给所述脑电检测模块,其中,所述神经元信号采集模块包括钙离子光纤记录单元和/或双光子活体钙成像单元;所述脑电检测模块,设置为基于所述皮层脑电信号、和所述皮层下脑区的神经活动信息以及活性变化信息分析出所述皮层脑电信号在预设波段 内的波段特征,将所述波段特征作为与所述皮层脑电信号对应的脑电检测结果,将所述脑电检测结果发送给觉醒状态评价装置70,其中,所述波段特征包括幅度、频率、能值和以及神经活动的变化信息中的至少一项。The EEG signal detection device includes an EEG signal acquisition module, a neuron signal acquisition module and an EEG detection module, wherein the EEG signal acquisition module is configured to acquire the cortical EEG signal of the target detection object and send the cortical EEG signal to the EEG detection module; the neuron signal acquisition module is configured to obtain the neural activity information and activity change information of the subcortical brain area of the target detection object and send the neural activity information and the activity change information to the EEG detection module, wherein the neuron signal acquisition module includes a calcium ion fiber recording unit and/or a two-photon in vivo calcium imaging unit; the EEG detection module is configured to analyze the band characteristics of the cortical EEG signal within a preset band based on the cortical EEG signal and the neural activity information and activity change information of the subcortical brain area, use the band characteristics as the EEG detection result corresponding to the cortical EEG signal, and send the EEG detection result to the wakefulness state evaluation device 70, wherein the band characteristics include at least one of amplitude, frequency, energy value and neural activity change information.
采用本技术方案,通过脑电信号可以分析出大脑皮层的活动特点,通过神经元信号采集模块可以分析出大脑皮层下脑区的活动信息,将两者进行结合能够更为准确地分析出目标检测对象的脑部活动特征。考虑到脑电信息可以划分为标志性的特定波段,如α、β、θ和γ波,可以针对每个特定波段进行分析,从而以不同的维度对脑电信号进行精细化分析。By adopting this technical solution, the activity characteristics of the cerebral cortex can be analyzed through the EEG signal, and the activity information of the subcortical brain area can be analyzed through the neuron signal acquisition module. Combining the two can more accurately analyze the brain activity characteristics of the target detection object. Considering that EEG information can be divided into iconic specific bands, such as α, β, θ and γ waves, each specific band can be analyzed, thereby performing a refined analysis of EEG signals in different dimensions.
觉醒状态评价装置70,可设置为基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述情绪反应检测结果、所述脑电检测结果和所述行为模式检测结果,确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。The wakefulness state evaluation device 70 can be configured to determine the wakefulness state of the target detection object based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the emotional response detection results, the EEG detection results and the behavioral pattern detection results, and display the wakefulness state.
由于眼动变化信息可以有效反映目标检测对象的注意力和警觉水平等信息,因此,可以基于眼动变化信息来检测目标检测对象的觉醒状态。可选地,觉醒状态检测系统还包括眼动追踪装置。眼动追踪装置,设置为获取所述目标检测对象在自由活动或接收外界刺激的状态下的眼动变化信息,将所述眼动变化信息发送至所述觉醒状态评价装置;所述觉醒状态评价装置,还设置为基于所述眼动变化信息更新所述目标检测对象的所述觉醒状态。所述眼动变化信息包括瞳孔直径变化信息、瞳孔位移信息及瞳孔偏转角度信息中的至少一种。Since the eye movement change information can effectively reflect information such as the attention and alertness level of the target detection object, the wakefulness state of the target detection object can be detected based on the eye movement change information. Optionally, the wakefulness state detection system also includes an eye tracking device. The eye tracking device is configured to obtain the eye movement change information of the target detection object when it is in a state of free movement or receiving external stimulation, and send the eye movement change information to the wakefulness state evaluation device; the wakefulness state evaluation device is also configured to update the wakefulness state of the target detection object based on the eye movement change information. The eye movement change information includes at least one of pupil diameter change information, pupil displacement information and pupil deflection angle information.
可选地,觉醒状态检测系统还包括靶点调控模块。所述靶点调控模块,设置为通过在体光遗传学技术对目标神经元靶点的活动状态进行调控。Optionally, the wakefulness state detection system further comprises a target point regulation module, which is configured to regulate the activity state of the target neuron target point through in vivo optogenetics technology.
在采用本申请实施例中的觉醒状态检测系统进行觉醒检测时,可以通过对系统采集的数据进行分析,确定与觉醒状态相关的神经元,设置目标神经元靶点。进而通过靶点调控模块基于在体光遗传学技术对目标神经元靶点的活动状态进行调控,如激活神经元或抑制神经元活动,可以分析目标检测对象在麻醉到觉醒过程中以上多个指标的变化特征,可进一步评估觉醒状态,亦可对本觉醒状态检测系统的评价体系进行验证。When the awakening state detection system in the embodiment of the present application is used for awakening detection, the neurons related to the awakening state can be determined by analyzing the data collected by the system, and the target neuron targets can be set. Then, the activity state of the target neuron targets can be regulated by the target control module based on in vivo optogenetics technology, such as activating neurons or inhibiting neuron activity. The change characteristics of the above multiple indicators of the target detection object during the process from anesthesia to awakening can be analyzed, and the awakening state can be further evaluated, and the evaluation system of the awakening state detection system can also be verified.
为了便于对觉醒状态的检测结果进行直观了解,可选地,觉醒状态检测系统还可以包括显示装置、声音播放装置以及无线通信装置中的至少一种。显示装置可以与觉醒状态评价装置连接,设置为显示所述目标检测对象的觉醒状态。声音播放装置可以与觉醒状态评价装置连接,设置为语音播报所述目标检测对象的觉醒状态。无线通信装置可以与觉醒状态评价装置连接,设置为将所述目标检测对象的觉醒状态发送至目标终端。In order to facilitate intuitive understanding of the detection results of the wakefulness state, optionally, the wakefulness state detection system may also include at least one of a display device, a sound playback device, and a wireless communication device. The display device may be connected to the wakefulness state evaluation device and configured to display the wakefulness state of the target detection object. The sound playback device may be connected to the wakefulness state evaluation device and configured to voice broadcast the wakefulness state of the target detection object. The wireless communication device may be connected to the wakefulness state evaluation device and configured to send the wakefulness state of the target detection object to the target terminal.
此外,显示装置、声音播放装置以及无线通信装置还可以分别与生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置、行为模式检测装置、脑电信号检测装置、眼动追踪装置以及靶点调控模块连接,设置为展示相关装置的预设展示信息。In addition, the display device, the sound playing device and the wireless communication device can also be respectively connected to the physiological index detection device, the body posture detection device, the motor ability detection device, the stimulus response detection device, the emotional response detection device, the behavior pattern detection device, the EEG signal detection device, the eye tracking device and the target control module, and set to display the preset display information of the relevant devices.
图2是根据本申请实施例的觉醒状态检测系统所适用的工作原理图。如图2所示,本申请实施例的觉醒状态检测系统,尤其适用于麻醉后的觉醒状态评价,主要包括:(1)基于本申请实施例的觉醒状态检测系统的评价体系,将视觉刺激诱发的防御反应应用于全身麻醉状态下觉醒状态评判过程中,将可诱发防御反应的视觉刺激和全身麻醉诱发的特殊脑状态相结合;(2)整个检测系统分清醒、翻正反射恢复(recovery of righting reflex,RORR)和翻正反射恢复后(post-recovery of righting reflex,post-RORR)三个阶段进行,每个阶段中适时给予动物视觉刺激,彼此之间相互比较其行为反应;(3)该系统同时纳入基本生理指标、行为表型、脑电/肌电信号记录、移动眼动追踪、运动能力测试、三维(three dimension,3D)精细行为分析、光纤记录和光遗传调控等多种手段,可实现多维度的指标检测。FIG2 is a working principle diagram of the awakening state detection system according to the embodiment of the present application. As shown in FIG2, the awakening state detection system of the embodiment of the present application is particularly suitable for evaluating the awakening state after anesthesia, and mainly includes: (1) Based on the evaluation system of the awakening state detection system of the embodiment of the present application, the defense reaction induced by visual stimulation is applied to the awakening state judgment process under general anesthesia, and the visual stimulation that can induce the defense reaction is combined with the special brain state induced by general anesthesia; (2) The entire detection system is divided into three stages: awakening, recovery of righting reflex (RORR) and post-recovery of righting reflex (post-RORR). In each stage, visual stimulation is given to the animal in a timely manner, and its behavioral response is compared with each other; (3) The system simultaneously incorporates basic physiological indicators, behavioral phenotypes, EEG/EMG signal recording, mobile eye tracking, motor ability test, three-dimensional (3D) fine behavior analysis, fiber optic recording and optogenetic regulation, etc., which can realize multi-dimensional indicator detection.
利用生理监护仪监测目标检测对象(图中的小动物)在不同状态下的基本生理指标,如体温、血压、心率、呼吸频率以及血氧饱和度等。利用常规的脑电(Electroencephalogram,EEG)信号采集设备,并结合钙离子光纤记录或双光子活体钙成像技术,可实时获取动物在不同状态下的皮层EEG信号及皮层下脑区的神经活动及活性变化,分析出特定波段(如α、β、θ和γ波等)的幅度、频率、能值以及神经活动的变化强弱等,并通过算法将皮层信号和皮层下信号在时间维度上进行同步,进而分析皮层和皮层下活动的关联性(如恢复顺序、恢复程度),即可对动物整体的大脑觉醒状态进行评判。利用本实验室自主研发的超微型易兼容眼动追踪系统可以实时获取动物在自由活动或接收外界刺激状态下的眼动变化信息,可对评判动物的注意力和警觉水平等。利用动物实验跑台和转棒仪对动物的运动进行测试,包括协调性、平衡力、肌肉力量和耐力等,并结合植入电极采集到的肌电(Electromyography,EMG)信号,可综合评判动物在不同状态下的运动能力。在不同阶段对动物实施伤害性刺激(如夹尾),分析其响应刺激所需要的反应潜伏期、反应强度及反应时长等,对动物在不同阶段下的疼痛反应及对恶性刺激加工处理能力进行评估。通过利用本实验室自主研发的高精度动物行为三维重建和自动化表型鉴定的新系统Behavior Atlas,可全方位采集动物在自由活动或外界刺激状态下的行为视频,进而利用人工智能算法对动物的行为进行分割、聚类、重建和注释,可对动物在不同状态下的行为和身体姿态进行精细分析,获得动物骨架、身体高度、偏转角度、运动距离和速度、动作种类和频率、状态转移以及行为切换模式等多维度的信息,综 合评判动物在麻醉停止--RORR--post-RORR,直至完全恢复清醒过程中的行为觉醒水平。Use physiological monitors to monitor the basic physiological indicators of the target detection object (the small animal in the picture) in different states, such as body temperature, blood pressure, heart rate, respiratory rate, and blood oxygen saturation. Using conventional electroencephalogram (EEG) signal acquisition equipment, combined with calcium ion fiber recording or two-photon in vivo calcium imaging technology, the cortical EEG signals of animals in different states and the neural activity and activity changes of the subcortical brain area can be obtained in real time, and the amplitude, frequency, energy value and strength of neural activity changes of specific bands (such as α, β, θ and γ waves, etc.) can be analyzed. The cortical signal and the subcortical signal are synchronized in the time dimension through an algorithm, and then the correlation between the cortical and subcortical activities (such as the order and degree of recovery) is analyzed, and the overall brain wakefulness state of the animal can be judged. Using the ultra-micro and easy-to-compatible eye tracking system independently developed by this laboratory, the eye movement change information of animals in free activities or receiving external stimuli can be obtained in real time, which can be used to judge the attention and alertness level of animals. The animal treadmill and rotarod are used to test the movement of animals, including coordination, balance, muscle strength and endurance, etc., and combined with the electromyography (EMG) signals collected by implanted electrodes, the animal's movement ability in different states can be comprehensively evaluated. The animals are subjected to noxious stimulation (such as tail clamping) at different stages, and the reaction latency, reaction intensity and reaction time required to respond to the stimulation are analyzed to evaluate the pain response of the animals at different stages and their ability to process malignant stimulation. By using the new system Behavior Atlas independently developed by our laboratory for high-precision animal behavior three-dimensional reconstruction and automated phenotypic identification, we can collect all-round behavioral videos of animals in free movement or under external stimulation, and then use artificial intelligence algorithms to segment, cluster, reconstruct and annotate the animal's behavior. We can perform a detailed analysis of the animal's behavior and body posture in different states, obtain multi-dimensional information such as the animal's skeleton, body height, deflection angle, movement distance and speed, movement type and frequency, state transition and behavior switching mode, and comprehensively evaluate the animal's behavioral awakening level during the process of anesthesia cessation-RORR-post-RORR until full recovery.
同时,利用在体光遗传学技术对特定靶点进行人为调控,如激活或抑制神经元活动。操作中,首先在清醒状态下选择能够对不断迫近的上视野阴影刺激(looming)做出正常防御反应的目标检测对象(图2中示出的动物),进而由全麻药物诱导动物进入全身麻醉状态,维持该状态30分钟后,将动物重新放回行为箱体中,保持翻正反射消失(loss of righting reflex,LORR)姿势。待其RORR瞬间和之后的适当时间点,再次给予视觉刺激,记录其行为反应。在技术允许及可操纵条件下,对同一只动物进行多维度指标的同步记录和监测,如生理指标检测+EEG/EMG记录+眼动追踪+光遗传调控+精细行为分析的组合方案,可在同一个体上同时获取多个维度的信息,并将多维信息在时间或空间尺度上进行匹配和关联分析,综合判断小鼠的觉醒状态。如果麻醉结束之后一时间点的多个水平指标已经基本和清醒状态下一致,即可认为动物在该时刻已恢复到正常觉醒水平。At the same time, in vivo optogenetics is used to artificially regulate specific targets, such as activating or inhibiting neuronal activity. In the operation, first, select the target detection object (the animal shown in Figure 2) that can make a normal defensive response to the approaching upper visual field shadow stimulation (looming) in the awake state, and then induce the animal into a state of general anesthesia with general anesthetics. After maintaining this state for 30 minutes, put the animal back into the behavior box and keep the loss of righting reflex (LORR) posture. Wait for its RORR moment and at an appropriate time point thereafter, give visual stimulation again, and record its behavioral response. Under technically permitted and manipulable conditions, the same animal is synchronously recorded and monitored for multi-dimensional indicators, such as a combination of physiological indicator detection + EEG/EMG recording + eye tracking + optogenetic regulation + fine behavior analysis. It can simultaneously obtain information in multiple dimensions on the same individual, match and correlate the multi-dimensional information in time or space scales, and comprehensively judge the awakening state of the mouse. If multiple horizontal indicators at a time point after the end of anesthesia are basically consistent with those in the awake state, it can be considered that the animal has recovered to a normal awakening level at that moment.
图3为本申请实施例提供的一种觉醒状态检测方法的流程示意图,本实施例可适用于对目标检测对象的觉醒状态进行检测的情况,该方法可应用于觉醒状态检测系统,其中,所述觉醒状态检测系统包括生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置、行为模式检测装置和觉醒状态评价装置。可选地,该方法可以由觉醒状态检测装置来执行,该觉醒状态检测装置可以采用硬件和/或软件的形式实现,该觉醒状态检测装置可配置于觉醒状态检测系统中或者独立于觉醒状态检测系统的电子设备中,也可以是一种程序产品。如图3所示,该方法包括如下步骤。FIG3 is a flow chart of a wakefulness state detection method provided in an embodiment of the present application. This embodiment is applicable to the case of detecting the wakefulness state of a target detection object. The method can be applied to a wakefulness state detection system, wherein the wakefulness state detection system includes a physiological index detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, an emotional response detection device, a behavior pattern detection device, and a wakefulness state evaluation device. Optionally, the method can be performed by a wakefulness state detection device, which can be implemented in the form of hardware and/or software. The wakefulness state detection device can be configured in the wakefulness state detection system or in an electronic device independent of the wakefulness state detection system, or can be a program product. As shown in FIG3 , the method includes the following steps.
S201、通过所述生理指标检测装置,采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给所述觉醒状态评价装置。S201. Collect target physiological indicators of a target detection object through the physiological indicator detection device, generate physiological detection results corresponding to the target physiological indicators, and send the physiological detection results to the wakefulness state evaluation device.
S202、通过所述身体姿态检测装置,对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置。S202. Detect the body posture of the target detection object through the body posture detection device, generate a posture detection result corresponding to the body posture, and send the posture detection result to the wakefulness state evaluation device.
S203、通过所述运动能力检测装置,对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置。S203, detecting the motion information of the target detection object through the motion ability detection device, generating a motion ability detection result corresponding to the motion information, and sending the motion ability detection result to the wakefulness state evaluation device.
S204、通过所述情绪反应检测装置,对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置。S204, detecting the emotional information of the target detection object through the emotional response detection device, generating an emotional response detection result corresponding to the emotional information, and sending the emotional response detection result to the wakefulness state evaluation device.
S205、通过所述刺激响应检测装置,基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号。S205. Generate a stimulus response detection result corresponding to the target stimulus signal based on the response information of the target detection object to the target stimulus signal through the stimulus response detection device, and send the stimulus response detection result to the wakefulness state evaluation device, wherein the target stimulus signal includes a harmful stimulus signal.
S206、通过所述行为模式检测装置,对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置。S206. Detect the behavior structure and switching pattern of the target detection object through the behavior pattern detection device, generate a behavior pattern detection result corresponding to the behavior phenotype, and send the behavior pattern detection result to the wakefulness state evaluation device.
S207、通过所述觉醒状态评价装置,基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述行为模式检测结果和所述情绪反应检测结果确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。S207. Determine the wakefulness state of the target detection object through the wakefulness state evaluation device based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the behavior pattern detection results and the emotional reaction detection results, and display the wakefulness state.
本申请实施例的技术方案,通过在觉醒状态检测系统设置生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、情绪反应检测装置和觉醒状态评价装置,构建了一套完整的、多维度的觉醒状态的检测体系。能够通过生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、及情绪反应检测装置以及行为模式检测装置,分别对生理指标、身体姿态、运动、刺激响应以及情绪的多维度的指标进行检测,进而,通过觉醒状态评价装置综合生理检测结果、姿态检测结果、运动能力检测结果、刺激响应检测装置、情绪反应检测结果和行为模式检测结果进行综合分析,更为全面的检测目标检测对象的觉醒状态,解决了单一指标判断觉醒状态不准确的技术问题,提升了对觉醒状态的检测精准度,为研究觉醒和意识状态的神经机制提供一种科学有效的检测手段。The technical solution of the embodiment of the present application, by setting up a physiological index detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, an emotional response detection device and an awakening state evaluation device in the awakening state detection system, constructs a complete, multi-dimensional awakening state detection system. Through the physiological index detection device, the body posture detection device, the motor ability detection device, the stimulus response detection device, the emotional response detection device and the behavior pattern detection device, the multi-dimensional indicators of physiological indicators, body posture, movement, stimulus response and emotion can be detected respectively, and then, through the awakening state evaluation device, the physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection device, the emotional response detection results and the behavior pattern detection results are comprehensively analyzed, and the awakening state of the detection target object is more comprehensively detected, which solves the technical problem of inaccurate judgment of the awakening state by a single indicator, improves the detection accuracy of the awakening state, and provides a scientific and effective detection method for studying the neural mechanism of awakening and consciousness state.
可选地,所述身体姿态检测装置包括视频采集模块和姿态分析模块。Optionally, the body posture detection device includes a video acquisition module and a posture analysis module.
相应地,所述通过所述身体姿态检测装置,对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置,包括:通过所述视频采集模块,采集所述目标检测对象在自由活动或外界刺激状态下的视频信息,并将所述视频信息发送给姿态分析模块;通过所述姿态分析模块,通过所述视频信息和预设的人工智能算法对所述目标检测对象的姿态进行识别,以得到所述目标检测对象的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置,其中,所述姿态检测结果包括骨架形态信息和/或身体高度信息。Correspondingly, the body posture of the target detection object is detected by the body posture detection device, a posture detection result corresponding to the body posture is generated, and the posture detection result is sent to the wakefulness state evaluation device, including: through the video acquisition module, video information of the target detection object in a free activity or external stimulation state is collected, and the video information is sent to the posture analysis module; through the posture analysis module, the posture of the target detection object is identified through the video information and a preset artificial intelligence algorithm to obtain the posture detection result of the target detection object, and the posture detection result is sent to the wakefulness state evaluation device, wherein the posture detection result includes skeleton morphology information and/or body height information.
可选地,所述运动能力检测装置包括视频采集模块和运动分析模块。相应地,所述通过所述运动能力检测装置,对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结 果发送给所述觉醒状态评价装置,包括:通过所述视频采集模块,采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给行为分析模块;通过所述行为分析模块,通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的行为进行分析,以得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置,其中,所述运动能力检测结果包括身体偏转角度信息、运动距离信息以及运动速度信息中的至少一种。Optionally, the motion ability detection device includes a video acquisition module and a motion analysis module. Accordingly, the motion information of the target detection object is detected by the motion ability detection device, a motion ability detection result corresponding to the motion information is generated, and the motion ability detection result is sent to the wakefulness state evaluation device, including: collecting the behavior video of the target detection object in a free activity or external stimulation state by the video acquisition module, and sending the behavior video to the behavior analysis module; analyzing the behavior of the target detection object in different states by the behavior video and a preset artificial intelligence algorithm by the behavior analysis module to obtain the motion ability detection result of the target detection object, and sending the motion ability detection result to the wakefulness state evaluation device, wherein the motion ability detection result includes at least one of body deflection angle information, movement distance information and movement speed information.
可选地,所述运动能力检测装置包括运动检测模块和运动分析模块,所述运动测试模块包括肌电信号采集模块、实验跑台测试模块和转棒仪测试模块中的至少一个。Optionally, the athletic ability detection device includes a motion detection module and a motion analysis module, and the motion test module includes at least one of an electromyographic signal acquisition module, an experimental treadmill test module and a rotarod test module.
相应地,所述通过所述运动能力检测装置,对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置,包括:通过所述肌电信号采集模块,采集目标检测对象的肌电信号,将所述肌电信号作为第一运动检测信号,并将所述第一运动检测信号发送给所述运动分析模块;通过所述实验跑台测试模块,对所述目标检测对象进行跑步测试,并将跑步测试数据作为第二运动检测信号,并将所述第二运动检测信号发送给所述运动分析模块;通过所述转棒仪测试模块,对所述目标检测对象进行测试,并将转棒仪测试数据作为第三运动检测信号,并将所述第三运动检测信号发送给所述运动分析模块;通过所述运动分析模块,对接收到的运动检测信号进行分析,得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置,其中,所述运动检测信号包括所述第一运动检测信号,第二运动检测信号以及第三运动检测信号中的至少一种,所述运动能力检测结果包括所述目标检测对象的肌肉力量指标、耐力指标、协调性指标以及平衡力指标中的至少一种。Correspondingly, the motion information of the target detection object is detected through the motion ability detection device, a motion ability detection result corresponding to the motion information is generated, and the motion ability detection result is sent to the wakefulness state evaluation device, including: collecting the electromyographic signal of the target detection object through the electromyographic signal acquisition module, using the electromyographic signal as the first motion detection signal, and sending the first motion detection signal to the motion analysis module; performing a running test on the target detection object through the experimental treadmill test module, and using the running test data as the second motion detection signal, and sending the second motion detection signal to the motion analysis module; A testing module tests the target detection object, and uses the rotarod test data as a third motion detection signal, and sends the third motion detection signal to the motion analysis module; the received motion detection signal is analyzed by the motion analysis module to obtain a motion ability detection result of the target detection object, and the motion ability detection result is sent to the wakefulness state evaluation device, wherein the motion detection signal includes at least one of the first motion detection signal, the second motion detection signal and the third motion detection signal, and the motion ability detection result includes at least one of the muscle strength index, endurance index, coordination index and balance index of the target detection object.
可选地,刺激响应检测装置50包括刺激单元、响应信息采集单元和响应结果检测单元。Optionally, the stimulus response detection device 50 includes a stimulation unit, a response information acquisition unit and a response result detection unit.
相应地,所述通过刺激响应检测装置50,基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号,包括:通过所述刺激单元,响应于刺激触发指令,生成目标刺激信号,将所述目标刺激信号作用于所述目标刺激对象,其中,所述目标刺激信号包括中的视觉刺激信号、嗅觉刺激信号、感觉刺激信号和听觉刺激信号中的至少一种;通过所述响应信息采集单元,采集所述目标检测对象响应所述目标刺激信号的响应信息,并将所述响应信息发送给所述响应结果检测 单元;通过所述响应结果检测单元,根据所述响应信息生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置。Correspondingly, the stimulus response detection device 50 generates a stimulus response detection result corresponding to the target stimulus signal based on the response information of the target detection object to the target stimulus signal, and sends the stimulus response detection result to the wakefulness state evaluation device, wherein the target stimulus signal includes a harmful stimulus signal, including: generating a target stimulus signal through the stimulation unit in response to a stimulus trigger instruction, and applying the target stimulus signal to the target stimulus object, wherein the target stimulus signal includes at least one of a visual stimulus signal, an olfactory stimulus signal, a sensory stimulus signal and an auditory stimulus signal; collecting response information of the target detection object in response to the target stimulus signal through the response information collection unit, and sending the response information to the response result detection unit; generating a stimulus response detection result corresponding to the target stimulus signal through the response result detection unit according to the response information, and sending the stimulus response detection result to the wakefulness state evaluation device.
可选地,所述行为模式检测装置包括行为视频采集模块和行为分析模块。Optionally, the behavior pattern detection device includes a behavior video acquisition module and a behavior analysis module.
相应地,所述通过所述行为模式检测装置,对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置,包括:通过所述视频采集模块,采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给行为分析模块;所述行为分析模块,设置为通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的行为结果和切换模式进行分析,以得到所述目标检测对象的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置,其中,所述行为模式检测结果包括行为动作种类信息、动作发生频率信息、行为状态转移信息以及行为模式切换信息等信息中的至少一种。Correspondingly, the behavior structure and switching pattern of the target detection object are detected by the behavior pattern detection device, a behavior pattern detection result corresponding to the behavior phenotype is generated, and the behavior pattern detection result is sent to the wakefulness state evaluation device, including: collecting the behavior video of the target detection object in a free activity or external stimulation state through the video acquisition module, and sending the behavior video to the behavior analysis module; the behavior analysis module is configured to analyze the behavior results and switching patterns of the target detection object in different states through the behavior video and a preset artificial intelligence algorithm to obtain the behavior pattern detection result of the target detection object, and send the behavior pattern detection result to the wakefulness state evaluation device, wherein the behavior pattern detection result includes at least one of the information such as behavior action type information, action frequency information, behavior state transition information and behavior pattern switching information.
可选地,所述觉醒状态检测系统还包括脑电信号检测装置。相应地,所述觉醒状态检测方法还可以包括:通过所述皮层脑电信号检测装置,对所述目标检测对象的脑电信号进行检测,生成与所述皮层脑电信号对应的脑电检测结果,并将所述脑电检测结果发送给所述觉醒状态评价装置;通过所述觉醒状态评价装置,基于所述脑电检测结果更新所述目标检测对象的所述觉醒状态。Optionally, the wakefulness state detection system further includes an electroencephalogram (EEG) signal detection device. Accordingly, the wakefulness state detection method may further include: detecting the EEG signal of the target detection object through the cortical EEG signal detection device, generating an EEG detection result corresponding to the cortical EEG signal, and sending the EEG detection result to the wakefulness state evaluation device; and updating the wakefulness state of the target detection object based on the EEG detection result through the wakefulness state evaluation device.
可选地,所述皮层脑电信号检测装置包括脑电信号采集模块、神经元信号采集模块和脑电检测模块。Optionally, the cortical EEG signal detection device includes an EEG signal acquisition module, a neuron signal acquisition module and an EEG detection module.
相应地,所述通过所述皮层脑电信号检测装置,对所述目标检测对象的脑电信号进行检测,生成与所述皮层脑电信号对应的脑电检测结果,并将所述脑电检测结果发送给所述觉醒状态评价装置,包括:通过所述皮层脑电信号采集模块,采集所述目标检测对象的皮层脑电信号,将所述皮层脑电信号发送给所述脑电检测模块;通过所述神经元信号采集模块,获取所述目标检测对象的皮层下脑区的神经活动信息及活性变化信息,将所述神经活动信息及所述活性变化信息发送给所述脑电检测模块,其中,所述神经元信号采集模块包括钙离子光纤记录单元和/或双光子活体钙成像单元;通过所述脑电检测模块,基于所述皮层脑电信号、和所述皮层下脑区的神经活动信息以及活性变化信息分析出所述皮层脑电信号在预设波段内的波段特征,将所述波段特征作为与所述皮层脑电信号对应的脑电检测结果,将所述脑电检测结果发送给所述觉醒状态评价装置,其中,所述波段特征包括幅度、频率、能值和以及神经活动的变化信息中的至少一项。Correspondingly, the cortical EEG signal detection device detects the EEG signal of the target detection object, generates an EEG detection result corresponding to the cortical EEG signal, and sends the EEG detection result to the wakefulness state evaluation device, including: collecting the cortical EEG signal of the target detection object through the cortical EEG signal acquisition module, and sending the cortical EEG signal to the EEG detection module; acquiring the neural activity information and activity change information of the subcortical brain area of the target detection object through the neuron signal acquisition module, and sending the neural activity information and the activity change information to the EEG detection module; The method is to send the neuron signal to the EEG detection module, wherein the neuron signal acquisition module includes a calcium ion fiber recording unit and/or a two-photon in vivo calcium imaging unit; through the EEG detection module, based on the cortical EEG signal, the neural activity information of the subcortical brain area and the activity change information, analyze the band characteristics of the cortical EEG signal within a preset band, use the band characteristics as the EEG detection result corresponding to the cortical EEG signal, and send the EEG detection result to the wakefulness state evaluation device, wherein the band characteristics include at least one of amplitude, frequency, energy value and change information of neural activity.
可选地,所述觉醒状态检测系统还包括眼动追踪装置。相应地,所述觉醒状态检测方法还可以包括:通过所述眼动追踪装置,获取所述目标检测对象在自由活动或接收外界刺激的状态下的眼动变化信息,将所述眼动变化信息发送至所述觉醒状态评价装置,其中,所述眼动变化信息包括瞳孔直径变化信息、瞳孔位移信息及瞳孔偏转角度信息中的至少一种;所述觉醒状态评价装置,还设置为基于所述眼动变化信息更新所述目标检测对象的所述觉醒状态。Optionally, the wakefulness state detection system also includes an eye tracking device. Accordingly, the wakefulness state detection method may also include: obtaining eye movement change information of the target detection object in a state of free movement or receiving external stimulation through the eye tracking device, and sending the eye movement change information to the wakefulness state evaluation device, wherein the eye movement change information includes at least one of pupil diameter change information, pupil displacement information and pupil deflection angle information; the wakefulness state evaluation device is also configured to update the wakefulness state of the target detection object based on the eye movement change information.
可选地,所述觉醒状态检测系统还包括靶点调控模块。相应地,所述觉醒状态检测方法还可以包括:通过所述靶点调控模块,通过在体光遗传学技术对目标神经元靶点的活动状态进行调控。Optionally, the wakefulness state detection system further includes a target regulation module. Accordingly, the wakefulness state detection method may further include: regulating the activity state of the target neuron target through in vivo optogenetics technology by means of the target regulation module.
图4示出了可以用来实施本申请的实施例的电子设备10的结构示意图。电子设备旨在表示多种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示多种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备(如头盔、眼镜、手表等)和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本申请的实现。Fig. 4 shows a block diagram of an electronic device 10 that can be used to implement an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and/or required herein.
如图4所示,电子设备10包括至少一个处理器11,以及与至少一个处理器11通信连接的存储器,如只读存储器(Read-Only Memory,ROM)12、随机访问存储器(Random Access Memory,RAM)13等,其中,存储器存储有可被至少一个处理器执行的计算机程序,处理器11可以根据存储在ROM 12中的计算机程序或者从存储单元18加载到RAM 13中的计算机程序,来执行多种适当的动作和处理。在RAM 13中,还可存储电子设备10操作所需的多种程序和数据。处理器11、ROM 12以及RAM 13通过总线14彼此相连。输入/输出(Input/Output,I/O)接口15也连接至总线14。As shown in FIG. 4 , the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform a variety of appropriate actions and processes according to the computer program stored in the ROM 12 or the computer program loaded from the storage unit 18 to the RAM 13. In the RAM 13, a variety of programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input/output (I/O) interface 15 is also connected to the bus 14.
电子设备10中的多个部件连接至I/O接口15,包括:输入单元16,例如键盘、鼠标等;输出单元17,例如多种类型的显示器、扬声器等;存储单元18,例如磁盘、光盘等;以及通信单元19,例如网卡、调制解调器、无线通信收发机等。通信单元19允许电子设备10通过诸如因特网的计算机网络和/或多种电信网络与其他设备交换信息/数据。A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
处理器11可以是多种具有处理和计算能力的通用和/或专用处理组件。处理器11的一些示例包括但不限于中央处理单元(Central Processing Unit,CPU)、图形处理单元(Graphics Processing Unit,GPU)、多种专用的人工智能(Artificial Intelligence,AI)计算芯片、多种运行机器学习模型算法的处理器、数字信号处理器(Digital Signal Processor,DSP)、以及任何适当的处理器、控制器、微控 制器等。处理器11执行上文所描述的多个方法和处理,例如觉醒状态检测方法。The processor 11 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), a variety of dedicated artificial intelligence (AI) computing chips, a variety of processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the multiple methods and processes described above, such as the wakefulness state detection method.
在一些实施例中,觉醒状态检测方法可被实现为计算机程序,其被有形地包含于计算机可读存储介质,例如存储单元18。在一些实施例中,计算机程序的部分或者全部可以经由ROM 12和/或通信单元19而被载入和/或安装到电子设备10上。当计算机程序加载到RAM 13并由处理器11执行时,可以执行上文描述的觉醒状态检测方法的一个或多个步骤。可选地,在其他实施例中,处理器11可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行觉醒状态检测方法。In some embodiments, the wakefulness state detection method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed on the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the wakefulness state detection method described above may be performed. Optionally, in other embodiments, the processor 11 may be configured to perform the wakefulness state detection method in any other appropriate manner (e.g., by means of firmware).
本文中以上描述的系统和技术的多种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(Field Programmable Gata Array,FPGA)、专用集成电路(Application Specific Integrated Circuit,ASIC)、专用标准产品(Application Specific Standard Parts,ASSP)、芯片上系统的系统(System on Chip,SOC)、负杂可编程逻辑设备(Complex Programmable Logic Device,CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、至少一个输入装置、和至少一个输出装置。Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard parts (ASSPs), system on chip systems (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These embodiments can include: being implemented in one or more computer programs that can be executed and/or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, at least one input device, and at least one output device.
用于实施本申请的方法的计算机程序可以采用一个或多个编程语言的任何组合来编写。这些计算机程序可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器,使得计算机程序当由处理器执行时使流程图和/或框图中所规定的功能/操作被实施。计算机程序可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions/operations specified in the flow chart and/or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
在本申请的上下文中,计算机可读存储介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的计算机程序。计算机可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。可选地,计算机可读存储介质可以是机器可读信号介质。机器可读存储介质的示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、RAM、ROM、可擦除可编程只读存储器(Erasable Programmable Read-Only Memory,EPROM)或快闪存储器、光纤、便捷式紧凑盘只读存储器(Compact Disc Read-Only Memory,CD-ROM)、光学储存设备、磁储存设备、或上述内 容的任何合适组合。In the context of the present application, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device, or apparatus. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. Examples of machine readable storage media may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a RAM, a ROM, an Erasable Programmable Read-Only Memory (EPROM) or flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
为了提供与用户的交互,可以在电子设备上实施此处描述的系统和技术,该电子设备具有:用于向用户显示信息的显示装置(例如,阴极射线管(Cathode Ray Tube,CRT)或者液晶显示器(Liquid Crystal Display,LCD)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给电子设备。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(Local Area Network,LAN)、广域网(Wide Area Network,WAN)、区块链网络和互联网。The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN), blockchain network, and the Internet.
计算系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,又称为云计算服务器或云主机,是云计算服务体系中的一项主机产品,以解决传统物理主机与虚拟专用服务器(Virtual Private Server,VPS)服务中,存在的管理难度大,业务扩展性弱的缺陷。A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and virtual private servers (VPS) services.
应该理解,可以使用上面所示的多种形式的流程,重新排序、增加或删除步骤。例如,本申请中记载的多个步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本申请的技术方案所期望的结果,本文在此不进行限制。It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the multiple steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution of this application can be achieved, and this document is not limited here.

Claims (11)

  1. 一种觉醒状态检测系统,包括:生理指标检测装置、身体姿态检测装置、运动能力检测装置、刺激响应检测装置、行为模式检测装置、情绪反应检测装置和觉醒状态评价装置;其中,A wakefulness state detection system includes: a physiological index detection device, a body posture detection device, a motor ability detection device, a stimulus response detection device, a behavior pattern detection device, an emotional response detection device and an wakefulness state evaluation device; wherein,
    所述生理指标检测装置,设置为采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给所述觉醒状态评价装置;The physiological index detection device is configured to collect a target physiological index of a target detection object, generate a physiological detection result corresponding to the target physiological index, and send the physiological detection result to the wakefulness state evaluation device;
    所述身体姿态检测装置,设置为对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置;The body posture detection device is configured to detect the body posture of the target detection object, generate a posture detection result corresponding to the body posture, and send the posture detection result to the wakefulness state evaluation device;
    所述运动能力检测装置,设置为对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置;The motor ability detection device is configured to detect the motor information of the target detection object, generate a motor ability detection result corresponding to the motor information, and send the motor ability detection result to the wakefulness state evaluation device;
    所述情绪反应检测装置,设置为对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置;The emotional response detection device is configured to detect emotional information of the target detection object, generate an emotional response detection result corresponding to the emotional information, and send the emotional response detection result to the wakefulness state evaluation device;
    所述刺激响应检测装置,设置为基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号;The stimulus response detection device is configured to generate a stimulus response detection result corresponding to the target stimulus signal based on the response information of the target detection object to the target stimulus signal, and send the stimulus response detection result to the wakefulness state evaluation device, wherein the target stimulus signal includes a harmful stimulus signal;
    所述行为模式检测装置,设置为对所述目标检测对象的行为结构和切换模式进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置;The behavior pattern detection device is configured to detect the behavior structure and switching pattern of the target detection object, generate a behavior pattern detection result corresponding to the behavior phenotype, and send the behavior pattern detection result to the wakefulness state evaluation device;
    所述觉醒状态评价装置,设置为基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述情绪反应检测结果和所述行为模式检测结果来确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。The wakefulness state evaluation device is configured to determine the wakefulness state of the target detection object based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the emotional reaction detection results and the behavioral pattern detection results, and display the wakefulness state.
  2. 根据权利要求1所述的觉醒状态检测系统,其中,所述身体姿态检测装置包括视频采集模块和姿态分析模块,其中,The wakefulness state detection system according to claim 1, wherein the body posture detection device comprises a video acquisition module and a posture analysis module, wherein:
    所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的视频信息,并将所述视频信息发送给所述姿态分析模块;The video acquisition module is configured to collect video information of the target detection object in a free activity state or in a state of external stimulation, and send the video information to the posture analysis module;
    所述姿态分析模块,设置为通过所述视频信息和预设的人工智能算法对所述目标检测对象的姿态进行识别,以得到所述目标检测对象的姿态检测结果, 并将所述姿态检测结果发送给所述觉醒状态评价装置,其中,所述姿态检测结果包括骨架形态信息和身体高度信息中的至少之一。The posture analysis module is configured to identify the posture of the target detection object through the video information and a preset artificial intelligence algorithm to obtain a posture detection result of the target detection object, and send the posture detection result to the wakefulness state evaluation device, wherein the posture detection result includes at least one of skeleton morphology information and body height information.
  3. 根据权利要求1所述的觉醒状态检测系统,其中,所述运动能力检测装置包括视频采集模块和运动分析模块,其中,The wakefulness state detection system according to claim 1, wherein the motion ability detection device comprises a video acquisition module and a motion analysis module, wherein:
    所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给所述运动分析模块;The video acquisition module is configured to acquire a behavior video of the target detection object in a free activity or external stimulation state, and send the behavior video to the motion analysis module;
    所述运动分析模块,设置为通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的运动状态进行分析,以得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置,其中,所述运动能力检测结果包括身体偏转角度信息、运动距离信息以及运动速度信息中的至少一种。The motion analysis module is configured to analyze the motion state of the target detection object in different states through the behavior video and a preset artificial intelligence algorithm to obtain the motion ability detection result of the target detection object, and send the motion ability detection result to the wakefulness state evaluation device, wherein the motion ability detection result includes at least one of body deflection angle information, motion distance information and motion speed information.
  4. 根据权利要求3所述的觉醒状态检测系统,其中,所述运动能力检测装置包括运动检测模块和运动分析模块,所述运动检测模块包括肌电信号采集模块、实验跑台测试模块和转棒仪测试模块中的至少一个,其中,According to the wakefulness state detection system of claim 3, the motor ability detection device comprises a motion detection module and a motion analysis module, the motion detection module comprises at least one of an electromyographic signal acquisition module, an experimental treadmill test module and a rotarod test module, wherein:
    所述肌电信号采集模块,设置为采集所述目标检测对象的肌电信号,将所述肌电信号作为第一运动检测信号,并将所述第一运动检测信号发送给所述运动分析模块;The electromyographic signal acquisition module is configured to acquire the electromyographic signal of the target detection object, use the electromyographic signal as the first motion detection signal, and send the first motion detection signal to the motion analysis module;
    所述实验跑台测试模块,设置为对所述目标检测对象进行跑步测试,并将跑步测试数据作为第二运动检测信号,并将所述第二运动检测信号发送给所述运动分析模块;The experimental treadmill test module is configured to perform a running test on the target detection object, and use the running test data as a second motion detection signal, and send the second motion detection signal to the motion analysis module;
    所述转棒仪测试模块,设置为对所述目标检测对象进行测试,将转棒仪测试数据作为第三运动检测信号,并将所述第三运动检测信号发送给所述运动分析模块;The rotarod test module is configured to test the target detection object, use the rotarod test data as the third motion detection signal, and send the third motion detection signal to the motion analysis module;
    所述运动分析模块,设置为对接收到的运动检测信号进行分析,得到所述目标检测对象的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置,其中,所述运动检测信号包括所述第一运动检测信号、第二运动检测信号以及第三运动检测信号中的至少一种,所述运动能力检测结果包括所述目标检测对象的肌肉力量指标、耐力指标、协调性指标以及平衡力指标中的至少一种。The motion analysis module is configured to analyze the received motion detection signal, obtain the motion ability detection result of the target detection object, and send the motion ability detection result to the wakefulness state evaluation device, wherein the motion detection signal includes at least one of the first motion detection signal, the second motion detection signal and the third motion detection signal, and the motion ability detection result includes at least one of the muscle strength index, endurance index, coordination index and balance index of the target detection object.
  5. 根据权利要求1所述的觉醒状态检测系统,其中,所述行为模式检测装置包括行为视频采集模块和行为分析模块,其中,According to the wakefulness state detection system of claim 1, wherein the behavior pattern detection device comprises a behavior video acquisition module and a behavior analysis module, wherein:
    所述视频采集模块,设置为采集所述目标检测对象在自由活动或外界刺激状态下的行为视频,并将所述行为视频发送给所述行为分析模块;The video acquisition module is configured to acquire a behavior video of the target detection object in a free activity or external stimulation state, and send the behavior video to the behavior analysis module;
    所述行为分析模块,设置为通过所述行为视频和预设的人工智能算法对所述目标检测对象在不同状态下的行为结果和切换模式进行分析,以得到所述目标检测对象的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置,其中,所述行为模式检测结果包括行为动作种类信息、动作发生频率信息、行为状态转移信息以及行为模式切换信息中的至少一种。The behavior analysis module is configured to analyze the behavior results and switching patterns of the target detection object in different states through the behavior video and a preset artificial intelligence algorithm to obtain the behavior pattern detection result of the target detection object, and send the behavior pattern detection result to the wakefulness state evaluation device, wherein the behavior pattern detection result includes at least one of behavior action type information, action frequency information, behavior state transition information and behavior pattern switching information.
  6. 根据权利要求1所述的觉醒状态检测系统,其中,所述刺激响应检测装置包括刺激单元、响应信息采集单元和响应结果检测单元,其中,The wakefulness state detection system according to claim 1, wherein the stimulus response detection device comprises a stimulation unit, a response information acquisition unit and a response result detection unit, wherein:
    所述刺激单元,设置为响应于刺激触发指令,生成目标刺激信号,将所述目标刺激信号作用于所述目标刺激对象,其中,所述目标刺激信号包括视觉刺激信号、嗅觉刺激信号、痛觉刺激信号和听觉刺激信号中的至少一种;The stimulation unit is configured to generate a target stimulation signal in response to a stimulation trigger instruction, and apply the target stimulation signal to the target stimulation object, wherein the target stimulation signal includes at least one of a visual stimulation signal, an olfactory stimulation signal, a pain stimulation signal, and an auditory stimulation signal;
    所述响应信息采集单元,设置为采集所述目标检测对象响应所述目标刺激信号的响应信息,并将所述响应信息发送给所述响应结果检测单元;The response information acquisition unit is configured to acquire response information of the target detection object in response to the target stimulation signal, and send the response information to the response result detection unit;
    所述响应结果检测单元,设置为根据所述响应信息生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置。The response result detection unit is configured to generate a stimulation response detection result corresponding to the target stimulation signal according to the response information, and send the stimulation response detection result to the wakefulness state evaluation device.
  7. 根据权利要求1所述的觉醒状态检测系统,还包括:脑电信号检测装置,其中,The wakefulness state detection system according to claim 1 further comprises: an electroencephalogram signal detection device, wherein:
    所述脑电信号检测装置,设置为对所述目标检测对象的脑电信号进行检测,生成与所述脑电信号对应的脑电检测结果,并将所述脑电检测结果发送给所述觉醒状态评价装置;The EEG signal detection device is configured to detect the EEG signal of the target detection object, generate an EEG detection result corresponding to the EEG signal, and send the EEG detection result to the wakefulness state evaluation device;
    所述觉醒状态评价装置,还设置为基于所述脑电检测结果更新所述目标检测对象的所述觉醒状态。The wakefulness state evaluation device is further configured to update the wakefulness state of the target detection object based on the EEG detection result.
  8. 根据权利要求7所述的觉醒状态检测系统,其中,所述脑电信号检测装置包括脑电信号采集模块、神经元信号采集模块和脑电检测模块,其中,According to the wakefulness state detection system of claim 7, the EEG signal detection device comprises an EEG signal acquisition module, a neuron signal acquisition module and an EEG detection module, wherein:
    所述脑电信号采集模块,设置为采集所述目标检测对象的皮层脑电信号,将所述皮层脑电信号发送给所述脑电检测模块;The EEG signal acquisition module is configured to acquire the cortical EEG signal of the target detection object and send the cortical EEG signal to the EEG detection module;
    所述神经元信号采集模块,设置为获取所述目标检测对象的皮层下脑区的神经活动信息及活性变化信息,将所述神经活动信息及所述活性变化信息发送给所述脑电检测模块,其中,所述神经元信号采集模块包括钙离子光纤记录单元和双光子活体钙成像单元中的至少之一;The neuron signal acquisition module is configured to obtain the neural activity information and activity change information of the subcortical brain area of the target detection object, and send the neural activity information and the activity change information to the EEG detection module, wherein the neuron signal acquisition module includes at least one of a calcium ion optical fiber recording unit and a two-photon in vivo calcium imaging unit;
    所述脑电检测模块,设置为基于所述皮层脑电信号、所述皮层下脑区的神经活动信息以及活性变化信息分析出所述皮层脑电信号在预设波段内的波段特 征,将所述波段特征作为与所述皮层脑电信号对应的脑电检测结果,将所述脑电检测结果发送给所述觉醒状态评价装置,其中,所述波段特征包括幅度、频率、能值和以及神经活动的变化信息中的至少一项。The EEG detection module is configured to analyze the band characteristics of the cortical EEG signal within a preset band based on the cortical EEG signal, the neural activity information of the subcortical brain area, and the activity change information, and use the band characteristics as the EEG detection results corresponding to the cortical EEG signal, and send the EEG detection results to the wakefulness state evaluation device, wherein the band characteristics include at least one of amplitude, frequency, energy value, and neural activity change information.
  9. 根据权利要求1所述的觉醒状态检测系统,还包括:眼动追踪装置,其中,The wakefulness state detection system according to claim 1, further comprising: an eye tracking device, wherein:
    所述眼动追踪装置,设置为获取所述目标检测对象在自由活动或接收外界刺激的状态下的眼动变化信息,将所述眼动变化信息发送至所述觉醒状态评价装置;其中,所述眼动变化信息包括瞳孔直径变化信息、瞳孔位移信息及瞳孔偏转角度信息中的至少一种;The eye tracking device is configured to obtain eye movement change information of the target detection object when the target detection object is in a free movement state or receiving external stimulation, and send the eye movement change information to the wakefulness state evaluation device; wherein the eye movement change information includes at least one of pupil diameter change information, pupil displacement information and pupil deflection angle information;
    所述觉醒状态评价装置,还设置为基于所述眼动变化信息更新所述目标检测对象的所述觉醒状态。The wakefulness state evaluation device is further configured to update the wakefulness state of the target detection object based on the eye movement change information.
  10. 根据权利要求1所述的觉醒状态检测系统,还包括:靶点调控模块,其中,The wakefulness state detection system according to claim 1 further comprises: a target control module, wherein:
    所述靶点调控模块,设置为通过在体光遗传学技术对目标神经元靶点的活动状态进行调控。The target regulation module is configured to regulate the activity state of the target neuron target through in vivo optogenetics technology.
  11. 一种觉醒状态检测方法,应用于觉醒状态检测系统,所述觉醒状态检测系统包括生理指标检测装置、身体姿态检测装置、运动能力检测装置、行为模式检测装置、刺激响应检测装置、情绪反应检测装置和觉醒状态评价装置;其中,所述觉醒状态检测方法包括:A method for detecting a state of wakefulness is applied to a system for detecting a state of wakefulness, wherein the system comprises a physiological index detection device, a body posture detection device, a motor ability detection device, a behavior pattern detection device, a stimulus response detection device, an emotional response detection device, and a state of wakefulness evaluation device; wherein the method for detecting a state of wakefulness comprises:
    通过所述生理指标检测装置,采集目标检测对象的目标生理指标,并生成与所述目标生理指标对应的生理检测结果,并将所述生理检测结果发送给所述觉醒状态评价装置;The target physiological index of the target detection object is collected through the physiological index detection device, and a physiological detection result corresponding to the target physiological index is generated, and the physiological detection result is sent to the wakefulness state evaluation device;
    通过所述身体姿态检测装置,对所述目标检测对象的身体姿态进行检测,生成与所述身体姿态对应的姿态检测结果,并将所述姿态检测结果发送给所述觉醒状态评价装置;The body posture of the target detection object is detected by the body posture detection device, a posture detection result corresponding to the body posture is generated, and the posture detection result is sent to the wakefulness state evaluation device;
    通过所述运动能力检测装置,对所述目标检测对象的运动信息进行检测,生成与所述运动信息对应的运动能力检测结果,并将所述运动能力检测结果发送给所述觉醒状态评价装置;The motion information of the target detection object is detected by the motion ability detection device, a motion ability detection result corresponding to the motion information is generated, and the motion ability detection result is sent to the wakefulness state evaluation device;
    通过所述情绪反应检测装置,对所述目标检测对象的情绪信息进行检测,生成与所述情绪信息对应的情绪反应检测结果,并将所述情绪反应检测结果发送给所述觉醒状态评价装置;The emotional response detection device detects emotional information of the target detection object, generates an emotional response detection result corresponding to the emotional information, and sends the emotional response detection result to the wakefulness state evaluation device;
    通过所述行为模式检测装置,对所述目标检测对象的行为结构和切换模式 进行检测,生成与行为表型对应的行为模式检测结果,并将所述行为模式检测结果发送给所述觉醒状态评价装置;The behavior pattern detection device detects the behavior structure and switching pattern of the target detection object, generates a behavior pattern detection result corresponding to the behavior phenotype, and sends the behavior pattern detection result to the wakefulness state evaluation device;
    通过所述刺激响应检测装置,基于所述目标检测对象对目标刺激信号的响应信息,生成与所述目标刺激信号对应的刺激响应检测结果,并将所述刺激响应检测结果发送给所述觉醒状态评价装置,其中,所述目标刺激信号包括伤害性刺激信号;By means of the stimulus response detection device, based on the response information of the target detection object to the target stimulus signal, a stimulus response detection result corresponding to the target stimulus signal is generated, and the stimulus response detection result is sent to the wakefulness state evaluation device, wherein the target stimulus signal includes a harmful stimulus signal;
    通过所述觉醒状态评价装置,基于接收到的所述生理检测结果、所述姿态检测结果、所述运动能力检测结果、所述刺激响应检测结果、所述行为模式检测结果和所述情绪反应检测结果确定所述目标检测对象的觉醒状态,并展示所述觉醒状态。Through the wakefulness state evaluation device, the wakefulness state of the target detection object is determined based on the received physiological detection results, the posture detection results, the motor ability detection results, the stimulus response detection results, the behavior pattern detection results and the emotional reaction detection results, and the wakefulness state is displayed.
PCT/CN2022/137869 2022-11-25 2022-12-09 System and method for wakeful state detection WO2024108669A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211493320.6A CN115804590A (en) 2022-11-25 2022-11-25 Wakefulness detection system and method
CN202211493320.6 2022-11-25

Publications (1)

Publication Number Publication Date
WO2024108669A1 true WO2024108669A1 (en) 2024-05-30

Family

ID=85484232

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/137869 WO2024108669A1 (en) 2022-11-25 2022-12-09 System and method for wakeful state detection

Country Status (2)

Country Link
CN (1) CN115804590A (en)
WO (1) WO2024108669A1 (en)

Also Published As

Publication number Publication date
CN115804590A (en) 2023-03-17

Similar Documents

Publication Publication Date Title
Giannakakis et al. Review on psychological stress detection using biosignals
Bulagang et al. A review of recent approaches for emotion classification using electrocardiography and electrodermography signals
Sharma et al. Objective measures, sensors and computational techniques for stress recognition and classification: A survey
Ferreira et al. Assessing real-time cognitive load based on psycho-physiological measures for younger and older adults
TWI589274B (en) Virtual reality system for psychological clinical application
JP2015054240A (en) Content evaluation system and content evaluation method using the same
Ganapathy et al. Emotion recognition using electrodermal activity signals and multiscale deep convolutional neural network
US20160029965A1 (en) Artifact as a feature in neuro diagnostics
KR20150076167A (en) Systems and methods for sensory and cognitive profiling
JP2018521830A (en) Method and system for monitoring and improving attention deficits
Sharma et al. Modeling stress recognition in typical virtual environments
Zhang et al. Real-time mental stress detection using multimodality expressions with a deep learning framework
CN104367306A (en) Physiological and psychological career evaluation system and implementation method
CN113974589B (en) Multi-modal behavior paradigm evaluation optimization system and cognitive ability evaluation method
Sharma et al. SzHNN: a novel and scalable deep convolution hybrid neural network framework for schizophrenia detection using multichannel EEG
CN109199411A (en) Case insider's recognition methods based on Model Fusion
Wang et al. Decoding pilot behavior consciousness of EEG, ECG, eye movements via an SVM machine learning model
Zhao et al. Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals
CN115299947A (en) Psychological scale confidence evaluation method and system based on multi-modal physiological data
Wang et al. Research on mental load state recognition based on combined information sources
WO2024108669A1 (en) System and method for wakeful state detection
CN110569968A (en) Method and system for evaluating entrepreneurship failure resilience based on electrophysiological signals
Ramakuri et al. Performance analysis of eye-state charecterization through single electrode EEG device for medical application
Zhu et al. Visceral versus verbal: Can we see depression?
CN107480452B (en) Multi-user emotion monitoring method, device, equipment and storage medium