CN107095670A - Time of driver's reaction Forecasting Methodology - Google Patents

Time of driver's reaction Forecasting Methodology Download PDF

Info

Publication number
CN107095670A
CN107095670A CN201710391410.7A CN201710391410A CN107095670A CN 107095670 A CN107095670 A CN 107095670A CN 201710391410 A CN201710391410 A CN 201710391410A CN 107095670 A CN107095670 A CN 107095670A
Authority
CN
China
Prior art keywords
mrow
msub
driver
layer
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710391410.7A
Other languages
Chinese (zh)
Inventor
张骏
郭孜政
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southwest Jiaotong University
Original Assignee
Southwest Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southwest Jiaotong University filed Critical Southwest Jiaotong University
Priority to CN201710391410.7A priority Critical patent/CN107095670A/en
Publication of CN107095670A publication Critical patent/CN107095670A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/24Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
    • A61B5/316Modalities, i.e. specific diagnostic methods
    • A61B5/369Electroencephalography [EEG]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/162Testing reaction times
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/16Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7203Signal processing specially adapted for physiological signals or for diagnostic purposes for noise prevention, reduction or removal
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/725Details of waveform analysis using specific filters therefor, e.g. Kalman or adaptive filters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235Details of waveform analysis
    • A61B5/7264Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/72Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271Specific aspects of physiological measurement analysis
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2503/00Evaluating a particular growth phase or type of persons or animals
    • A61B2503/20Workers
    • A61B2503/22Motor vehicles operators, e.g. drivers, pilots, captains

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Psychiatry (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physiology (AREA)
  • Psychology (AREA)
  • Educational Technology (AREA)
  • Developmental Disabilities (AREA)
  • Hospice & Palliative Care (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

本发明公开了一种驾驶员反应时间预测方法,该驾驶员反应时间预测方法包括步骤:获取驾驶员的脑电信号;通过小波变换提取经滤波处理后的脑电信号中的脑电特征参数;以驾驶员的脑电特征参数作为输入层,以反应时间作为输出层,构建BP神经网络预测模型。在本发明中,通过小波变换提取脑电特征参数作为客观预测指标,结合BP神经网络方法,构建了一种驾驶员反应时间的预测算法,以便为车载实时驾驶员危险性驾驶状态预警系统的开发与设计提供理论依据。

The invention discloses a method for predicting a driver's reaction time. The method for predicting the driver's reaction time comprises the steps of: acquiring the driver's brain electrical signal; extracting brain electrical characteristic parameters in the filtered brain electrical signal through wavelet transform; Taking the driver's EEG characteristic parameters as the input layer and the reaction time as the output layer, a BP neural network prediction model is constructed. In the present invention, the EEG characteristic parameters are extracted by wavelet transform as an objective predictive index, combined with the BP neural network method, a predictive algorithm of driver reaction time is constructed, so as to provide a real-time driver's dangerous driving state early warning system for the development of the vehicle Provide theoretical basis with design.

Description

驾驶员反应时间预测方法Driver Reaction Time Prediction Method

技术领域technical field

本发明涉及特定人员反应时间测量技术领域,特别涉及一种驾驶员反应时间预测方法。The invention relates to the technical field of measuring the reaction time of a specific person, in particular to a method for predicting the reaction time of a driver.

背景技术Background technique

高铁速度的不断提升对动车组司机的作业能力提出了更高要求,其中动车组司机对突发事件的反应能力是影响驾驶作业安全可靠性的关键因素。The continuous improvement of the speed of high-speed rail puts forward higher requirements on the operating ability of EMU drivers, and the ability of EMU drivers to respond to emergencies is a key factor affecting the safety and reliability of driving operations.

目前国内外就动车组司机(及机动车驾驶员)反应时间预测的相关研究尚不多见,现有研究主要针对反应时间与神经生理信号相关性进行了探讨。Jap等人研究了在模拟环境下机车司机长时间单调驾驶过程中脑电信号与反应时间的相关性,研究结果表明脑电信号中低频波段与反应时间呈现了正相关,而高频波段与反应时间呈现负相关。Darwent等人在真实环境下对机车司机的警觉度进行了监测,结果表明随着驾驶警觉度的下降,对突发事件的反应时间不断延长,同时论证了脑电信号与反应时间存在着了紧密联系。Haga等人设计了一项机车司机对信号灯的反应能力的实验,验证了脑电信号的变化能够直接反映机车司机的反应能力。Lin等人利用脑电信号与驾驶行为绩效(反应时间、车速等)的相关性,对驾驶持续性注意性水平进行了实时监测。At present, there are few related studies on the prediction of reaction time of EMU drivers (and motor vehicle drivers) at home and abroad. The existing research mainly discusses the correlation between reaction time and neurophysiological signals. Jap et al. studied the correlation between EEG signal and reaction time during the long-term monotonous driving of locomotive drivers in a simulated environment. Time is negatively correlated. Darwent et al. monitored the vigilance of locomotive drivers in a real environment, and the results showed that with the decline of driving vigilance, the reaction time to emergencies continued to prolong, and demonstrated that there was a close relationship between EEG signals and reaction time. connect. Haga et al. designed an experiment on the ability of locomotive drivers to respond to signal lights, and verified that changes in EEG signals can directly reflect the ability of locomotive drivers to respond. Lin et al. used the correlation between EEG signals and driving behavior performance (reaction time, vehicle speed, etc.) to monitor the level of continuous attention in driving in real time.

以上研究从不同角度验证了反应时间与神经生理信号具有相关性,但却未能用两者相关性对反应时间进行有效预测。因此如何通过动车组司机的神经生理信号,实现动车组司机对突发事件的反应时间的有效预测,是构建车载实时动车组司机危险性驾驶状态预警系统的关键性技术。The above studies have verified the correlation between reaction time and neurophysiological signals from different perspectives, but the correlation between the two has not been used to effectively predict the reaction time. Therefore, how to realize the effective prediction of the reaction time of EMU drivers to emergencies through the neurophysiological signals of EMU drivers is a key technology for building a real-time warning system for dangerous driving status of EMU drivers.

发明内容Contents of the invention

有鉴于此,本发明旨在提供一种驾驶员反应时间预测方法,即通过小波变换提取脑电特征参数作为客观预测指标,结合BP神经网络方法,构建了一种驾驶员反应时间的预测算法,以便为车载实时驾驶员危险性驾驶状态预警系统的开发与设计提供理论依据。In view of this, the present invention aims to provide a method for predicting the driver's reaction time, that is, extracting the EEG characteristic parameters by wavelet transform as an objective predictive index, and in conjunction with the BP neural network method, a prediction algorithm for the driver's reaction time is constructed, In order to provide a theoretical basis for the development and design of the vehicle-mounted real-time driver's dangerous driving state warning system.

具体而言,本发明的驾驶员反应时间预测方法包括步骤:获取驾驶员的脑电信号;通过小波变换提取经滤波处理后的脑电信号中的脑电特征参数;以驾驶员的脑电特征参数作为输入层,以反应时间作为输出层,构建BP神经网络预测模型。Specifically, the driver's reaction time prediction method of the present invention includes the steps of: obtaining the driver's EEG signal; extracting the EEG characteristic parameters in the filtered EEG signal through wavelet transform; The parameters are used as the input layer, and the response time is used as the output layer to build a BP neural network prediction model.

进一步地,所述滤波处理具体包括:脑电信号以0-35Hz的带宽进行整体滤波处理。Further, the filtering process specifically includes: performing an overall filtering process on the EEG signal with a bandwidth of 0-35 Hz.

进一步地,通过小波变换提取脑电特征参数具体包括:Further, extracting EEG feature parameters through wavelet transform specifically includes:

a、对于经滤波处理后的脑电信号,记为u(n),则其小波变换定义为:a. For the filtered EEG signal, denoted as u(n), its wavelet transform is defined as:

式中,为小波函数;i为频率因子;m为时间平移因子;n为信号时长;In the formula, is the wavelet function; i is the frequency factor; m is the time translation factor; n is the signal duration;

b、小波变换后的信号u(n)进行有限层分解,采用Mallat算法:b. The wavelet-transformed signal u(n) is subjected to finite layer decomposition, using the Mallat algorithm:

式中,AH为近似分量;Ci为不同尺度下的细节分量;H为分解层数;通过上述有限层分解得到θ、α、β3种不同频段的小波系数;In the formula, AH is the approximate component; Ci is the detail component at different scales; H is the number of decomposition layers; through the above finite layer decomposition, the wavelet coefficients of θ, α, and β three different frequency bands are obtained;

c、对上述频段提取小波系数的能量值作为脑电特征参数:c. Extract the energy value of the wavelet coefficient for the above-mentioned frequency band as the EEG feature parameter:

式中,PX为相应频段的能量值;SX(t)为相应频段的小波系数;t为时间;hi为相应频段的幅值;In the formula, P X is the energy value of the corresponding frequency band; S X (t) is the wavelet coefficient of the corresponding frequency band; t is the time; h i is the amplitude of the corresponding frequency band;

d、对q个电极的脑电信号进行处理,相应得到3×q项脑电特征参数。d. Process the EEG signals of q electrodes, and obtain 3×q EEG characteristic parameters accordingly.

进一步地,所述方法还包括:对所得到的脑电特征参数按式进行归一化处理,使脑电特征参数的数值在[0,1]之间,以消除数据中存在的噪声:Further, the method also includes: normalizing the obtained EEG characteristic parameters according to the formula, so that the value of the EEG characteristic parameters is between [0,1], so as to eliminate the noise existing in the data:

式中,ximax与ximin为脑电特征参数xi的最大值与最小值。In the formula, ximax and ximin are the maximum and minimum values of the EEG characteristic parameter xi .

进一步地,构建BP神经网络预测模型具体包括:以驾驶员的脑电特征参数作为输入层,以反应时间预测值作为输出层,构建含1个隐含层的BP神经网络预测模型;其中,输入层节点个数由驾驶员的脑电特征参数个数决定;隐含层节点个数s则由模型训练结果进行择优选取;输出层节点个数为1。Further, constructing the BP neural network prediction model specifically includes: taking the driver's EEG characteristic parameters as the input layer, and taking the predicted value of reaction time as the output layer, constructing a BP neural network prediction model with one hidden layer; wherein, the input The number of layer nodes is determined by the number of EEG characteristic parameters of the driver; the number s of hidden layer nodes is selected according to the model training results; the number of output layer nodes is 1.

进一步地,所述模型中输入层到隐含层、隐含层到输出层之间的连接权值系数及偏置分别为wik,wk1,bik,bk1(i=1,2,...,3×q,k=1,2,...,s),对于输入层的任意节点o至隐含层的任意节点p的输出:Further, the connection weight coefficients and offsets between the input layer to the hidden layer and the hidden layer to the output layer in the model are respectively wi ik , w k1 , b ik , b k1 (i=1,2, ...,3×q,k=1,2,...,s), for the output from any node o in the input layer to any node p in the hidden layer:

yop=f(xiwop+bop)y op =f(x i w op +b op )

式中,f(·)为Sigmoid函数,即In the formula, f(·) is the Sigmoid function, namely

输出层输出结果为:The output layer output result is:

式中,yi为神经网络模型预测结果输出;W1为输入层至隐含层的连接权数系数矩阵;W2为隐含层至输出层的连接权数系数矩阵;xi为驾驶员脑电特征参数;b1为输入层至隐含层的偏置矩阵;b2为隐含层至输出层的偏置矩阵。In the formula, y i is the prediction result output of the neural network model; W 1 is the connection weight coefficient matrix from the input layer to the hidden layer; W 2 is the connection weight coefficient matrix from the hidden layer to the output layer; xi is the driver EEG feature parameters; b 1 is the bias matrix from the input layer to the hidden layer; b 2 is the bias matrix from the hidden layer to the output layer.

进一步地,所述获取驾驶员的脑电信号具体包括:采集预定数目的驾驶员的脑电信号。Further, the acquiring the EEG signals of the drivers specifically includes: acquiring the EEG signals of a predetermined number of drivers.

进一步地,脑电信号采集频率为10Hz;脑电采集仪连续采集驾驶员脑电数据。Further, the EEG signal acquisition frequency is 10 Hz; the EEG acquisition device continuously collects the driver's EEG data.

进一步地,BP神经网络模型所得到的反应时间预测值与实验所采集的反应时间实际值拟合程度的比较选取最大绝对误差M1与相对均方误差M2作为预测效果测评指标:Further, the comparison between the predicted value of the reaction time obtained by the BP neural network model and the actual value of the reaction time collected in the experiment compares the fitting degree and selects the maximum absolute error M1 and the relative mean square error M2 as the evaluation indicators of the prediction effect:

本发明通过小波变换提取脑电特征参数作为客观预测指标,结合BP神经网络方法,构建了一种驾驶员反应时间的预测算法,实现了驾驶员对突发事件反应时间的准确预测,这对车载实时驾驶员危险性驾驶状态预警系统开发与设计提供了理论依据。The present invention uses wavelet transform to extract EEG feature parameters as an objective predictive index, and combines the BP neural network method to construct a predictive algorithm of driver's reaction time, which realizes the accurate prediction of the driver's reaction time to emergencies. The development and design of the real-time driver's dangerous driving state warning system provides a theoretical basis.

附图说明Description of drawings

并入到说明书中并且构成说明书的一部分的附图示出了本发明的实施例,并且与描述一起用于解释本发明的原理。在这些附图中,类似的附图标记用于表示类似的要素。下面描述中的附图是本发明的一些实施例,而不是全部实施例。对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,可以根据这些附图获得其他的附图。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate the embodiments of the invention and together with the description serve to explain the principles of the invention. In the drawings, like reference numerals are used to denote like elements. The drawings in the following description are some, but not all, embodiments of the present invention. Those skilled in the art can obtain other drawings based on these drawings without creative efforts.

图1为本发明实施例提供的驾驶员反应时间预测方法的流程示意图;FIG. 1 is a schematic flow chart of a driver reaction time prediction method provided by an embodiment of the present invention;

图2为本发明实施例中实验任务中刺激点出现位置的示意图;Fig. 2 is a schematic diagram of the location of the stimulus point in the experimental task in the embodiment of the present invention;

图3为本发明实施例中实验任务中探测信号闪现的示意图;Fig. 3 is a schematic diagram of the detection signal flashing in the experimental task in the embodiment of the present invention;

图4为本发明实施例中的BP神经网络模型结构示意图;Fig. 4 is the structural representation of the BP neural network model in the embodiment of the present invention;

图5为本发明实施例中BP神经网络模型预测反应时间与实际反应时间对比示意图;Fig. 5 is the comparison schematic diagram of BP neural network model prediction reaction time and actual reaction time in the embodiment of the present invention;

图6为本发明实施例中BP神经网络模型预测反应时间误差示意图。FIG. 6 is a schematic diagram of a reaction time error predicted by a BP neural network model in an embodiment of the present invention.

具体实施方式detailed description

为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互任意组合。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.

下面结合附图及场景详细说明本发明实施例的驾驶员反应时间预测方法。The method for predicting the driver's reaction time according to the embodiment of the present invention will be described in detail below in conjunction with the drawings and scenes.

参见图1所示,该驾驶员反应时间预测方法的方法包括步骤:获取驾驶员的脑电信号;通过小波变换提取经滤波处理后的脑电信号中的脑电特征参数;以驾驶员的脑电特征参数作为输入层,以反应时间作为输出层,构建BP神经网络预测模型。Referring to Fig. 1, the method of the driver's reaction time prediction method includes the steps of: obtaining the driver's EEG signal; extracting the EEG characteristic parameters in the filtered EEG signal by wavelet transform; The electrical characteristic parameters are used as the input layer, and the response time is used as the output layer to build a BP neural network prediction model.

为了更说明本发明所述方法的优势、原理和效果,下面结合具体实验场景、示例详细阐述。In order to further illustrate the advantages, principles and effects of the method of the present invention, it will be described in detail below in conjunction with specific experimental scenarios and examples.

1实验方法1 Experimental method

1.1被试选取1.1 Selection of subjects

选取20名某个动车组司机班男性学员作为被试。年龄在34-38岁之间,均值为36.1岁,标准差为1.8岁;驾龄在6-11年,均值为7.2年,标准差为1.1年。所选被试睡眠质量良好,身体状况良好,无不良嗜好(吸烟、嗜酒等),无色弱或者色盲,视力或者校正视力为1.0。实验开始前4h禁止被试饮用咖啡或者茶品等刺激性饮料,并在充分了解《知情同意书》前提下自愿签订。Select 20 male trainees of a certain EMU driver class as subjects. Those aged between 34 and 38 had a mean of 36.1 years and a standard deviation of 1.8 years; those with driving experience of 6 to 11 years had a mean of 7.2 years and a standard deviation of 1.1 years. The selected subjects had good sleep quality, good physical condition, no bad habits (smoking, alcoholism, etc.), no color weakness or color blindness, and visual acuity or corrected visual acuity was 1.0. 4 hours before the start of the experiment, the subjects were prohibited from drinking coffee or tea and other irritating beverages, and they voluntarily signed the "Informed Consent Form" after fully understanding it.

1.2实验设备1.2 Experimental equipment

1.2.1动车模拟器1.2.1 EMU Simulator

实验采用具有6自由度运动系统的CRH380型动车模拟器,该模拟器采用单通道大屏前向视景系统,其屏幕分辨率为1920×1200pix,水平视角可达160°。机车主操作台由列车自动防护系统(Automatic Train Protection,ATP),综合专用数字移动通信系统以及DMI显示屏、开关、指示灯、速度设定控制器等组成。模拟器声音环境由7.1数字音频发声系统产生,该系统可高保真模拟仿真动车运行时的背景声音环境。该模拟器的有效性通过了系统性测试,其仿真度可满足实验要求。The experiment uses a CRH380 train simulator with a 6-degree-of-freedom motion system. The simulator uses a single-channel large-screen forward-looking vision system with a screen resolution of 1920×1200pix and a horizontal viewing angle of up to 160 ° . The locomotive main operating console is composed of automatic train protection system (Automatic Train Protection, ATP), integrated dedicated digital mobile communication system, DMI display screen, switch, indicator light, speed setting controller, etc. The sound environment of the simulator is generated by a 7.1 digital audio sound system, which can simulate the background sound environment of the running train with high fidelity. The validity of the simulator has passed the systematic test, and its degree of simulation can meet the experimental requirements.

1.2.2脑电采集仪1.2.2 EEG Acquisition Instrument

实验过程中采用澳大利亚Compumedics公司生产的64导Neuroscan脑电仪实时连续采集被试的脑电信号数据。该脑电仪采用国际脑电图学会通用的10-20系统的电极帽,其电极位置已设定,选取FCz电极作为参考电极。During the experiment, the 64-channel Neuroscan EEG instrument produced by Compumedics in Australia was used to continuously collect the EEG signal data of the subjects in real time. The EEG instrument adopts the electrode cap of the 10-20 system commonly used by the International Electroencephalography Society, the electrode position has been set, and the FCz electrode is selected as the reference electrode.

1.3实验任务1.3 Experimental tasks

实验采用福州至合肥南站线路,线路全长为808km。列车途经22个车站,到站停靠时进行正常停靠站作业。当列车在各区间运行时,采用随机信号检测的方式来实时探测驾驶作业中被试反应时间。在被试驾驶操作过程中,前方屏幕中五个可能的位置将会呈现随机信号(红点)(图2),信号呈现时间为120±10s。当信号在某个位置出现(图3)时,要求被试通过按键方式尽可能快的做出反应。若在信号出现1000ms后,被试未按键则视为此次反应无效。The experiment uses the line from Fuzhou to Hefei South Railway Station, with a total length of 808km. The train passes through 22 stations, and when it arrives at the station, it will perform normal station operations. When the train is running in each section, the random signal detection method is used to detect the reaction time of the subjects in the driving operation in real time. During the test driving operation, five possible positions in the front screen will present random signals (red dots) (Figure 2), and the signal presentation time is 120±10s. When the signal appeared at a certain position (Figure 3), the subjects were required to respond as quickly as possible by pressing the keys. If the subject did not press the button 1000ms after the signal appeared, the response was considered invalid.

1.4实验流程与数据采集1.4 Experimental process and data collection

在实验开始前24h让被试了解实验任务、操作规则,然后按照日常驾驶习惯操作模拟器,直到被试能够熟练操作该模拟器。为了保证被试具有较高的警戒性水平,实验统一安排在上午8:00进行。在正式实验开始之前,为了使被试适应驾驶模拟环境并进入实验状态,给予15min驾驶模拟练习。在正式实验过程中,室内灯光照度为300lx,温度为24±1℃。要求被试以不低于220km/h的速度保持动车运行,驾驶作业时长为2h。24 hours before the start of the experiment, let the subjects understand the experimental tasks and operating rules, and then operate the simulator according to their daily driving habits until the subjects can operate the simulator proficiently. In order to ensure that the subjects had a high level of vigilance, the experiment was uniformly arranged to be conducted at 8:00 am. Before the start of the formal experiment, in order to make the subjects adapt to the driving simulation environment and enter the experimental state, 15 minutes of driving simulation practice was given. During the formal experiment, the indoor light illumination was 300lx, and the temperature was 24±1°C. The subjects were required to keep the train running at a speed of no less than 220km/h, and the driving time was 2 hours.

同步记录被试在驾驶过程中对随机信号刺激的反应时间,数据采集频率为10Hz。同时,脑电采集仪连续采集被试脑电数据。为去除其他信息干扰,记录水平与垂直眼电、肌电。脑电信号采样率设置、采集频率带宽为128Hz、0.5-100Hz,要求所有电极阻抗不得超过5kΩ。Simultaneously record the reaction time of the subjects to random signal stimuli during driving, and the data acquisition frequency is 10Hz. At the same time, the EEG acquisition instrument continuously collects the EEG data of the subjects. In order to remove the interference of other information, the horizontal and vertical oculoelectricity and myoelectricity were recorded. The sampling rate of the EEG signal is set, and the sampling frequency bandwidth is 128Hz, 0.5-100Hz. It is required that the impedance of all electrodes shall not exceed 5kΩ.

2.基于脑电信号的反应时间预测模型2. Reaction time prediction model based on EEG signal

对于上述实验所采集的20名动车组司机的脑电数据,采用小波变换提取经滤波处理后的脑电数据中各项脑电特征参数,结合以脑电特征参数作为输入指标,反应时间作为输出指标的BP神经网络,构建动车组司机对突发事件反应时间预测模型。具体模型构建步骤如下:For the EEG data of 20 EMU drivers collected in the above experiment, the wavelet transform is used to extract the EEG characteristic parameters in the filtered EEG data, combined with the EEG characteristic parameters as the input index, and the reaction time as the output The index BP neural network is used to construct the prediction model of the EMU driver's reaction time to emergencies. The specific model construction steps are as follows:

2.1脑电特征参数提取2.1 Extraction of EEG feature parameters

脑电信号能够反映大脑皮层活动状态,当动车组司机处于低觉醒水平时其脑电频谱分布趋向于低频波段,反之当高觉醒水平时则脑电频谱分布趋向于高频波段。已有研究结果表明脑电信号中θ(4~8Hz),α(8~13Hz),β(13~30Hz)3种频段与反应时间具有高度相关性,可作为反应时间的客观预测指标。因此本发明实施例将通过小波变换提取上述3种频段的小波系数能量值作为脑电特征参数。其计算过程如下:The EEG signal can reflect the activity state of the cerebral cortex. When the EMU driver is at a low level of arousal, the EEG spectrum distribution tends to be in the low frequency band. On the contrary, when the level of arousal is high, the EEG spectrum distribution tends to be in the high frequency band. Existing research results have shown that the three frequency bands of θ (4-8Hz), α (8-13Hz), and β (13-30Hz) in EEG signals are highly correlated with reaction time and can be used as objective predictors of reaction time. Therefore, in the embodiment of the present invention, the wavelet coefficient energy values of the above three frequency bands are extracted by wavelet transform as the EEG feature parameters. Its calculation process is as follows:

⑴对实验采集的脑电信号以0-35Hz的带宽进行整体滤波处理,去除工频电及部分肌电等伪迹成分干扰。(1) The EEG signal collected in the experiment is processed by overall filtering with a bandwidth of 0-35Hz to remove the interference of artifact components such as power frequency electricity and part of myoelectricity.

⑵对于经滤波处理后的脑电信号,记为u(n),则其小波变换定义为:(2) For the filtered EEG signal, denoted as u(n), its wavelet transform is defined as:

式中,为小波函数;i为频率因子;m为时间平移因子;n为信号时长。In the formula, is the wavelet function; i is the frequency factor; m is the time translation factor; n is the signal duration.

⑶为了对小波变换后的信号u(n)进行有限层分解,本发明实施例引入Mallat算法[9],即(3) In order to decompose the wavelet-transformed signal u(n) into finite layers, the embodiment of the present invention introduces the Mallat algorithm [9], namely

式中,AH为近似分量;Ci为不同尺度下的细节分量;H为分解层数,文中取层数为3。因此,可通过上述有限层分解得到θ、α、β3种不同频段的小波系数。In the formula, AH is the approximate component; Ci is the detail component at different scales; H is the number of decomposition layers, and the number of layers is taken as 3 in this paper. Therefore, the wavelet coefficients of θ, α, and β three different frequency bands can be obtained through the above-mentioned finite layer decomposition.

⑷小波系数的能量值能够反映脑电信号的频域特征,因此对上述波段提取相应的能量值作为脑电特征参数。(4) The energy value of the wavelet coefficient can reflect the frequency-domain characteristics of the EEG signal, so the corresponding energy value of the above band is extracted as the EEG characteristic parameter.

式中,PX为相应频段的能量值;SX(t)为相应频段的小波系数;t为时间;hi为相应频段的幅值。In the formula, P X is the energy value of the corresponding frequency band; S X (t) is the wavelet coefficient of the corresponding frequency band; t is the time; h i is the amplitude of the corresponding frequency band.

⑸按照⑴-⑷步骤对q个电极的脑电信号进行处理,则相应得到3×q项脑电特征参数,记为xi(i=1,2,...,3×q)。由于各项脑电特征参数的量纲不同,将脑电特征参数按式⑷进行归一化处理,从而使脑电特征参数的数值在[0,1]之间,以消除数据中存在的噪声。(5) Process the EEG signals of q electrodes according to the steps (1) - (4), and obtain 3×q EEG characteristic parameters correspondingly, denoted as x i (i=1,2,...,3×q). Due to the different dimensions of the EEG characteristic parameters, the EEG characteristic parameters are normalized according to formula (4), so that the value of the EEG characteristic parameters is between [0,1] to eliminate the noise in the data .

式中,ximax与ximin为脑电特征参数xi的最大值与最小值。In the formula, ximax and ximin are the maximum and minimum values of the EEG characteristic parameter xi .

2.2基于BP神经网络的预测模型构建2.2 Construction of prediction model based on BP neural network

以动车组司机的脑电特征参数作为输入层,以反应时间预测值作为输出层,构建含1个隐含层的BP神经网络预测模型。其中输入层节点个数由动车组司机的脑电特征参数个数3×q决定;隐含层节点个数s则由模型训练结果进行择优选取;输出层节点个数为1,其结构示意图如图4所示。Taking EMU driver's EEG feature parameters as input layer and reaction time prediction value as output layer, a BP neural network prediction model with one hidden layer was constructed. Among them, the number of input layer nodes is determined by the EMU driver's EEG characteristic parameter number 3×q; the number of hidden layer nodes s is selected according to the model training results; the number of output layer nodes is 1, and its structure diagram is as follows Figure 4 shows.

设该模型中输入层到隐含层、隐含层到输出层之间的连接权值系数及偏置分别为wik,wk1,bik,bk1(i=1,2,...,3×q,k=1,2,...,s),对于输入层的任意节点o至隐含层的任意节点p的输出:In this model, the connection weight coefficients and offsets between the input layer and the hidden layer and between the hidden layer and the output layer are respectively set as w ik , w k1 , b ik , b k1 (i=1,2,... ,3×q,k=1,2,...,s), for the output from any node o in the input layer to any node p in the hidden layer:

yop=f(xiwop+bop) ⑸y op =f(x i w op +b op ) ⑸

式中,f(·)为Sigmoid函数,即In the formula, f(·) is the Sigmoid function, namely

输出层输出结果为:The output layer output result is:

式中,yi为神经网络的输出,即模型预测结果;W1为输入层至隐含层的连接权数系数矩阵;W2为隐含层至输出层的连接权数系数矩阵;xi为动车组司机脑电特征参数;b1为输入层至隐含层的偏置矩阵;b2为隐含层至输出层的偏置矩阵。In the formula, y i is the output of the neural network, that is, the model prediction result; W 1 is the connection weight coefficient matrix from the input layer to the hidden layer; W 2 is the connection weight coefficient matrix from the hidden layer to the output layer; x i is EMU driver’s EEG characteristic parameter; b 1 is the bias matrix from input layer to hidden layer; b 2 is the bias matrix from hidden layer to output layer.

对于一个动车组司机实验样本Xi=(x1,x2,...xi,...,x3×q;yi),其中yi表示动车组司机第i次按键所得到的反应时间,将其输入神经网络进行训练,该实验样本的网络输出误差定义为:For an EMU driver experimental sample X i =(x 1 ,x 2 ,... xi ,...,x 3×q ; y i ), where y i represents the value obtained by the EMU driver for the ith key press The reaction time is input into the neural network for training, and the network output error of the experimental sample is defined as:

式中,为动车组司机实际反应时间。而对动车组司机所有实验样本的总误差定义为:In the formula, is the actual reaction time of the EMU driver. The total error for all experimental samples of EMU drivers is defined as:

式中,N为实验样本个数。通过误差逆向传播调整连接权数训练神经网络,直到总误差达到最小为止,从而完成神经网络训练。In the formula, N is the number of experimental samples. The neural network is trained by adjusting the connection weights through error backpropagation until the total error reaches the minimum, thus completing the training of the neural network.

2.3预测效果测评指标2.3 Forecasting effect evaluation index

为评价BP神经网络模型所得到的反应时间预测值与实验所采集的反应时间实际值拟合程度的优劣,本发明实施例选取最大绝对误差M1与相对均方误差M2作为预测效果测评指标。In order to evaluate the degree of fit between the predicted value of the reaction time obtained by the BP neural network model and the actual value of the reaction time collected in the experiment, the embodiment of the present invention selects the maximum absolute error M1 and the relative mean square error M2 as the evaluation indicators of the prediction effect.

3有益效果及分析3 Beneficial effects and analysis

对于实验所采集各反应时间内的脑电数据,采用第2.1节的方法均得到经归一化处理后的96项脑电特征参数,将其作为BP神经网络预测模型的输入指标。为了验证脑电特征参数与反应时间具有相关性,本发明实施例采用皮尔逊相关性检验对两者之间相关性进行检验,从而为反应时间预测提供理论前提。For the EEG data collected in each reaction time in the experiment, the method in Section 2.1 was used to obtain 96 EEG characteristic parameters after normalization processing, which were used as the input indicators of the BP neural network prediction model. In order to verify that there is a correlation between the EEG characteristic parameters and the reaction time, the embodiment of the present invention uses the Pearson correlation test to test the correlation between the two, so as to provide a theoretical premise for the prediction of the reaction time.

(1)脑电特征参数与反应时间的相关性分析。将θ、α、β三项脑电特征参数与反应时间进行皮尔逊相关性检验,其结果如表所示。(1) Correlation analysis between EEG characteristic parameters and reaction time. The Pearson correlation test was performed on the three EEG characteristic parameters of θ, α, β and reaction time, and the results are shown in the table.

表1各脑电特征参数与反应时间的相关性Table 1 Correlation between EEG characteristic parameters and reaction time

注:|r|为皮尔逊相关性系数的绝对值,|r|的值的大小反映了两者之间的相关性的强弱。**表示在0.01的显著性水平上相关性极显著;*表示在0.05的显著性水平下相关性显著。Note: |r| is the absolute value of the Pearson correlation coefficient, and the value of |r| reflects the strength of the correlation between the two. ** indicates that the correlation is extremely significant at the 0.01 significance level; * indicates that the correlation is significant at the 0.05 significance level.

从表中可看出,三项脑电特征参数在不同程度上均与反应时间呈现着显著相关性,再次论证了前人研究中脑电信号与反应时间存在着高度相关性。从相关性强弱来看,显然脑电特征参数α与反应时间较其他两项更相关,同时最为显著。It can be seen from the table that the three EEG characteristic parameters have a significant correlation with the reaction time to varying degrees, which once again demonstrates the high correlation between the EEG signal and the reaction time in previous studies. Judging from the strength of the correlation, it is obvious that the EEG characteristic parameter α is more related to the reaction time than the other two items, and at the same time it is the most significant.

此外,已有研究表明大脑皮层的活动变化能够直接反映驾驶精神状态,其脑电信号与驾驶人的精神状态(疲劳、嗜睡等)具有高度相关性。在视觉探测等经典认知心理学试验中得出也论证了脑电信号的变化与反应时间存在着高度相关性,而本研究通过脑电特征参数与反应时间的相关性分析,验证了在实际驾驶任务操作过程中,与动车组司机的反应时间也具有相关性。In addition, existing studies have shown that changes in the activity of the cerebral cortex can directly reflect the driver's mental state, and the EEG signal is highly correlated with the driver's mental state (fatigue, lethargy, etc.). In the classic cognitive psychology experiments such as visual detection, it has also been demonstrated that there is a high correlation between the change of EEG signal and the reaction time. However, this study verified the correlation between the EEG characteristic parameters and the reaction time in practice. During the operation of the driving task, it is also related to the reaction time of the driver of the EMU.

(2)模型输出结果分析。为了确定BP神经网络预测模型的最优网络结构,同时为了体现训练样本的整体性与代表性,本发明实施例对20名动车组司机的实验样本分别随机抽取7个样本,对所得到140个样本作为训练样本,将最终的预测结果所产生的最大绝对误差与相对均方误差作为评价标准。经过多次反复训练之后,确定了最优网络结构为96-20-1(输入层-隐含层-输出层)。结合最优网络结构,对上述140个样本(随机抽取75%的样本作为训练样本,余下作为测试样本)代入模型重新进行训练和测试,其预测结果如图5和图6所示。(2) Analysis of model output results. In order to determine the optimal network structure of the BP neural network prediction model, and in order to reflect the integrity and representativeness of the training samples, the embodiment of the present invention randomly selected 7 samples from the experimental samples of 20 EMU drivers, and compared the obtained 140 samples. The sample is used as a training sample, and the maximum absolute error and relative mean square error generated by the final prediction result are used as evaluation criteria. After several repeated trainings, the optimal network structure was determined to be 96-20-1 (input layer-hidden layer-output layer). Combined with the optimal network structure, the above 140 samples (75% of the samples were randomly selected as training samples and the rest as test samples) were substituted into the model for retraining and testing. The prediction results are shown in Figure 5 and Figure 6.

从图5和图6可看出,模型预测结果与实际结果较为接近,表明该模型预测效果较好。因此对各司机实验样本同样采用随机抽取75%作为训练样本,余下作为测试样本的方法,分别对神经网络模型予以训练与测试,同时为了了解所提模型的精度高低,本发明采用已有的贝叶斯预测模型对反应时间进行预测,所得到的预测结果如表2所示。It can be seen from Figures 5 and 6 that the model prediction results are closer to the actual results, indicating that the model prediction effect is better. Therefore to each driver's experimental sample, 75% are randomly selected as training samples, and the rest are used as test samples to train and test the neural network model respectively. Simultaneously, in order to understand the accuracy of the proposed model, the present invention uses existing The Yesian prediction model predicts the reaction time, and the obtained prediction results are shown in Table 2.

表2各司机在预测模型中所得到的预测结果Table 2 The prediction results obtained by each driver in the prediction model

从总体上来看,采用人工神经网络所得到的结果中最大绝对误差平均值(11.01%)与相对均方误差平均值(8.15%)均高于贝叶斯预测模型(14.6%,10.7%)。同时,对每个司机的反应时间预测结果可看出,采用人工神经网络所得到的最大绝对误差均小于15%,而最大相对均方误差为10.89%,最小相对均方误差为6.93%;而采用贝叶斯预测模型所得的结果中,最大绝对误差在11%至20%之间,而最大相对均方误差为15.36%,最小相对均方误差为8.14%,说明了人工神经网络预测精度高于贝叶斯预测模型。因此本发明实施例所提预测模型具有可靠性,可准确预测动车组司机对突发事件反应时间,从而有效减少事故发生率。On the whole, the maximum absolute error (11.01%) and relative mean square error (8.15%) of the results obtained by artificial neural network are higher than those of Bayesian prediction model (14.6%, 10.7%). At the same time, it can be seen from the prediction results of each driver's reaction time that the maximum absolute error obtained by artificial neural network is less than 15%, while the maximum relative mean square error is 10.89%, and the minimum relative mean square error is 6.93%; In the results obtained by using the Bayesian prediction model, the maximum absolute error is between 11% and 20%, while the maximum relative mean square error is 15.36%, and the minimum relative mean square error is 8.14%, which shows that the prediction accuracy of artificial neural network is high. in Bayesian predictive models. Therefore, the prediction model proposed in the embodiment of the present invention is reliable, and can accurately predict the reaction time of the EMU driver to an emergency, thereby effectively reducing the accident rate.

从上可知,本发明实施例基于2h的动车模拟驾驶实验,就动车组司机对突机事件反应时间的预测进行了研究,其有益成果与结论如下:As can be seen from the above, the embodiment of the present invention is based on the 2h motor car simulation driving experiment, and the prediction of the reaction time of the driver of the motor car unit to the emergency event has been studied, and its beneficial results and conclusions are as follows:

⑴基于动车组司机的脑电信号,采用小波变换提取可用于动车组司机反应水平测评及反应时间预测的θ、α、β3项脑电指标。结合BP神经网络,构建了一种动车组司机反应时间的预测模型。(1) Based on the EEG signals of EMU drivers, wavelet transform is used to extract three EEG indicators, θ, α, and β, which can be used for the evaluation of the EMU driver's reaction level and the prediction of reaction time. Combined with BP neural network, a prediction model for the reaction time of EMU drivers is constructed.

⑵从结果可看出,3项脑电特征参数与反应时间均具有显著相关性,说明脑电信号能够直接反应驾驶人的精神状态,从而为反应时间的预测提供了研究依据。(2) It can be seen from the results that the three EEG characteristic parameters have a significant correlation with the reaction time, indicating that the EEG signal can directly reflect the driver's mental state, thus providing a research basis for the prediction of the reaction time.

⑶最终结果表明,模型预测的司机对随机信号刺激的反应时间与司机实际反应时间的最大绝对误差为11.01%(1.75%),及相对均方误差为8.51%(1.37%),低于其他预测模型,表明该方法具有较高精度。(3) The final results show that the maximum absolute error between the driver's reaction time predicted by the model and the driver's actual reaction time is 11.01% (1.75%), and the relative mean square error is 8.51% (1.37%), which is lower than other predictions model, which shows that the method has high accuracy.

本发明实施例实现了动车组司机对突发事件反应时间的准确预测,该研究成果对车载实时动车组司机危险性驾驶状态预警系统开发与设计提供了理论依据。今后可对该方法在动车实际运行状态下的适用性予以进一步验证研究。The embodiment of the present invention realizes the accurate prediction of the reaction time of the EMU driver to an emergency, and the research results provide a theoretical basis for the development and design of the vehicle-mounted real-time EMU driver's dangerous driving state warning system. In the future, the applicability of this method in the actual running state of the train can be further verified.

本领域普通技术人员可以理解,实现上述实施例的全部或者部分步骤/单元/模块可以通过程序指令相关的硬件来完成,前述程序可以存储于计算机可读取存储介质中,该程序在执行时,执行包括上述实施例各单元中对应的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光碟等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps/units/modules of the above embodiments can be implemented by hardware related to program instructions, and the aforementioned programs can be stored in a computer-readable storage medium. When the program is executed, Execution includes the corresponding steps in the units of the above-mentioned embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

以上所述的具体实施例,对本发明的目的、技术方案和有益效果进行了进一步详细说明,所应理解的是,以上所述仅为本发明的具体实施例而已,并不用于限制本发明,凡在本发明的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The specific embodiments described above have further described the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above descriptions are only specific embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included within the protection scope of the present invention.

Claims (9)

1. a kind of time of driver's reaction Forecasting Methodology, it is characterised in that methods described includes step:
Obtain the EEG signals of driver;
The brain electrical feature parameter in the EEG signals after filtered processing is extracted by wavelet transformation;
Using the brain electrical feature parameter of driver as input layer, using the reaction time as output layer, BP neural network prediction is built Model.
2. time of driver's reaction Forecasting Methodology as claimed in claim 1, it is characterised in that the filtering process is specifically wrapped Include:EEG signals carry out overall filtering process with 0-35Hz bandwidth.
3. time of driver's reaction Forecasting Methodology as claimed in claim 2, it is characterised in that brain electricity is extracted by wavelet transformation Characteristic parameter is specifically included:
A, for the EEG signals after filtered processing, be designated as u (n), then its wavelet transformation is defined as:
In formula,For wavelet function;I is frequency factor;M is the time-shifting factor;N is signal duration;
Signal u (n) after b, wavelet transformation carries out finite layer decomposition, using Mallat algorithms:
<mrow> <mi>u</mi> <mrow> <mo>(</mo> <mi>n</mi> <mo>)</mo> </mrow> <mo>=</mo> <msub> <mi>A</mi> <mi>H</mi> </msub> <mo>+</mo> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>H</mi> </munderover> <msub> <mi>C</mi> <mi>i</mi> </msub> </mrow>
In formula, AH is approximation component;Ci is the details coefficients under different scale;H is Decomposition order;Decomposed by above-mentioned finite layer Obtain the wavelet coefficient of 3 kinds of different frequency ranges of θ, α, β;
C, the energy value to above-mentioned frequency extraction wavelet coefficient are used as brain electrical feature parameter:
<mrow> <msub> <mi>P</mi> <mi>X</mi> </msub> <mo>=</mo> <mfrac> <mn>1</mn> <mi>t</mi> </mfrac> <msup> <mrow> <mo>|</mo> <msub> <mi>S</mi> <mi>X</mi> </msub> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> <mo>|</mo> </mrow> <mn>2</mn> </msup> <mi>d</mi> <mi>t</mi> <mo>=</mo> <mfrac> <mn>1</mn> <mi>n</mi> </mfrac> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>n</mi> </munderover> <msup> <mrow> <mo>|</mo> <msub> <mi>h</mi> <mi>i</mi> </msub> <mo>|</mo> </mrow> <mn>2</mn> </msup> </mrow>
In formula, PXFor the energy value of corresponding band;SX(t) it is the wavelet coefficient of corresponding band;T is the time;hiFor corresponding band Amplitude;
D, the EEG signals to q electrode are handled, and accordingly obtain 3 × q brain electrical feature parameters.
4. time of driver's reaction Forecasting Methodology as claimed in claim 3, it is characterised in that methods described also includes:To institute Obtained brain electrical feature parameter is normalized by formula, makes the numerical value of brain electrical feature parameter between [0,1], to eliminate number The noise present in:
<mrow> <mi>x</mi> <mo>=</mo> <mfrac> <mrow> <msub> <mi>x</mi> <mi>i</mi> </msub> <mo>-</mo> <msub> <mi>x</mi> <mrow> <mi>i</mi> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </mrow> <mrow> <msub> <mi>x</mi> <mrow> <mi>i</mi> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> </msub> <mo>-</mo> <msub> <mi>x</mi> <mrow> <mi>i</mi> <mi>m</mi> <mi>i</mi> <mi>n</mi> </mrow> </msub> </mrow> </mfrac> </mrow>
In formula, xi maxWith xi minFor brain electrical feature parameter xiMaxima and minima.
5. the time of driver's reaction Forecasting Methodology as described in any one of Claims 1-4, it is characterised in that build BP nerves Network Prediction Model is specifically included:Using the brain electrical feature parameter of driver as input layer, using reaction time predicted value as defeated Go out layer, build the BP neural network forecast model containing 1 hidden layer;Wherein, input layer number is special by the brain electricity of driver Levy number of parameters decision;Hidden layer node number s is then preferentially chosen by model training result;Output layer node number is 1.
6. time of driver's reaction Forecasting Methodology as claimed in claim 5, it is characterised in that input layer is to hidden in the model It is respectively w containing layer, hidden layer to the connection weight coefficient between output layer and biasingik,wk1,bik,bk1(i=1,2 ..., 3 × Q, k=1,2 ..., s), for input layer arbitrary node o to hidden layer arbitrary node p output:
yop=f (xiwop+bop)
In formula, f () is Sigmoid functions, i.e.,
<mrow> <mi>f</mi> <mrow> <mo>(</mo> <mi>&amp;sigma;</mi> <mo>)</mo> </mrow> <mo>=</mo> <mfrac> <mn>1</mn> <mrow> <mn>1</mn> <mo>+</mo> <msup> <mi>e</mi> <mrow> <mo>-</mo> <mi>&amp;sigma;</mi> </mrow> </msup> </mrow> </mfrac> </mrow>
Output layer output result is:
<mrow> <msub> <mi>y</mi> <mi>i</mi> </msub> <mo>=</mo> <mi>f</mi> <mrow> <mo>(</mo> <msubsup> <mi>W</mi> <mn>2</mn> <mi>T</mi> </msubsup> <mo>(</mo> <mrow> <mi>f</mi> <mrow> <mo>(</mo> <mrow> <msubsup> <mi>W</mi> <mn>1</mn> <mi>T</mi> </msubsup> <msub> <mi>x</mi> <mi>i</mi> </msub> </mrow> <mo>)</mo> </mrow> <mo>+</mo> <msub> <mi>b</mi> <mn>1</mn> </msub> </mrow> <mo>)</mo> <mo>+</mo> <msub> <mi>b</mi> <mn>2</mn> </msub> <mo>)</mo> </mrow> </mrow>
In formula, yiExported for Neural Network model predictive result;W1For the connection weight number system matrix number of input layer to hidden layer;W2 For the connection weight number system matrix number of hidden layer to output layer;xiFor driver's brain electrical feature parameter;b1For input layer to hidden layer Bias matrix;b2For the bias matrix of hidden layer to output layer.
7. time of driver's reaction Forecasting Methodology as claimed in claim 6, it is characterised in that the brain electricity of the acquisition driver Signal is specifically included:Gather the EEG signals of the driver of predetermined number.
8. time of driver's reaction Forecasting Methodology as claimed in claim 7, it is characterised in that eeg signal acquisition frequency is 10Hz;Electroencephalogramdata data collector continuous acquisition driver's eeg data.
9. time of driver's reaction Forecasting Methodology as claimed in claim 7, it is characterised in that obtained by BP neural network model Comparison of the reaction time predicted value with testing gathered reaction time actual value fitting degree use maximum absolute error M1 Prediction effect assessment indicator is used as with relative mean square error M2:
<mrow> <msub> <mi>M</mi> <mn>1</mn> </msub> <mo>=</mo> <munder> <mrow> <mi>m</mi> <mi>a</mi> <mi>x</mi> </mrow> <mi>i</mi> </munder> <mrow> <mo>|</mo> <mfrac> <mrow> <msub> <mi>y</mi> <mi>i</mi> </msub> <mo>-</mo> <msubsup> <mi>y</mi> <mi>i</mi> <mo>*</mo> </msubsup> </mrow> <msub> <mi>y</mi> <mi>i</mi> </msub> </mfrac> <mo>|</mo> </mrow> <mo>&amp;times;</mo> <mn>100</mn> <mi>%</mi> </mrow>
<mrow> <msub> <mi>M</mi> <mn>2</mn> </msub> <mo>=</mo> <msqrt> <mrow> <mfrac> <mn>1</mn> <mi>N</mi> </mfrac> <munderover> <mo>&amp;Sigma;</mo> <mrow> <mi>i</mi> <mo>=</mo> <mn>1</mn> </mrow> <mi>N</mi> </munderover> <msup> <mrow> <mo>(</mo> <mfrac> <mrow> <msub> <mi>y</mi> <mi>i</mi> </msub> <mo>-</mo> <msubsup> <mi>y</mi> <mi>i</mi> <mo>*</mo> </msubsup> </mrow> <msub> <mi>y</mi> <mi>i</mi> </msub> </mfrac> <mo>)</mo> </mrow> <mn>2</mn> </msup> </mrow> </msqrt> <mo>&amp;times;</mo> <mn>100</mn> <mi>%</mi> <mo>.</mo> </mrow> 2
CN201710391410.7A 2017-05-27 2017-05-27 Time of driver's reaction Forecasting Methodology Pending CN107095670A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710391410.7A CN107095670A (en) 2017-05-27 2017-05-27 Time of driver's reaction Forecasting Methodology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710391410.7A CN107095670A (en) 2017-05-27 2017-05-27 Time of driver's reaction Forecasting Methodology

Publications (1)

Publication Number Publication Date
CN107095670A true CN107095670A (en) 2017-08-29

Family

ID=59660411

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710391410.7A Pending CN107095670A (en) 2017-05-27 2017-05-27 Time of driver's reaction Forecasting Methodology

Country Status (1)

Country Link
CN (1) CN107095670A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107595302A (en) * 2017-09-06 2018-01-19 西安交通大学 A kind of device and method that user's state of mind is monitored using EEG signals
CN108836321A (en) * 2018-05-03 2018-11-20 江苏师范大学 A kind of EEG signals preprocess method based on adaptive noise cancel- ation system
CN108874137A (en) * 2018-06-15 2018-11-23 北京理工大学 A kind of gesture motion based on EEG signals is intended to the universal model of detection
CN109204307A (en) * 2018-10-30 2019-01-15 吉林大学 Obtain method, storage medium and the system of adaptive anticollision early warning distance
CN110313916A (en) * 2019-07-17 2019-10-11 军事科学院系统工程研究院军需工程技术研究所 A kind of patient with diabetic feet plantar pressure characteristic recognition method
CN111803065A (en) * 2020-06-23 2020-10-23 北方工业大学 Dangerous traffic scene identification method and system based on electroencephalogram data
CN112365705A (en) * 2020-08-27 2021-02-12 招商局重庆交通科研设计院有限公司 Method for determining road traffic volume
CN113633296A (en) * 2021-10-15 2021-11-12 西南交通大学 Method, device, device and readable storage medium for constructing reaction time prediction model
CN114081504A (en) * 2021-11-23 2022-02-25 青岛理工大学 Driving intention identification method and system based on electroencephalogram signals
CN114224359A (en) * 2021-12-18 2022-03-25 西南交通大学 Electroencephalogram fatigue index determination method for high-speed rail dispatcher
CN114343661A (en) * 2022-03-07 2022-04-15 西南交通大学 Method, device, device and readable storage medium for estimating response time of high-speed rail driver
CN120304830A (en) * 2025-06-13 2025-07-15 中国民航大学 Prediction and identification method of dispatcher's mental fatigue based on physiological and reaction time indicators

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1253762A (en) * 1999-11-19 2000-05-24 中国科学院上海生理研究所 Full-automatic quantitive detection device of epileptoid discharge in electroencephalogram
CN101221554A (en) * 2008-01-25 2008-07-16 北京工业大学 EEG Feature Extraction Method Based on Wavelet Transform and BP Neural Network
CN101352337A (en) * 2007-12-25 2009-01-28 天津大学 Signal acquisition and feature extraction method of standing up imagination action EEG
CN101690666A (en) * 2009-10-13 2010-04-07 北京工业大学 Driving working load calculation method of automobile driver
CN102254226A (en) * 2011-06-15 2011-11-23 河海大学 Method for identifying human activities based on BP (Back Propagation) neural network in intelligent family environment
CN103431859A (en) * 2012-01-10 2013-12-11 西安交通大学 Experimental method for determining brain load in multitask visual cognition
CN103845052A (en) * 2014-02-20 2014-06-11 清华大学 Human body faint early warning method based on acquired electroencephalogram signals
CN104665849B (en) * 2014-12-11 2017-03-01 西南交通大学 A kind of high ferro dispatcher based on the interaction of many physiological signals multi-model stress detection method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1253762A (en) * 1999-11-19 2000-05-24 中国科学院上海生理研究所 Full-automatic quantitive detection device of epileptoid discharge in electroencephalogram
CN101352337A (en) * 2007-12-25 2009-01-28 天津大学 Signal acquisition and feature extraction method of standing up imagination action EEG
CN101221554A (en) * 2008-01-25 2008-07-16 北京工业大学 EEG Feature Extraction Method Based on Wavelet Transform and BP Neural Network
CN101690666A (en) * 2009-10-13 2010-04-07 北京工业大学 Driving working load calculation method of automobile driver
CN102254226A (en) * 2011-06-15 2011-11-23 河海大学 Method for identifying human activities based on BP (Back Propagation) neural network in intelligent family environment
CN103431859A (en) * 2012-01-10 2013-12-11 西安交通大学 Experimental method for determining brain load in multitask visual cognition
CN103845052A (en) * 2014-02-20 2014-06-11 清华大学 Human body faint early warning method based on acquired electroencephalogram signals
CN104665849B (en) * 2014-12-11 2017-03-01 西南交通大学 A kind of high ferro dispatcher based on the interaction of many physiological signals multi-model stress detection method

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHIN-TENG LIN ET AL: "Wireless and Wearable EEG System for Evaluating Driver Vililance", 《IEEE TRANSACTION ON BIOMEDICAL CIRCUITS AND SYSTEMS》 *
张骏等: "基于SVR模型的驾驶简单反应时间预测方法", 《中国公路学报》 *
林相波: "脑电信号特征分析和特征提取的研究", 《中国优秀硕士学位论文全文数据库》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107595302A (en) * 2017-09-06 2018-01-19 西安交通大学 A kind of device and method that user's state of mind is monitored using EEG signals
CN108836321A (en) * 2018-05-03 2018-11-20 江苏师范大学 A kind of EEG signals preprocess method based on adaptive noise cancel- ation system
CN108874137A (en) * 2018-06-15 2018-11-23 北京理工大学 A kind of gesture motion based on EEG signals is intended to the universal model of detection
CN109204307A (en) * 2018-10-30 2019-01-15 吉林大学 Obtain method, storage medium and the system of adaptive anticollision early warning distance
CN110313916A (en) * 2019-07-17 2019-10-11 军事科学院系统工程研究院军需工程技术研究所 A kind of patient with diabetic feet plantar pressure characteristic recognition method
CN111803065B (en) * 2020-06-23 2023-12-26 北方工业大学 Dangerous traffic scene identification method and system based on electroencephalogram data
CN111803065A (en) * 2020-06-23 2020-10-23 北方工业大学 Dangerous traffic scene identification method and system based on electroencephalogram data
CN112365705A (en) * 2020-08-27 2021-02-12 招商局重庆交通科研设计院有限公司 Method for determining road traffic volume
CN113633296A (en) * 2021-10-15 2021-11-12 西南交通大学 Method, device, device and readable storage medium for constructing reaction time prediction model
CN114081504A (en) * 2021-11-23 2022-02-25 青岛理工大学 Driving intention identification method and system based on electroencephalogram signals
CN114081504B (en) * 2021-11-23 2024-03-01 青岛理工大学 A driving intention recognition method and system based on EEG signals
CN114224359A (en) * 2021-12-18 2022-03-25 西南交通大学 Electroencephalogram fatigue index determination method for high-speed rail dispatcher
CN114343661A (en) * 2022-03-07 2022-04-15 西南交通大学 Method, device, device and readable storage medium for estimating response time of high-speed rail driver
CN114343661B (en) * 2022-03-07 2022-05-27 西南交通大学 Method, device and equipment for estimating reaction time of driver in high-speed rail and readable storage medium
CN120304830A (en) * 2025-06-13 2025-07-15 中国民航大学 Prediction and identification method of dispatcher's mental fatigue based on physiological and reaction time indicators
CN120304830B (en) * 2025-06-13 2025-09-23 中国民航大学 Prediction and identification method of dispatcher's mental fatigue based on physiological and reaction time indicators

Similar Documents

Publication Publication Date Title
CN107095670A (en) Time of driver&#39;s reaction Forecasting Methodology
Zhu et al. Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network
CN101583313B (en) Awakening state judging model generation device, arousal state judging device, and warning device
Gurudath et al. Drowsy driving detection by EEG analysis using wavelet transform and K-means clustering
CN101690666B (en) Driving working load calculation method of automobile driver
CN110604565A (en) Brain health screening method based on portable EEG equipment
Wan et al. On‐road experimental study on driving anger identification model based on physiological features by ROC curve analysis
Bittner et al. Detecting of fatigue states of a car driver
CN106913333A (en) A kind of choosing method of the sensivity feature index of Sustained attention level
Kreuzmair et al. The influence of driver fatigue on take-over performance in highly automated vehicles
Zhou et al. Vigilance detection method for high‐speed rail using wireless wearable EEG collection technology based on low‐rank matrix decomposition
CN113753059A (en) A prediction method of driver&#39;s takeover ability under automatic driving system
CN111685779A (en) Schizophrenia disorder screening method based on portable EEG equipment
CN114088422A (en) Vehicle fault diagnosis method and device and electronic equipment
CN116807478B (en) Method, device and equipment for detecting sleepiness starting state of driver
Zhou et al. Detection of vigilance in L3 autonomous driving based on EEG
Utomo et al. Driver fatigue prediction using different sensor data with deep learning
CN114224359A (en) Electroencephalogram fatigue index determination method for high-speed rail dispatcher
CN119099606A (en) A method for calculating vehicle risk collision time based on expected functional safety
CN119279590A (en) A driving scenario human safety monitoring experimental platform and method
CN114343661B (en) Method, device and equipment for estimating reaction time of driver in high-speed rail and readable storage medium
Zhang et al. Drive Risk Assessment Based on Game Theory Combinatorial Weighting—Unascertained Measure Theory
Mohamed et al. An approach in determining fatigueness and drowsiness detection using EEG
CN116942181A (en) Electroencephalogram signal-based driver road accident emotion recognition method in simulation environment
CN106919779A (en) A kind of Forecasting Methodology of driver to the simple reaction time of time burst

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170829