WO2018165901A1 - 一种驾驶员状态的监测装置和监测方法 - Google Patents

一种驾驶员状态的监测装置和监测方法 Download PDF

Info

Publication number
WO2018165901A1
WO2018165901A1 PCT/CN2017/076761 CN2017076761W WO2018165901A1 WO 2018165901 A1 WO2018165901 A1 WO 2018165901A1 CN 2017076761 W CN2017076761 W CN 2017076761W WO 2018165901 A1 WO2018165901 A1 WO 2018165901A1
Authority
WO
WIPO (PCT)
Prior art keywords
driver
monitoring
information
unit
processing unit
Prior art date
Application number
PCT/CN2017/076761
Other languages
English (en)
French (fr)
Inventor
廖建强
Original Assignee
廖建强
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 廖建强 filed Critical 廖建强
Priority to PCT/CN2017/076761 priority Critical patent/WO2018165901A1/zh
Publication of WO2018165901A1 publication Critical patent/WO2018165901A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K28/00—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions
    • B60K28/02—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver
    • B60K28/06—Safety devices for propulsion-unit control, specially adapted for, or arranged in, vehicles, e.g. preventing fuel supply or ignition in the event of potentially dangerous conditions responsive to conditions relating to the driver responsive to incapacity of driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers

Definitions

  • the invention relates to the technical field of driving safety, in particular to a monitoring device and a monitoring method for a driver's state.
  • Fatigue driving refers to the phenomenon that the driver has blurred vision and unresponsiveness due to imbalance of physical and mental functions after continuous driving for a long time. It can be seen that in the process of driving the vehicle, the normality of the driver's physiological and psychological conditions will directly affect the safety of driving.
  • a monitoring unit for monitoring the physiological and psychological state of the driver which is specifically provided with a sensor for pointing to the driver inside the vehicle, which sensor can be derived from the driver's consciousness and based on the physiological parameter change of the driver. The conclusion of the fatigue condition, thereby implementing the operation of the alarm notification based on the conclusion.
  • the technical problem to be solved by the present invention is that the driver state monitoring system in the prior art can only perform simple sound or optical alarms for the physiological or psychological condition of the driver, and cannot be directed to the driver. Physical movements or facial movements take appropriate measures to restore the driver's concentration of attention.
  • an embodiment of the present invention provides a monitoring device for a driver state, where the monitoring device includes a processing unit, a monitoring unit, and a feedback unit, and is characterized by:
  • the monitoring unit is configured to acquire motion information of the driver during driving, and transmit the information to the processing unit;
  • the processing unit is configured to convert the action information into driver state information and transmit the information to the feedback unit;
  • the feedback unit applies an incentive to the driver based on the driver status information
  • the monitoring unit includes an imaging monitoring component and/or a touch monitoring component
  • the imaging monitoring component is configured to capture a facial motion and/or a limb motion of the driver
  • the touch monitoring component is a pressure sensor for detecting a contact condition between the driver's hand and the steering wheel and/or between the sole and the brake;
  • the excitation measure applied by the feedback unit is an directional transmission of an audio signal of an inaudible frequency range.
  • an embodiment of the present invention further provides a method for monitoring a driver status, including:
  • the motion information is obtained by an imaging method and/or a touch sensing method
  • the touch sensing method acquires the action information by detecting a pressure sensing condition between a driver's hand and a steering wheel and/or between a sole and a brake;
  • driver facial offset information and/or limb movement information is obtained based on the motion information, and the driving state information is acquired thereby;
  • the incentive measure is to orient the driver to transmit an audio signal of an inaudible frequency range.
  • the present invention provides a monitoring device and a monitoring method for a driver's state by the above technical solution, which can monitor and analyze the behavioral state of the limbs and faces of the driver during driving, and draw attention to the driver's driving.
  • the conclusion is whether the force is normal, and the corresponding driver feedback scheme is designed according to the conclusion, so as to achieve the driver's attention concentration recovery, so as to improve the safety of driving.
  • FIG. 1 is a schematic structural diagram of a monitoring device for a driver state according to an embodiment of the present invention
  • FIG. 2 is a schematic flow chart of a method for monitoring a driver's state according to an embodiment of the present invention.
  • FIG. 1 is a schematic structural diagram of a monitoring device for a driver state according to an embodiment of the present invention.
  • the monitoring device includes a processing unit, a monitoring unit, and a feedback unit.
  • the processing unit is configured to control the operation of the monitoring unit and the feedback unit, perform calculation processing on the monitoring information of the monitoring unit, and design a corresponding countermeasure solution for the feedback unit to implement.
  • the monitoring unit is for monitoring the limb movement or facial movement of the driver during driving.
  • the monitoring unit has a trigger portion disposed on the driver's seat, the trigger portion is configured to detect a weight applied to the driver's seat, and when the trigger portion detects that the weight exceeds a preset threshold, it monitors the weight
  • the unit sends a start command to implement the operation of the monitoring unit, that is, when the driver sits on the driver's seat, the monitoring unit is turned on and monitors the driver in real time.
  • the monitoring unit may include a camera monitoring portion and/or a touch monitoring portion.
  • the camera monitoring portion captures the driver's face, upper body and hands by the camera device.
  • the camera device may be a monocular camera device or a binocular camera device.
  • the binocular camera device can capture an image with depth of field parallax for the driver, and can facilitate the processing unit to acquire images about different angles of the driver. Dynamic analysis also enables the shooting of a wide range of angles of the driver.
  • the specific working process of the camera device is: the camera device divides the imaging space into a plurality of sub-spaces, and each of the sub-spaces respectively corresponds to a maximum range of motion of the driver's face, the upper body and each part of the hands, so that the camera device can accurately The action of each part.
  • the camera device cyclically acquires an image corresponding to each subspace at a specific frame rate, thereby ensuring that all actions of the driver during driving can be accurately recorded. For example, during a certain period of time, the camera device will align with the subspace in which the face is located, and acquire several frame images of the facial motion, and the camera device will align the next time period adjacent to the camera.
  • the sub-space in which the two hands are located, and acquiring a plurality of frame images about the two-hand motion the camera device sequentially acquires images in all the sub-spaces in this cycle, and finally transmits the acquired images to the processing unit for analysis processing.
  • the processing unit After receiving the image transmitted by the monitoring unit, the processing unit performs corresponding image analysis processing. For example, when the image received by the processing unit is related to the driver's facial motion, the processing unit establishes a coordinate system in the subspace where the face is located, and extracts five parts of the face, the ear, the mouth, the nose, and the eyebrow. The feature information is obtained by acquiring the centroid points of the five parts based on the feature information, thereby simplifying the structure of the five parts in the coordinate system.
  • the initial coordinate position of the centroid point in the coordinate system is determined and stored in the processing unit as a reference value; the processing unit subsequently updates the driving unit about driving
  • the image of the person's face is subjected to the same centroid processing, and the coordinate positions of the centroid points of the five parts in the coordinate system at different times are obtained, and the updated coordinate position is compared with the reference value to obtain a difference operation.
  • the corresponding centroid point coordinate offset value is output.
  • the processing unit compares the smallest offset value among the five centroid point coordinate offset values with the offset threshold range, when the minimum When the offset value exceeds the offset threshold range, the processing unit indicates to the feedback unit that the driver status is abnormal, otherwise the processing unit indicates to the feedback unit that the driver status is normal, and the feedback unit receives the information. The corresponding operation will be performed.
  • the touch monitoring portion detects the contact condition between the driver's hands and the steering wheel and/or between the sole and the brake by means of a sensor.
  • the touch monitoring portion may be a pressure sensor or a capacitive sensor or the like.
  • the pressure sensor can be disposed on both sides of the steering wheel and the tread surface of the brake brake, so that when the driver holds the steering wheel with both hands or the foot brakes the brake, the corresponding pressure sensor A sensing signal is generated that triggers a corresponding level signal and transmits it to the processing unit for analysis calculation.
  • the specific working process of the touch monitoring part is: if the driver leaves the steering wheel when any one hand is driving or the driver's foot leaves the brake brake, the sensing signal generated by the pressure sensor becomes weak, which makes the The sensing signal is insufficient to trigger a high level signal, and the processing unit can only receive a continuous zero level signal from the monitoring unit, and correspondingly the processing unit indicates to the feedback unit that the driver status is abnormal;
  • the driver always grasps the steering wheel while the driver is driving or the driver's foot is always in contact with the brake brake, and the sensing signal generated by the pressure sensor is enhanced, which enables the sensing signal to trigger a high level signal.
  • the processing unit is capable of receiving a continuous high level signal from the monitoring unit, and accordingly the processing unit indicates to the feedback unit information that the driver status is normal.
  • the feedback unit After receiving the information indicated by the processing unit, the feedback unit identifies the corresponding information from the indicated information.
  • the identification code specifically, the information that the processing unit indicates to the feedback unit that the driver status is abnormal includes the identification code “1”, and the processing unit indicates to the feedback unit that the information that the driver status is normal includes the identification code “ 0"; Therefore, the feedback unit applies a corresponding stimulation operation to the driver only after the feedback unit recognizes the feedback information having the identification code "1".
  • the stimulating operation may specifically be an audio signal directed to the driver, the audio signal being different from the alarm sound in the prior art, the audio signal being in the inaudible frequency range of the person, which makes the audio signal not in the vehicle Other passengers caused nuisance.
  • the frequency of the audio signal can be set to a frequency range of 12 Hz to 15 Hz, and the audio signal is transmitted to the driver's single or both ears in a periodic regular tempo direction.
  • the frequency range of 12 Hz to 15 Hz The audio signal can make the person fully awake and highly concentrated by stimulating the driver's brain waves.
  • the monitoring device of the driver state can perform imaging and/or touch form monitoring on the limb motion and/or facial motion of the driver during driving, and can be based on the monitored image. Or data to analyze whether the current driver is in a state of distraction, thereby feeding back a signal about the normal or abnormal state of the driver to the feedback unit, which determines whether to transmit an audio signal to the driver to stimulate the brain wave, To improve the driver's concentration.
  • FIG. 2 is a schematic flowchart of a method for monitoring a driver's state according to an embodiment of the present invention.
  • the monitoring method includes:
  • the monitoring unit may include a camera monitoring portion and/or a touch monitoring portion.
  • the imaging monitoring section photographs the driver's face, upper body, and both hands by the imaging device.
  • the specific working process of the camera device is: the camera device divides the imaging space into a plurality of sub-spaces, and each of the sub-spaces respectively corresponds to a maximum range of motion of the driver's face, the upper body and each part of the hands, so that the camera device can accurately The action of each part.
  • the camera device cyclically acquires an image corresponding to each subspace at a specific frame rate, thereby ensuring that all actions of the driver during driving can be accurately recorded.
  • the touch monitoring portion detects the contact condition between the driver's hands and the steering wheel and/or between the sole and the brake by means of a sensor.
  • the touch monitoring portion can be a pressure sensor
  • the pressure sensor can be disposed on both sides of the steering wheel and the tread surface of the brake brake, so that when the driver grips both hands
  • the corresponding pressure sensor generates a sensing signal.
  • S2 Acquire driving state information about the driver based on the motion information.
  • the imaging device of the imaging monitoring portion transmits the acquired image to the processing unit for analysis processing.
  • the processing unit obtains the initial coordinate position of the centroid point in the coordinate system by performing centroid processing on the driver's facial features, and stores it in the processing unit as a reference value; the processing unit monitors the monitoring
  • the image of the driver's face updated by the unit is subjected to the same centroid processing, and the coordinate positions of the centroid points of the five parts in the coordinate system at different times are obtained, and the updated coordinate position and the reference are obtained.
  • the value is subjected to a difference operation to obtain a corresponding centroid point coordinate offset value.
  • the processing unit indicates to the feedback unit that the driver status is abnormal, otherwise the processing unit indicates to the feedback unit that the driver status is normal.
  • the sensing signal of the touch monitoring portion triggers a corresponding level signal based on the sensing signal and transmits it to the processing unit for analysis and calculation; the specific process is: if the driver leaves the steering wheel or the driver with any hand during driving When the foot of the foot leaves the brake, the sensing signal generated by the pressure sensor becomes weak, which makes the sensing signal insufficient to trigger a high level signal, and the processing unit can only receive continuous from the monitoring unit.
  • the processing unit indicates to the feedback unit that the driver's state is abnormal; if the driver always grasps the steering wheel while the driver is driving or the driver's foot is always in contact with the brake, the pressure sensor generates The sensing signal is enhanced, which enables the sensing signal to trigger a high level signal, at which time the processing unit can receive a continuous high level signal from the monitoring unit, correspondingly the processing unit to the feedback unit Information indicating that the driver's status is normal.
  • S3 Determine whether to apply an incentive to the driver based on the driving state information.
  • the feedback unit identifies a corresponding identification code from the indicated information. Specifically, the processing unit indicates to the feedback unit that the driver status abnormality information includes the identification code. "1", and the information indicating that the driver status is normal to the feedback unit includes the identification code "0"; therefore, the feedback unit is only after the feedback unit recognizes the feedback information having the identification code "1"
  • the corresponding stimulation operation is applied to the driver.
  • the stimulating operation may specifically be an audio signal directed to the driver, the audio signal being different from the alarm sound in the prior art.
  • the audio signal is in the inaudible frequency range of the person, which causes the audio signal to not cause nuisance to other passengers in the vehicle.
  • the frequency of the audio signal can be set to a frequency range of 12 Hz to 15 Hz, and the audio signal is transmitted to the driver's single or both ears in a periodic regular tempo direction.
  • the frequency range of 12 Hz to 15 Hz The audio signal can make the person fully awake and highly concentrated by stimulating the driver's brain waves.
  • the monitoring method of the driver state can convert the action information during the driving process of the driver into the corresponding driving state information, and analyze whether the current driver is distracted according to the driving state information.
  • the state thereby feeding back a signal about the normal or abnormal state of the driver to the feedback unit, which determines whether to transmit an audio signal to the driver to stimulate the brain wave to improve the driver's concentration.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Abstract

一种驾驶员状态的监测装置和监测方法，通过对驾驶员的肢体动作和面部动作进行监测，得出关于驾驶员动作等的相关参数，并且还能够根据关于驾驶员动作等的相关参数来获取关于驾驶员注意力集中程度的相关数据，从而避免驾驶员在驾驶过程中注意力分散而影响行车安全；此外，驾驶员状态的监测装置和监测方法还能依据关于驾驶员注意力集中程度的相关数据来对驾驶员施加相应的刺激方式，以提高驾驶员的注意力集中度。

Description

一种驾驶员状态的监测装置和监测方法 技术领域
本发明涉及行车安全技术领域，尤其涉及一种驾驶员状态的监测装置和监测方法。
背景技术
随着汽车普及化程度越来越高，交通事故的数量也逐渐增多。研究表明，有将近40％的交通事故是由于驾驶员疲劳驾驶造成的，疲劳驾驶已经成为交通事故产生的首要原因。疲劳驾驶是指驾驶员在长时间连续驾驶后，由于生理和心理机能的失衡，导致视力模糊和反应迟钝等现象的出现。可见，在驾驶车辆的过程中，驾驶员的生理和心理状况的正常与否会直接影响行车的安全性。现有技术已经存在用于监测驾驶员生理和心理状态的监控单元，其具体为在车辆内部设置用于指向驾驶员的传感器，该传感器能够基于驾驶员的生理参数变化得出关于驾驶员意识和疲劳状况的结论，从而根据该结论来实施警报通知的操作。
发明内容
针对上述现有技术的缺陷，本发明所要解决的技术问题在于现有技术中的驾驶员状态监测系统只能针对驾驶员的生理或心理状况进行简单的声音或光学警报，而不能针对驾驶员的肢体动作或面部动作来采取相应的措施以使驾驶员恢复相应的注意力集中度。
为了解决上述技术问题，本发明实施例提供一种驾驶员状态的监测装置，所述监控装置包括处理单元、监控单元和反馈单元，其特征在于：
所述监控单元用于获取驾驶员在驾驶过程中的动作信息，并传送给所述处理单元；
所述处理单元用于将所述动作信息转换成驾驶员状态信息，并传送给所述反馈单元；
所述反馈单元基于所述驾驶员状态信息对驾驶员施加激励措施；
进一步，所述监控单元包括摄像监测部件和/或触摸监测部件；
进一步，所述摄像监测部件用于拍摄驾驶员的面部动作和/或肢体动作；
进一步，所述触摸监测部件为压力传感器，其用于检测驾驶员手部与方向盘之间和/或脚掌与刹车制动之间的接触状况；
进一步，所述反馈单元施加的所述激励措施为定向发送不可听频率范围的音频信号。
相应地，本发明实施例还提供一种驾驶员状态的监测方法，包括：
S1：获取驾驶员在驾驶过程中的动作信息；
S2：基于所述动作信息获取关于驾驶员的驾驶状态信息；
S3：基于所述驾驶状态信息来决定是否对驾驶员施加激励措施；
进一步，所述动作信息是通过摄像方式和/或触摸传感方式来获取的；
进一步，所述触摸传感方式是通过检测驾驶员手部与方向盘之间和/或脚掌与刹车制动之间的压力传感状况来获取所述动作信息的；
进一步，基于所述动作信息得出驾驶员面部偏移信息和/或肢体移动信息，并以此获取所述驾驶状态信息；
进一步，所述激励措施为向驾驶员定向发送不可听频率范围的音频信号。
本发明通过上述技术方案提供一种驾驶员状态的监测装置和监测方法，该装置和方法能够对驾驶员在驾驶过程中的肢体和面部动作状态进行监测和分析，并得出关于驾驶员驾驶注意力是否正常的结论，并针对该结论设计出相应的驾驶员反馈方案，从而实现驾驶员注意力集中度的恢复，以提高行车的安全性。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明实施例提供的一种驾驶员状态的监测装置的结构示意图；
图2是本发明实施例提供的一种驾驶员状态的监测方法的流程示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
参见图1，为本发明实施例提供的一种驾驶员状态的监测装置的结构示意图，在本发明实施例中，该监测装置包括处理单元、监控单元和反馈单元。该处理单元用于控制该监控单元和该反馈单元的工作，将该监控单元的监控信息进行计算处理以及设计相应的应对方案来供该反馈单元实施。
该监控单元是用于对驾驶员在驾驶过程中的肢体动作或者面部动作进行监控的。具体而言，该监控单元具有设置在驾驶座上的触发部分，该触发部分用于检测施加到该驾驶座上的重量，当该触发部分检测到该重量超过预设阈值时，其向该监控单元发送启动指令以实现该监控单元的工作，即当驾驶员坐到该驾驶座上后，该监控单元就会开启并实时对驾驶员进行监控。该监控单元可包括摄像监测部分和/或触摸监测部分。
其中，该摄像监测部分是通过摄像装置来对驾驶员的面部、上半身和双手进行拍摄的。该摄像装置可为单目摄像装置或双目摄像装置，一般来说，该双目摄像装置能够对驾驶员拍摄具有景深视差的图像，并能够便于该处理单元获取关于驾驶员不同角度的图像以进行动态分析，还能够实现对驾驶员大范围视角的拍摄。该摄像装置的具体工作过程为：摄像装置将其摄像空间划分若干个子空间，该每个子空间分别对应驾驶员面部、上半身和双手每个部位自个最大的活动范围，这样能够使摄像装置精确地该每个部位的动作。该摄像装置以特定的帧速度循环地获取该每个子空间对应的图像，从而保证驾驶员在驾驶过程中的所有动作都能够被准确地记录。比如，在某一时间段内，该摄像装置会对准该面部所在的子空间，并获取关于该面部动作的若干帧图像，而在邻接的下一个时间段内，该摄像装置会对准该双手所在的子空间，并获取关于该双手动作的若干帧图像，该摄像装置以此循环依次获取该所有子空间内的图像，最终将获取的图像传送给该处理单元进行分析处理。
该处理单元接收该监控单元传送的图像后，进行相应的图像分析处理。比如当处理单元接收到的图像是关于驾驶员的面部动作时，该处理单元会在该面部所在的子空间建立坐标系，并提取该面部中眼、耳、口、鼻和眉这五个部位的特征信息，并以该特征信息为基准获取上述五个部位各自的质心点，从而简化上述五个部位在该坐标系中的结构。在得出上述五个部位各自对应的质心点后，确定该质心点在该坐标系中的初始坐标位置并存储在该处理单元中作为基准值；该处理单元对该监控单元后续更新的关于驾驶员面部的图像进行相同的质心点化处理，得出在不同时刻上述五个部位各自的质心点在该坐标系中的坐标位置，并将更新后的坐标位置与该基准值进行差运算以得出相应的质心点坐标偏移值。由于上述五个部位的运动会产生对应的五个质心点坐标偏移值，该处理单元将该五个质心点坐标偏移值中最小的偏移值与偏移阈值范围向比较，当该最小的偏移值超出该偏移阈值范围时，该处理单元向该反馈单元指示驾驶员状态异常的信息，否则该处理单元向该反馈单元指示驾驶员状态正常的信息，该反馈单元接收到该信息后会进行相应的操作。
该触摸监测部分是通过传感器来检测驾驶员双手与方向盘之间和/或脚掌与刹车制动之间的接触状况。该触摸监测部分可以是压力传感器或者电容式传感器等。当该触摸监测部分为压力传感器时，该压力传感器可设置在方向盘的两侧表面和刹车制动的踩踏表面上，这样当驾驶员双手握住方向盘或者脚掌踩踏刹车制动时，对应的压力传感器会产生传感信号，该传感信号触发相应的电平信号并传送到该处理单元上进行分析计算。该触摸监测部分的具体工作过程为：若驾驶员在驾驶过程中任意一只手离开方向盘或者驾驶员的脚掌离开刹车制动时，该压力传感器产生的传感信号就会变弱，这使得该传感信号不足以触发高电平信号，此时该处理单元只能从该监控单元中接收到持续的零电平信号，相应地该处理单元向该反馈单元指示驾驶员状态异常的信息；若驾驶员在驾驶过程中双手始终把握方向盘或者驾驶员的脚掌始终与刹车制动接触，该压力传感器产生的传感信号就会增强，这使得该传感信号能够触发高电平信号，此时该处理单元能够从该监控单元中接收到持续的高电平信号，相应地该处理单元向该反馈单元指示驾驶员状态正常的信息。
该反馈单元接收到该处理单元指示的信息后，从该指示的信息中识别相应 的标识码，具体来说，该处理单元向该反馈单元指示驾驶员状态异常的信息是包括标识码“1”，而该处理单元向该反馈单元指示驾驶员状态正常的信息是包括标识码“0”；因此，只有当该反馈单元识别到具有标识码“1”的反馈信息后，该反馈单元才向驾驶员施加相应的刺激操作。该刺激操作具体可为定向指向该驾驶员的音频信号，该音频信号有别于现有技术中的报警声音，该音频信号处于人的不可听频率范围，这使得该音频信号不会对车辆中的其他乘客造成滋扰。该音频信号的频率可设为处于12Hz至15Hz的频率范围，并且该音频信号是以周期性的规律节拍定向传送到驾驶员的单耳或双耳中，实验证明，该12Hz至15Hz频率范围的音频信号能够通过刺激驾驶员的脑电波来使人使人处于完全清醒和注意力高度集中的状态。
从上述实施例可以看出，该驾驶员状态的监测装置能够通过对驾驶员在驾驶过程中的肢体动作和/或面部动作进行摄像和/或触控形式的监测，并能够根据该监测的图像或者数据来分析当前驾驶员是否处于注意力分散的状态，从而将关于驾驶员状态正常或异常的信号反馈给反馈单元，该反馈单元据此决定是否对驾驶员传送音频信号来刺激其脑电波，以提高驾驶员的注意力集中度。
参见图2，为本发明实施例提供的一种驾驶员状态的监测方法的流程示意图，在本发明实施例中，所述监测方法包括：
S1：获取驾驶员在驾驶过程中的动作信息。
具体而言，当驾驶员坐到驾驶座上时，该驾驶座上的触发部分会向监控单元发送启动指令以实现该监控单元对驾驶员的监控工作。该监控单元可包括摄像监测部分和/或触摸监测部分。该摄像监测部分通过摄像装置来对驾驶员的面部、上半身和双手进行拍摄的。该摄像装置的具体工作过程为：摄像装置将其摄像空间划分若干个子空间，该每个子空间分别对应驾驶员面部、上半身和双手每个部位自个最大的活动范围，这样能够使摄像装置精确地该每个部位的动作。该摄像装置以特定的帧速度循环地获取该每个子空间对应的图像，从而保证驾驶员在驾驶过程中的所有动作都能够被准确地记录。
该触摸监测部分是通过传感器来检测驾驶员双手与方向盘之间和/或脚掌与刹车制动之间的接触状况。该触摸监测部分可为压力传感器时，该压力传感器可设置在方向盘的两侧表面和刹车制动的踩踏表面上，这样当驾驶员双手握 住方向盘或者脚掌踩踏刹车制动等动作时，对应的压力传感器会产生传感信号。
S2：基于该动作信息获取关于驾驶员的驾驶状态信息。
具体而言，该摄像监测部分的摄像装置将获取的图像传送给处理单元进行分析处理。该处理单元接收到该图像后通过将驾驶员面部五官进行质心点化处理后，获取该质心点在坐标系中的初始坐标位置并存储在该处理单元中作为基准值；该处理单元对该监控单元后续更新的关于驾驶员面部的图像进行相同的质心点化处理，得出在不同时刻上述五个部位各自的质心点在该坐标系中的坐标位置，并将更新后的坐标位置与该基准值进行差运算以得出相应的质心点坐标偏移值。当其中最小的偏移值超出该偏移阈值范围时，该处理单元向该反馈单元指示驾驶员状态异常的信息，否则该处理单元向该反馈单元指示驾驶员状态正常的信息。
该触摸监测部分的传感信号基于该传感信号触发相应的电平信号并传送到该处理单元上进行分析计算；具体过程为：若驾驶员在驾驶过程中任意一只手离开方向盘或者驾驶员的脚掌离开刹车制动时，该压力传感器产生的传感信号就会变弱，这使得该传感信号不足以触发高电平信号，此时该处理单元只能从该监控单元中接收到持续的零电平信号，相应地该处理单元向该反馈单元指示驾驶员状态异常的信息；若驾驶员在驾驶过程中双手始终把握方向盘或者驾驶员的脚掌始终与刹车制动接触，该压力传感器产生的传感信号就会增强，这使得该传感信号能够触发高电平信号，此时该处理单元能够从该监控单元中接收到持续的高电平信号，相应地该处理单元向该反馈单元指示驾驶员状态正常的信息。
S3：基于该驾驶状态信息来决定是否对驾驶员施加激励措施。
具体而言，反馈单元接收到该处理单元指示的信息后，从该指示的信息中识别相应的标识码，具体来说，该处理单元向该反馈单元指示驾驶员状态异常的信息是包括标识码“1”，而该处理单元向该反馈单元指示驾驶员状态正常的信息是包括标识码“0”；因此，只有当该反馈单元识别到具有标识码“1”的反馈信息后，该反馈单元才向驾驶员施加相应的刺激操作。该刺激操作具体可为定向指向该驾驶员的音频信号，该音频信号有别于现有技术中的报警声音， 该音频信号处于人的不可听频率范围，这使得该音频信号不会对车辆中的其他乘客造成滋扰。该音频信号的频率可设为处于12Hz至15Hz的频率范围，并且该音频信号是以周期性的规律节拍定向传送到驾驶员的单耳或双耳中，实验证明，该12Hz至15Hz频率范围的音频信号能够通过刺激驾驶员的脑电波来使人使人处于完全清醒和注意力高度集中的状态。
从上述实施例可以看出，该驾驶员状态的监测方法能够将驾驶员驾驶过程中的动作信息转换成相应的驾驶状态信息，并根据该驾驶状态信息来分析当前驾驶员是否处于注意力分散的状态，从而将关于驾驶员状态正常或异常的信号反馈给反馈单元，该反馈单元据此决定是否对驾驶员传送音频信号来刺激其脑电波，以提高驾驶员的注意力集中度。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
以上所揭露的仅为本发明一种较佳实施例而已，当然不能以此来限定本发明之权利范围，本领域普通技术人员可以理解实现上述实施例的全部或部分流程，并依本发明权利要求所作的等同变化，仍属于发明所涵盖的范围。

Claims (10)

  1. 一种驾驶员状态的监控装置，所述监控装置包括处理单元、监控单元和反馈单元，其特征在于：
    所述监控单元用于获取驾驶员在驾驶过程中的动作信息，并传送给所述处理单元；
    所述处理单元用于将所述动作信息转换成驾驶员状态信息，并传送给所述反馈单元；
    所述反馈单元基于所述驾驶员状态信息对驾驶员施加激励措施。
  2. 根据权利要求1所述的监控装置，其特征在于，所述监控单元包括摄像监测部件和/或触摸监测部件。
  3. 根据权利要求2所述的监控装置，其特征在于，所述摄像监测部件用于拍摄驾驶员的面部动作和/或肢体动作。。
  4. 根据权利要求2所述的监控装置，其特征在于，所述触摸监测部件为压力传感器，其用于检测驾驶员手部与方向盘之间和/或脚掌与刹车制动之间的接触状况。
  5. 根据权利要求1所述的监控装置，其特征在于，所述反馈单元施加的所述激励措施为定向发送不可听频率范围的音频信号。
  6. 一种驾驶员状态的监控方法，其特征在于，包括：
    S1：获取驾驶员在驾驶过程中的动作信息；
    S2：基于所述动作信息获取关于驾驶员的驾驶状态信息；
    S3：基于所述驾驶状态信息来决定是否对驾驶员施加激励措施。
  7. 根据权利要求6所述的监控方法，其特征在于，在所述步骤S1中，所述动作信息是通过摄像方式和/或触摸传感方式来获取的。
  8. 根据权利要求7所述的监控方法，其特征在于，在所述步骤S1中，所述触摸传感方式是通过检测驾驶员手部与方向盘之间和/或脚掌与刹车制动之间的压力传感状况来获取所述动作信息的。
  9. 根据权利要求6所述的监控方法，其特征在于，在所述步骤S2中，基于所述动作信息得出驾驶员面部偏移信息和/或肢体移动信息，并以此获取所述驾驶状态信息。
  10. 根据权利要求6所述的监控方法，其特征在于，在所述步骤S3中，所述激励措施为向驾驶员定向发送不可听频率范围的音频信号。
PCT/CN2017/076761 2017-03-15 2017-03-15 一种驾驶员状态的监测装置和监测方法 WO2018165901A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/076761 WO2018165901A1 (zh) 2017-03-15 2017-03-15 一种驾驶员状态的监测装置和监测方法

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/076761 WO2018165901A1 (zh) 2017-03-15 2017-03-15 一种驾驶员状态的监测装置和监测方法

Publications (1)

Publication Number Publication Date
WO2018165901A1 true WO2018165901A1 (zh) 2018-09-20

Family

ID=63522643

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/076761 WO2018165901A1 (zh) 2017-03-15 2017-03-15 一种驾驶员状态的监测装置和监测方法

Country Status (1)

Country Link
WO (1) WO2018165901A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130162794A1 (en) * 2011-12-26 2013-06-27 Denso Corporation Driver monitoring apparatus
CN103473890A (zh) * 2013-09-12 2013-12-25 合肥工业大学 基于多信息的驾驶员疲劳实时监测系统及监测方法
CN103476622A (zh) * 2011-03-11 2013-12-25 约翰逊控制器汽车电子有限责任公司 用于监测和控制驾驶员警觉性的方法和设备
US20140210978A1 (en) * 2013-01-25 2014-07-31 Toyota Motor Engineering & Manufacturing North America, Inc. Method and apparatus for early detection of dynamic attentive states for providing an inattentive warning
CN104240445A (zh) * 2013-06-24 2014-12-24 孔德利 防疲劳驾驶智能检测仪
CN106462027A (zh) * 2014-06-23 2017-02-22 本田技研工业株式会社 对驾驶员状态进行响应的系统和方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103476622A (zh) * 2011-03-11 2013-12-25 约翰逊控制器汽车电子有限责任公司 用于监测和控制驾驶员警觉性的方法和设备
US20130162794A1 (en) * 2011-12-26 2013-06-27 Denso Corporation Driver monitoring apparatus
US20140210978A1 (en) * 2013-01-25 2014-07-31 Toyota Motor Engineering & Manufacturing North America, Inc. Method and apparatus for early detection of dynamic attentive states for providing an inattentive warning
CN104240445A (zh) * 2013-06-24 2014-12-24 孔德利 防疲劳驾驶智能检测仪
CN103473890A (zh) * 2013-09-12 2013-12-25 合肥工业大学 基于多信息的驾驶员疲劳实时监测系统及监测方法
CN106462027A (zh) * 2014-06-23 2017-02-22 本田技研工业株式会社 对驾驶员状态进行响应的系统和方法

Similar Documents

Publication Publication Date Title
US8369608B2 (en) System and method for detecting drowsy facial expressions of vehicle drivers under changing illumination conditions
US20200334477A1 (en) State estimation apparatus, state estimation method, and state estimation program
JP6273823B2 (ja) 状態推定装置、および状態推定プログラム
EP3588372B1 (en) Controlling an autonomous vehicle based on passenger behavior
CN110155072B (zh) 防晕车方法和防晕车装置
US20130188838A1 (en) Attention detection method based on driver's reflex actions
US10943137B2 (en) Biometric data capturing and analysis
JP2017194772A (ja) 覚醒度判定装置
JP6935774B2 (ja) 推定システム、学習装置、学習方法、推定装置及び推定方法
CN111163687B (zh) 脉波检测装置、车辆装置以及存储介质
WO2014150690A1 (en) Vestibular testing
JP6344747B2 (ja) 演算処理装置及び人の状態推定方法
US10596963B2 (en) Fatigue alarm apparatus and method
JP6344254B2 (ja) 眠気検知装置
US20210316737A1 (en) Driver abnormality determination apparatus, method and computer program
WO2018165901A1 (zh) 一种驾驶员状态的监测装置和监测方法
US9820687B2 (en) Method for determining drowsiness
US10478066B2 (en) System and method for detection of cravings in individuals with addiction
Beukman et al. A multi-sensor system for detection of driver fatigue
CN114041794B (zh) 驾驶状态的监测方法、装置和系统
JP6604266B2 (ja) 眠気検知装置
CN109102883A (zh) 一种信息处理方法及系统
JP6689470B1 (ja) 情報処理装置、プログラム及び情報処理方法
KR101932147B1 (ko) 심전도 신호를 이용한 운전자의 졸음운전 진단 방법 및 장치
JP2021053240A (ja) 眠気又は覚醒レベル評価装置及び評価プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17901012

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17901012

Country of ref document: EP

Kind code of ref document: A1