WO2018163497A1 - Dispositif, procédé et programme d'aide à la vigilance - Google Patents

Dispositif, procédé et programme d'aide à la vigilance Download PDF

Info

Publication number
WO2018163497A1
WO2018163497A1 PCT/JP2017/038550 JP2017038550W WO2018163497A1 WO 2018163497 A1 WO2018163497 A1 WO 2018163497A1 JP 2017038550 W JP2017038550 W JP 2017038550W WO 2018163497 A1 WO2018163497 A1 WO 2018163497A1
Authority
WO
WIPO (PCT)
Prior art keywords
driver
audible sound
output
pulsation
information
Prior art date
Application number
PCT/JP2017/038550
Other languages
English (en)
Japanese (ja)
Inventor
将典 橋崎
崇 池谷
竜洋 平野
Original Assignee
オムロン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オムロン株式会社 filed Critical オムロン株式会社
Publication of WO2018163497A1 publication Critical patent/WO2018163497A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024—Detecting, measuring or recording pulse rate or heart rate
    • A61B5/0245—Detecting, measuring or recording pulse rate or heart rate by using sensing means generating electric signals, i.e. ECG signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
    • A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems

Definitions

  • the present invention relates to a wake-up support device, a method, and a program for promoting a driver's wake-up.
  • the driver of the vehicle is required to be sufficiently awake while driving the vehicle.
  • a vehicle equipped with an automatic driving control device that automatically controls the driving operation of the vehicle has also been proposed.
  • the driving operation is not completely left to the automatic driving control device. Awakening is required.
  • the wake-up support device is basically a device that obtains a driving state of a vehicle, a driver's biological information and video, and gives a stimulus to the driver when necessary based on the information. Examples of the stimulus given to the driver include sound, vibration, light, and scent.
  • Japanese Patent No. 5482644 discloses an example of a wake-up support device that gives a vibration stimulus to the driver by vibrating the driver's seat.
  • Japanese Patent No. 5056067 discloses an example of a wake-up support device that gives a driver a sound stimulus by generating sound from a speaker.
  • Such awakening support devices are currently under development in methods and techniques for detecting driver drowsiness, stimuli given to drivers, and methods of giving stimuli, etc., and awakening support devices with various specifications and configurations Has been proposed.
  • This invention provides a novel awakening support device that promotes awakening of the driver.
  • a first aspect of the present invention is an awakening support device that promotes a driver's awakening.
  • the awakening support device causes the non-audible sound output device to output a non-audible sound based on detection information of a pulsation sensor that detects the pulsation of the driver and further based on a period of the pulsation of the driver.
  • a non-audible sound information output unit that outputs non-audible sound information is provided.
  • a wake-up support device relates to the wake-up support device according to the first aspect, wherein the driver is drowsy based on detection information of a driver state detection sensor that detects the state of the driver. It further includes a driver state determination unit that determines whether or not the event is being held. The non-audible sound information output unit outputs the non-audible sound information when the driver state determination unit determines that the driver is drowsy.
  • a wake-up support device relates to the wake-up support device according to the first or second aspect, wherein the non-audible sound information is derived from the driver's beat to the driver's beat cycle.
  • the non-audible sound is output to the non-audible sound output device for a predetermined period with a shorter time interval.
  • the time interval is greater than half of the driver's pulsation period, and the predetermined period is shorter than the difference between the pulsation period and the time interval.
  • a wake-up support apparatus relates to the wake-up support apparatus according to the third aspect, wherein the non-audible sound information output unit sets the time interval to a pulsation cycle of a driver who has drowsiness.
  • the non-audible sound information is output so as to decrease in a stepwise manner from a corresponding time interval to a time interval corresponding to a driver's pulsation period at awakening.
  • a wake-up support device relates to the wake-up support device according to the first to fourth aspects, wherein the non-audible sound information is different from the non-audible sound output during the previous period. An audible sound is output to the non-audible sound output device.
  • non-audible sound information that causes the non-audible sound output device to output a non-audible sound is output based on the cycle of the driver's beat. For this reason, it is effective in preventing the driver from drowsiness. Further, when the driver is drowsy, the driver's awakening is promoted. According to the second aspect of the present invention, a non-audible sound is output when it is determined that the driver is drowsy. Thereby, the driver's awakening is promoted.
  • a non-audible sound is output prior to the driver's pulsation. For this reason, shortening of a driver's pulsation period is promoted favorably. Thereby, the driver's arousal is favorably promoted.
  • the time interval until the non-audible sound is output from each pulsation is the time interval corresponding to the cycle of the pulsation of the driver who has drowsiness. It is reduced in steps until a time interval corresponding to the person's beat cycle. As a result, the pulsation of the driver is reliably increased, and the driver's arousal level is improved as in the awakening phase.
  • a non-audible sound different from the previously output non-audible sound is output. That is, a non-audible sound that is not monotonous is output. For this reason, it is reduced that a driver
  • FIG. 1 is a diagram showing an overall configuration of an automatic driving control system including a driving support device including an awakening support device according to an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a functional configuration of the awakening support apparatus according to the embodiment of the present invention.
  • FIG. 3 is a flowchart showing the procedure and control contents of a wake-up support by the wake-up support apparatus shown in FIG.
  • FIG. 4 is a time chart of non-audible sound output from the non-audible sound output device according to the embodiment of the present invention.
  • FIG. 1 is a diagram showing an overall configuration of an automatic driving control system according to an embodiment of the present invention.
  • This automatic driving control system is mounted on a vehicle 1 such as a passenger car.
  • the vehicle 1 includes, as basic equipment, a power unit 2 including a power source and a transmission, and a steering device 3 equipped with a steering wheel 3a.
  • a power unit 2 including a power source and a transmission
  • a steering device 3 equipped with a steering wheel 3a.
  • An engine and / or a motor is used as the power source.
  • the vehicle 1 is configured to be able to travel in either the manual operation mode or the automatic operation mode.
  • the manual driving mode is a mode in which the vehicle 1 is driven mainly by a driver's manual driving operation, for example.
  • the manual operation mode includes, for example, an operation mode for driving the vehicle based only on the driver's driving operation, and an operation mode for performing driving operation support control for supporting the driving operation of the driver while mainly driving the driver's driving operation. Is included.
  • the driving operation support control assists the steering torque so that the driver's steering becomes an appropriate steering amount based on the curvature of the curve when the vehicle 1 is traveling on the curve, for example.
  • the driving operation support control includes control for assisting a driver's accelerator operation (for example, operation of an accelerator pedal) or brake operation (for example, operation of a brake pedal), manual steering (manual operation of steering), and manual speed adjustment (speed). Adjustment manual operation) is also included.
  • a driver's accelerator operation for example, operation of an accelerator pedal
  • brake operation for example, operation of a brake pedal
  • manual steering manual operation of steering
  • speed manual speed adjustment
  • Adjustment manual operation is also included.
  • manual steering the vehicle 1 is steered mainly by the driver's operation of the steering wheel 3a.
  • the manual speed adjustment the speed of the vehicle is adjusted mainly by the driver's accelerator operation or brake operation.
  • the driving operation support control does not include control for forcibly intervening in the driving operation of the driver and automatically driving the vehicle.
  • the driving operation of the driver is reflected in the driving of the vehicle within a preset allowable range, but forcibly intervenes in the driving of the vehicle under certain conditions (for example, deviation from the lane of the vehicle). Control to do is not included.
  • the automatic operation mode is a mode that realizes an operation state in which the vehicle automatically travels along the road on which the vehicle travels, for example.
  • the automatic driving mode includes, for example, a driving state in which the vehicle automatically travels toward a preset destination without driving by the driver.
  • the automatic driving mode it is not always necessary to automatically control all of the vehicle, and the driving state in which the driving operation of the driver is reflected in the driving of the vehicle within the preset allowable range is also included in the automatic driving mode. That is, the automatic driving mode includes control for forcibly intervening in driving of the vehicle under certain conditions, while reflecting the driving operation of the driver in driving of the vehicle within a preset allowable range.
  • the vehicle 1 is also provided with an automatic driving control device 5 for executing driving control in the automatic driving mode.
  • the automatic driving control device 5 acquires sensing information from the steering sensor 11, the accelerator pedal sensor 12, the brake pedal sensor 13, the GPS receiver 14, the gyro sensor 15, and the vehicle speed sensor 16, respectively.
  • the automatic driving control device 5 is a peripheral monitoring system that monitors these sensing information, route information generated by a navigation system (not shown), traffic information acquired by road-to-vehicle communication, and positions and movements of surrounding people and vehicles.
  • the vehicle 1 is automatically controlled based on the information obtained by the above.
  • Automatic control includes, for example, automatic steering (automatic steering operation) and automatic speed adjustment (automatic driving of speed).
  • Automatic steering is an operating state in which the steering device 3 is automatically controlled.
  • Automatic steering includes LKA (Lane Keeping Assist).
  • LKA Li Keeping Assist
  • the LKA automatically controls the steering device 3 so that the vehicle 1 does not deviate from the traveling lane even when the driver does not perform the steering operation.
  • the driver's steering operation may be reflected in the steering of the vehicle in a range where the vehicle 1 does not deviate from the travel lane (allowable range).
  • automatic steering is not limited to LKA.
  • Automatic speed adjustment is an operating state in which the speed of the vehicle 1 is automatically controlled.
  • Automatic speed adjustment includes ACC (Adaptive Cruise Control). For example, when there is no preceding vehicle ahead of the vehicle 1, ACC performs constant speed control that causes the vehicle 1 to travel at a constant speed at a preset speed, and when the preceding vehicle exists ahead of the vehicle 1. Is a follow-up control that adjusts the vehicle speed of the vehicle 1 in accordance with the inter-vehicle distance from the preceding vehicle.
  • the automatic operation control device 5 decelerates the vehicle 1 according to the driver's brake operation (for example, operation of the brake pedal) even when ACC is being executed.
  • the automatic operation control device 5 can perform the driver's accelerator operation (for example, accelerator) up to a preset maximum allowable speed (for example, the maximum speed legally determined on the traveling road) even during execution of ACC.
  • the vehicle can be accelerated according to the pedal operation.
  • the automatic speed adjustment is not limited to ACC but also includes CC (Cruise Control).
  • the vehicle 1 is also provided with a driving support device 6.
  • the driving support device 6 may have various functions.
  • the driving support device 6 cooperates with a driver monitoring function and a notification device that constitute a driver monitoring system that cooperates with a driver state detection sensor to monitor the driver and acquire the state of the driver.
  • Warning generation function that constitutes a warning generation system that issues a warning according to the state of the driver
  • operation mode switching control function that constitutes an operation mode switching control system that controls switching of the operation mode according to the state of the driver
  • biological information It may have a wake-up support function that constitutes a wake-up support system that works with the sensor and the stimulus output device to wake up the driver according to the driver's state.
  • the state of the driver is, for example, whether the driver is looking aside, whether the driver is drowsy, whether the driver is in a state of high concentration with respect to driving, and automatically During driving, there may be various conditions such as whether or not the driver can return to manual driving.
  • the determination of the driver's state is performed as follows, for example.
  • the driver's monitoring image is acquired by the driver state detection sensor, and based on the acquired monitoring image, the driver's eye opening, blink frequency, eye movement, etc. are detected, and the driver's line of sight is detected. Recognize direction and driver's arousal level.
  • the state of the driver is determined by comparing the dwell time of the driver's line of sight, the arousal level, and the like with a preset threshold value.
  • the driving support device 6 includes at least a driver monitoring unit 6a that performs the driver monitoring function and an awakening support unit 6b that performs the awakening support function.
  • the driver monitoring unit 6a cooperates with the driver camera 7 as a driver state detection sensor to constitute a driver monitoring system 8
  • the awakening support unit 6b includes a pulsation sensor 9A as a biological information sensor and a stimulus output.
  • Awakening support system 10 is configured in cooperation with non-audible sound output device 9B as a device.
  • the driver monitoring unit 6a and the awakening support unit 6b constitute a waking support device 6A.
  • the driving support device 6 includes the awakening support device 6A.
  • the state of the driver determined by the driver monitoring unit 6a includes at least the state of whether or not the driver is drowsy.
  • the driver camera 7 is installed at a position in front of the driver, such as on a dashboard, for example, and images the driver and outputs the video signal to the driving support device 6.
  • the pulsation sensor 9 ⁇ / b> A detects the pulsation of the driver and outputs a pulsation signal representing the pulsation to the driving support device 6.
  • the pulsation sensor 9A is not limited to this, but may be constituted by, for example, a pulse wave sensor or a heart sound sensor.
  • the pulsation sensor 9A may be a clothes-type pulsation sensor, for example. Or the pulsation sensor 9A may be attached to the seat of the driver's seat.
  • the pulsation sensor 9A is composed of a camera that captures the driver's face (for example, the driver camera 7) and its image processing circuit, and uses a technique for measuring the pulse from the image of the driver's face. The pulsation of the driver may be detected.
  • the non-audible sound output device 9B converts the non-audible sound signal output from the driving support device 6 into a non-audible sound and outputs it.
  • the non-audible sound output device 9B has, for example, a speaker and outputs a non-audible sound from the speaker.
  • the non-audible sound output device 9B may be configured to output not only a non-audible sound but also an audible sound.
  • the non-audible sound output device 9B may be configured using a sound output function of the navigation system.
  • a non-audible sound is a sound having a frequency outside the audible range.
  • An audible sound is a sound having a frequency within the audible region.
  • the non-audible sound may be a sound having a frequency outside the frequency range of 20 Hz to 20 kHz, for example.
  • the non-audible sound may be a sound having a frequency higher than 20 kHz.
  • the non-audible sound may be a sound having a frequency lower than 20 Hz.
  • the awakening support device 6A is a device that works together with the pulsation sensor 9A and the non-audible sound output device 9B to promote the driver's awakening when necessary, for example, when the driver is drowsy. It is configured as follows.
  • FIG. 2 is a block diagram showing the functional configuration.
  • the awakening support device 6A includes a control unit 61, an input / output interface unit 62, and a storage unit 63.
  • the input / output interface unit 62 converts the input analog signal into digital data and outputs the digital data to the control unit 61, and converts the digital data output from the control unit 61 into an analog signal and outputs the analog signal. Specifically, the input / output interface unit 62 receives the video signal output from the driver camera 7, converts it into digital data, and outputs it to the control unit 61. The input / output interface unit 62 also converts the non-audible sound information data output from the control unit 61 into a signal and outputs the signal to the non-audible sound output device 9B.
  • the storage unit 63 uses, as a storage medium, a non-volatile memory that can be written and read at any time, such as an SSD (Solid State Drive) or an HDD (Hard Disk Drive). Not limited to this, the storage unit 63 may be configured by a volatile memory such as a RAM.
  • the storage unit 63 includes a driver monitoring video storage unit 631, a driver state storage unit 632, and a non-audible sound information storage unit 633 as storage areas used for carrying out this embodiment.
  • the control unit 61 has a CPU (Central Processing Unit) and a program memory constituting the computer.
  • the control unit 61 includes a driver monitoring video acquisition unit 611, a driver state determination unit 612, and a non-audible sound information output unit 613 as control functions necessary for carrying out this embodiment. All of these control functions are realized by causing the CPU to execute a program stored in the program memory.
  • the driver monitoring video acquisition unit 611 has a function of acquiring a driver monitoring video from the driver camera 7.
  • the driver monitoring video acquisition unit 611 takes in the digital data (driver monitoring video data) of the driver's video signal output from the driver camera 7 from the input / output interface unit 62, and uses the captured driver monitoring video data.
  • the information is stored in the driver monitoring video storage unit 631 of the storage unit 63.
  • the driver state determination unit 612 has a function of determining the state of the driver.
  • the driver state determination unit 612 reads the driver monitoring video data from the driver monitoring video storage unit 631 at a preset time interval, and each time the driver is drowsy based on the driver monitoring video data. The process which determines whether it exists is performed.
  • the driver state determination unit 612 stores information representing the determination result in the driver state storage unit 632 of the storage unit 63.
  • the determination of whether or not the driver is drowsy is performed, for example, as follows. First, the driver state determination unit 612 detects a driver's eye open state, blinking frequency, or eye movement based on the driver monitoring video data, and recognizes the driver's arousal level. Next, the driver state determination unit 612 compares the driver's arousal level with a preset threshold value. If the driver's arousal level is higher than the threshold, the driver state determination unit 612 determines that the driver is not drowsy. Conversely, if the driver's arousal level is lower than the threshold, It is determined that the driver is drowsy.
  • the non-audible sound information output unit 613 has a function of outputting non-audible sound information when necessary.
  • the non-audible sound information output unit 613 reads information representing a determination result as to whether or not the driver is drowsy from the driver state storage unit 632, and the information indicating the determination result indicates that the driver is drowsy. If this is the case, the non-audible sound information is output to the non-audible sound output device 9B.
  • the non-audible sound information output unit 613 also stores the output non-audible sound information in the non-audible sound information storage unit 633 of the storage unit 63.
  • FIG. 3 is a flowchart showing the overall control procedure and control contents.
  • driver monitoring system 8 starts monitoring the driver in step S1.
  • Driver monitoring continues, for example, during driving.
  • the driver is monitored as follows, for example.
  • the driver camera 7 When driving is started, the driver camera 7 is activated, and continuously captures a predetermined range including the driver's face and outputs the video signal.
  • the awakening support device 6A takes in digital data (driver monitoring video data) of the video signal output from the driver camera 7 from the input / output interface unit 62 under the control of the driver monitoring video acquisition unit 611.
  • the captured driver monitoring video data is stored in the driver monitoring video storage unit 631 of the storage unit 63.
  • the driver's imaging may be performed intermittently at predetermined time intervals.
  • the driver camera 7 or the input / output interface unit 62 may encode the video signal according to a predetermined encoding method. In this way, it is possible to reduce the information amount of the monitoring video data and save the storage capacity of the driver monitoring video storage unit 631.
  • the awakening support device 6 ⁇ / b> A determines the state of the driver every time a certain period of time is determined under the control of the driver state determination unit 612. Do.
  • the driver's determination time interval may be set to a short interval of about 1 second so that a substantially continuous determination can be performed, for example, or to a relatively long interval of 10 to 30 seconds. May be.
  • the driver state determination unit 612 reads the driver monitoring video data from the driver monitoring video storage unit 631 at a preset time interval. Next, every time the driver monitoring video data is read, the driver state determination unit 612 determines whether or not the driver is drowsy based on the driver monitoring video data.
  • the driver state determination unit 612 stores information indicating the determination result in the driver state storage unit 632 of the storage unit 63 in association with information indicating the determination timing, for example, time stamp information.
  • the wakefulness support device 6A determines whether or not the driver is drowsy by the non-audible sound information output unit 613 in step S2, that is, Determine if the driver is sleepy.
  • the driver state determination unit 612 determines the driver's state at regular time intervals, and stores information indicating the determination result in the driver state storage unit 632.
  • the determination result of the driver's state includes information representing the determination result as to whether or not the driver is drowsy.
  • the non-audible sound information output unit 613 reads information representing the determination result of whether or not the driver is drowsy from the driver state storage unit 632 at regular time intervals.
  • step S5 determines the end of driving.
  • the non-audible sound output device 9B performs a process of outputting the non-audible sound in synchronization with the driver's beat.
  • the non-audible sound information output unit 613 reads pulsation information related to the driver's pulsation from the pulsation sensor 9A. Next, the non-audible sound information output unit 613 obtains the period of the driver's pulsation based on the pulsation information. Subsequently, the non-audible sound information output unit 613 outputs the non-audible sound from the driver's beat for a predetermined period at a time interval shorter than the driver's beat cycle. The non-audible sound information to be output to the device 9B is output. The non-audible sound output device 9B outputs a non-audible sound based on the non-audible sound information.
  • FIG. 4 is a time chart of the non-audible sound output from the non-audible sound output device 9B.
  • T 0 is the time when the output of the non-audible sound is started
  • T B is the period (time interval) of the driver's pulsation
  • T S is the time from which each audible sound is output.
  • time interval T P represents the period of non-audible sound is outputted.
  • the non-audible sound S i is output from each beat at a time interval T S ( ⁇ T B ).
  • Time interval T S at least, it is set larger than a half period T B of the driver beat. That is, the time interval T S is set so that at least T S > (1/2) T B.
  • the time interval T S is, T S> (2/3) may be set such that T B, as other, the T S> (3/4) T B , T S> ( 4/5) may be set such that T B.
  • the period T P in which non-audible sound S i is output is set so that the output of the non-audible sound S i before the next beat is completed.
  • the period T P is set to be shorter than the difference between the period T B and the time interval T S beats. That is, the period T P is set such that T P ⁇ (T B -T S ).
  • the non-audible sound S i is output in advance of the time interval of (T B ⁇ T S ) for each pulsation of the driver.
  • the number of beats decreases. That is, the time interval of pulsation of a person who is drowsy is longer than the time interval of pulsation of a person who is not drowsy. Conversely, if the time interval between pulsations is shortened, the person's arousal level increases.
  • the human audible frequency region is generally 20 Hz to 20 kHz.
  • the non-audible sound Si is output in advance for each pulsation of the driver.
  • the timing of the driver of the beat is expected to proceed.
  • the driver's arousal level is increased, that is, the driver's sleepiness is expected to be improved.
  • the non-audible sounds S i may all be the same.
  • non-audible tone S i + 1 may be different from the non-audible sound S i output during the last period T P. That is, S i + 1 ⁇ S i .
  • the non-audible sound S i + 1 only needs to be different from the non-audible sound S i + 1 in at least one of frequency and amplitude.
  • the non-audible sound S i + 1 may be different from the non-audible sound S i + 1 in either frequency or amplitude.
  • the non-audible sound S i + 1 may be different from the non-audible sound S i + 1 in both frequency and amplitude.
  • the non-audible sound information non-audible sound information output unit 613 to output to output the non-audible sound S i + 1 which is different from the non-audible sound S i output during the last period in the non-audible sound output device 9B It may be a thing.
  • the non-audible sound information output unit 613 stores the non-audible sound information in the non-audible sound information storage unit 633 of the storage unit 63 each time the non-audible sound information is output.
  • the non-audible sound information output unit 613 also reads the previously output non-audible sound information from the non-audible sound information storage unit 633 when outputting the non-audible sound information. That is, the non-audible sound information output unit 613 reads the non-audible sound information of the non-audible sound S i from the non-audible sound information storage unit 633 when outputting the non-audible sound information of the non-audible sound S i + 1 .
  • the non-audible sound information output unit 613 determines a non-audible sound information of a non-audible sound S i + 1 to be output to the non-audible sound output device 9B.
  • the time interval from when each beat is output to the non-audible sound may be changed according to the situation. For example, during a certain output period, the non-audible sound is output from each beat at the same time interval, but during the next output period, from each beat, the time interval during the previous output period. Non-audible sounds may be output at different time intervals.
  • the next output period is not allowed for each pulsation with a time interval longer than the time interval during the first output period.
  • Output listening sound if improvement in driver drowsiness is observed during this output period, in the next output period, non-audible sounds are placed at intervals shorter than those in the previous output period from each beat. Is output. Repeat this step until the non-audible sound is output from each beat at intervals of the first output period. You may make it approach to. Specifically, for example, the following may be performed.
  • the pulsation period at this time is 0.751.
  • the driver is drowsy and the driver's beat is 1.29 Hz.
  • the pulsation period at this time is 0.775...
  • the non-audible sound is output at a time interval of 0.751...
  • the time interval from each beat to the actual beat of the driver who drowsed, for example, 1 .Non-audible sound is output with a time interval of 0.769... Seconds corresponding to a 30 Hz beat period.
  • the pulsation of the driver can be easily raised from each pulsation, compared to outputting a non-audible sound at a time interval corresponding to a pulsation cycle of 1.33 Hz from the beginning. If the driver's beat is raised to 1.30 Hz, then each beat will be given an inaudible sound at a time interval of 0.757 ... seconds corresponding to a 1.31 Hz beat cycle. Output. Thereafter, this operation is repeated, and finally the pulsation of the driver is raised to 1.33 Hz.
  • the time interval from each beat until the non-audible sound is output corresponds to the period of the driver's beat at awakening from the time interval close to the period of the sleepy driver's beat.
  • a non-audible sound is output at a time interval corresponding to the period of a general human beat at awakening, and no improvement in the driver's sleepiness is observed.
  • a non-audible sound is output at a time interval close to the beat cycle of the driver who drowsed.
  • the present invention is not limited to this. From the beginning, from each beat, a non-audible sound is output at a time interval close to the beat cycle of the driver who drowsy, and a non-audible sound is output from each beat.
  • the time interval until the vehicle may be gradually reduced to a time interval corresponding to the period of the driver's pulsation when waking up.
  • the effect can be obtained even if non-audible sound is output from each beat with a time interval corresponding to the general beat period of a human being awake. Yes, it takes more time than in such a case, but it can be expected that the pulsation of the driver is surely increased and the driver's arousal level is improved just as when awakened.
  • step S4 Re-determination of the driver's sleepiness After the non-audible sound is output, the arousal support device 6A determines whether or not the driver's sleepiness is sufficiently improved in step S4. This determination is performed by the same method as in step S2.
  • the non-audible sound information output unit 613 reads information representing a determination result of whether or not the driver is drowsy from the driver state storage unit 632.
  • the process proceeds to the next step S5 for determining the end of driving.
  • the process returns to step S3, and the process of outputting the non-audible sound is performed again.
  • the awakening support device 6A obtains a determination result that the driver's sleepiness is sufficiently improved in step S3 and step S4 by the non-audible sound information output unit 613.
  • the process of outputting the non-audible sound and re-determination of the driver's drowsiness is repeated until it is received.
  • step S5 Determination of driving completion If it is determined that the driver is not drowsy at step S2 or if it is determined at step S4 that the driver's drowsiness is sufficiently improved, For example, in step S5, it is determined whether or not the operation is finished. If it is determined that the operation has not ended, the process returns to step S2 to repeat the series of controls described above. On the other hand, when it is determined that the driving is finished, the control of the awakening support is finished.
  • the driver state determination unit 612 causes the driver to detect the driver state based on the detection information of the driver camera 7 that is a driver state detection sensor that detects the driver state. Determine if you are drowsy.
  • the non-audible sound information output unit 613 outputs a non-audible sound to the non-audible sound output device 9B based on the heart rate information from the pulsation sensor 9A. Output non-audible sound information.
  • the non-audible sound output device 9B outputs a non-audible sound from each pulsation of the driver for a predetermined period at a time interval shorter than the period of the pulsation of the driver. . For this reason, the non-audible sound is repeatedly output prior to the driver's beat. Thereby, shortening of the driver's pulsation period, that is, an increase in heart rate is promoted, and the driver's sleepiness is improved.
  • Non-audible sound does not give the driver the awareness of listening. For this reason, it is considered that a non-audible sound does not irritate the driver and does not cause mental damage to the driver. As a result, the driver's arousal can be favorably promoted without causing mental distress to the driver.
  • the driver state detection sensor is configured by the driver camera 7 and the state of the driver is determined based on the video signal including the driver's face obtained by the driver camera 7 has been described as an example.
  • the driver state detection sensor is not limited to the driver camera 7, and is configured by a biological sensor that acquires biological information of the driver, and is detected by a biological signal obtained by the biological sensor, for example, a pulse wave sensor or a heart rate sensor.
  • the state of the driver may be determined based on the pulse wave signal or heartbeat signal of the driver or a signal representing the vertical movement of the diaphragm detected by the pressure sensor.
  • the present invention is not limited to such a situation, and the driver can be used in various situations. You may make it support awakening.
  • the following situation may be used as a situation for supporting the driver's awakening.
  • the sleepiness is such that it is determined that the driver is sleeping or that it is difficult for the driver to manually drive the vehicle
  • the driver's awakening may be supported.
  • the application field of the present invention is not limited to the vehicle, and the present invention is not limited to a vehicle, a machine, or the like. May be applied.
  • the present invention may be applied to various vehicles and facilities such as ships, airplanes, factories, research laboratories, and offices.
  • the term “driver” is not limited to the driver of the vehicle.
  • the vehicle other than the vehicle for example, the operation of a ship, an aircraft, or a spacecraft. It should be construed to include operators, steering personnel, pilots, etc., drivers and operators of machines and systems, operators, operators of computers, etc.
  • the vehicle type, the function of the automatic driving control device, the control function and control procedure of the awakening support device, and the control contents can be variously modified and implemented without departing from the gist of the present invention.
  • the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage.
  • various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.
  • a wake-up support device that promotes driver wake-up, having a hardware processor, The hardware processor causes the non-audible sound output device to output a non-audible sound based on detection information of a pulsation sensor that detects the pulsation of the driver and further based on a period of the pulsation of the driver.
  • Awakening support device that outputs non-audible sound information.
  • the hardware processor is Based on detection information of a driver state detection sensor that detects the state of the driver, it is determined whether or not the driver is drowsy, information indicating the determination result is stored in the memory, The awakening support according to appendix 1, wherein information indicating the determination result is read from the memory, and the non-audible sound information is output when the information indicating the determination result indicates that the driver is drowsy. apparatus.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Cardiology (AREA)
  • Psychology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Educational Technology (AREA)
  • Child & Adolescent Psychology (AREA)
  • Social Psychology (AREA)
  • Hospice & Palliative Care (AREA)
  • Acoustics & Sound (AREA)
  • Hematology (AREA)
  • Developmental Disabilities (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Anesthesiology (AREA)
  • Physiology (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

L'invention concerne un dispositif d'aide à la vigilance permettant de favoriser la vigilance d'un conducteur. Ce dispositif d'aide à la vigilance comprend une unité de génération d'informations sonores inaudibles permettant de générer des informations sonores inaudibles afin de transférer un son inaudible à un dispositif de génération de son inaudible d'après les informations de détection d'un capteur de pouls qui détecte le pouls du conducteur, ainsi que d'après le cycle de pouls du conducteur.
PCT/JP2017/038550 2017-03-10 2017-10-25 Dispositif, procédé et programme d'aide à la vigilance WO2018163497A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017046063A JP2018151745A (ja) 2017-03-10 2017-03-10 覚醒支援装置、方法およびプログラム
JP2017-046063 2017-03-10

Publications (1)

Publication Number Publication Date
WO2018163497A1 true WO2018163497A1 (fr) 2018-09-13

Family

ID=63447471

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/038550 WO2018163497A1 (fr) 2017-03-10 2017-10-25 Dispositif, procédé et programme d'aide à la vigilance

Country Status (2)

Country Link
JP (1) JP2018151745A (fr)
WO (1) WO2018163497A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004518151A (ja) * 2001-02-19 2004-06-17 ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング 操作部材の接触を検出する方法，コンピュータプログラム，開ループ制御及び／又は閉ループ制御装置及び装置並びに操作部材
JP2009137336A (ja) * 2007-12-04 2009-06-25 Honda Motor Co Ltd 車載警報装置
JP2016122455A (ja) * 2011-03-11 2016-07-07 ジョンソン コントロールズ オートモーティブ エレクトロニクス ゲーエムベーハー 運転者の覚醒度を監視及び制御するための方法及び装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2871630A4 (fr) * 2012-07-09 2015-06-17 Ts Tech Co Ltd Appareil de prolongement de la veille

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004518151A (ja) * 2001-02-19 2004-06-17 ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング 操作部材の接触を検出する方法，コンピュータプログラム，開ループ制御及び／又は閉ループ制御装置及び装置並びに操作部材
JP2009137336A (ja) * 2007-12-04 2009-06-25 Honda Motor Co Ltd 車載警報装置
JP2016122455A (ja) * 2011-03-11 2016-07-07 ジョンソン コントロールズ オートモーティブ エレクトロニクス ゲーエムベーハー 運転者の覚醒度を監視及び制御するための方法及び装置

Also Published As

Publication number Publication date
JP2018151745A (ja) 2018-09-27

Similar Documents

Publication Publication Date Title
JP6589930B2 (ja) 覚醒維持装置
JP5228970B2 (ja) 居眠り防止装置
KR101013232B1 (ko) 차량용 이상 경보 장치 및 제어 프로그램
WO2018070064A1 (fr) Dispositif, procédé et programme de commande de commutation de mode de conduite
JP4973551B2 (ja) 運転者状態判定装置
JP5830944B2 (ja) 車両用運転支援装置及び車両用運転支援方法
JP2017200822A (ja) 運転者の挙動に応答するシステムおよび方法
EP2497670A1 (fr) Procédé et appareil de surveillance de la promptitude mentale du conducteur d'un véhicule
JP4710502B2 (ja) 車両用居眠り防止装置及び居眠り防止方法
JP2019159711A (ja) 覚醒度維持装置
JP2014071628A (ja) 運転支援システム、運転支援プログラム、運転支援方法
WO2020066757A1 (fr) Dispositif de prévention de conduite dangereuse
CN110612558A (zh) 车辆的驾驶控制系统及车辆的驾驶控制方法
JP2010063682A (ja) 運転者監視装置
JP2005253590A (ja) 運転支援装置
US20230278565A1 (en) Driving assistance device
WO2018163474A1 (fr) Dispositif, procédé et programme de commande de commutation de mode de conduite
JP2009137336A (ja) 車載警報装置
JP2019008427A (ja) 覚醒維持装置
WO2017221603A1 (fr) Appareil de maintien de la vigilance
JP2019036018A (ja) 運転者支援装置及び運転者支援方法
JP2019016160A (ja) 覚醒維持装置
WO2018163497A1 (fr) Dispositif, procédé et programme d'aide à la vigilance
JP6648722B2 (ja) 故障判定装置、方法およびプログラム
JP2019008468A (ja) 覚醒維持装置

Legal Events

Date Code Title Description
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17899964

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17899964

Country of ref document: EP

Kind code of ref document: A1