WO2021112071A1

WO2021112071A1 - Awakening device

Info

Publication number: WO2021112071A1
Application number: PCT/JP2020/044641
Authority: WO
Inventors: みちる前田; 彩子小谷; 真紀子杉浦; 麻美塩見
Original assignee: 株式会社デンソー
Priority date: 2019-12-04
Filing date: 2020-12-01
Publication date: 2021-06-10
Also published as: JP2021087621A

Abstract

An awakening device (1) awakens a driver. The awakening device is provided with: a drowsiness level measuring unit which measures the drowsiness level of the driver; and a light stimulation generating unit which generates light stimulation having a periodically varying brightness. The light stimulation generating unit makes the speed of variation of the brightness greater in a first case in which the drowsiness level measured by the drowsiness level measuring unit is at least equal to a predetermined threshold, than in a second case in which the drowsiness level is less than the threshold.

Description

Awakening device

Cross-reference of related applications

This international application claims priority based on Japanese Patent Application No. 2019-219683 filed with the Japan Patent Office on December 4, 2019, and Japanese Patent Application No. 2019-2196883. The entire contents are incorporated in this international application by reference.

This disclosure relates to an awakening device.

The awakening device is disclosed in Patent Documents 1 and 2. When the awakening device detects drowsiness of the driver, the awakening device generates an awakening stimulus such as a light stimulus in order to awaken the driver.

WO2018 / 216669 A1 WO2018 / 221364 A1

If the brightness of the light stimulus is changed periodically, the effect of awakening the driver becomes even higher. However, as a result of detailed examination by the inventor, it has been found that the driver and passengers may feel annoyed by the light stimulus whose brightness changes periodically.

In one aspect of the present disclosure, it is preferable to provide an awakening device that can awaken the driver and makes it difficult for the driver and passengers to feel annoyed.

One aspect of the present disclosure is an awakening device configured to awaken a driver, a drowsiness level measuring unit configured to measure the drowsiness level of the driver, and light whose brightness changes periodically. It comprises a photostimulation generator configured to generate a stimulus.

In the first case where the drowsiness level measured by the drowsiness level measuring unit is equal to or higher than a preset threshold value, the light stimulus generating unit is compared with the second case where the drowsiness level is less than the threshold value. Increase the rate of change in brightness.

The awakening device, which is one aspect of the present disclosure, increases the rate of change in brightness when the drowsiness level is equal to or higher than the threshold value. Therefore, the awakening device, which is one aspect of the present disclosure, has a high effect of awakening the driver. In addition, the awakening device, which is one aspect of the present disclosure, reduces the rate of change in brightness when the drowsiness level is less than the threshold value. Therefore, the driver and passengers are less likely to feel annoyed by the light stimulus.

It is explanatory drawing which shows the structure of the awakening apparatus. It is explanatory drawing which shows the functional structure of the awakening apparatus. It is explanatory drawing which shows the arrangement of a light emitter in a vehicle interior. It is a flowchart which shows the process which awakening apparatus executes. It is explanatory drawing which shows the pattern A. It is explanatory drawing which shows the pattern B. It is explanatory drawing which shows the map which defines the relationship between the illuminance around the vehicle, and the maximum value.

An exemplary embodiment of the present disclosure will be described with reference to the drawings.
<First Embodiment>
1. 1. Configuration of Awakening Device 1 The configuration of the awakening device 1 will be described with reference to FIGS. 1 to 3. As shown in FIG. 1, the awakening device 1 is mounted on the vehicle 3. The vehicle 3 is driven by the driver. The awakening device 1 includes a microcomputer having a CPU 5 and, for example, a semiconductor memory such as a RAM or a ROM (hereinafter referred to as a memory 7).

Each function of the awakening device 1 is realized by the CPU 5 executing a program stored in a non-transitional substantive recording medium. In this example, the memory 7 corresponds to a non-transitional substantive recording medium in which a program is stored. Moreover, when this program is executed, the method corresponding to the program is executed. The awakening device 1 may include one microcomputer or a plurality of microcomputers.

As shown in FIG. 2, the awakening device 1 includes a drowsiness level measurement unit 9, a light stimulation generation unit 11, an illuminance measurement unit 13, a maximum value setting unit 15, a line-of-sight direction detection unit 17, and a selection unit 19. , The end determination unit 21 and.

The awakening device 1 is connected to another configuration mounted on the vehicle 3. As shown in FIG. 1, as a configuration connected to the awakening device 1, a driver status monitor (DSM) 23, an in-vehicle network 25, an illuminance meter 27, a light emitter group 29, and a head-up display (HUD) 53. , A meter (MET) 55, and a center information display (CID) 39.

DSM23 takes a picture of the driver's face and generates an image. The DSM 23 sends the generated image to the awakening device 1. The in-vehicle network 25 sends the detection result of the sensor mounted on the vehicle 3 to the awakening device 1. Examples of the sensor include a sensor that detects vehicle speed, acceleration, steering angle, accelerator depression amount, brake depression amount, and the like.

The illuminance meter 27 can measure the illuminance around the vehicle 3. The illuminometer 27 measures, for example, the illuminance in front of the vehicle 3. Alternatively, the illuminance meter 27 measures the illuminance with the rearview mirror 35 or the instrument panel 37 of the vehicle 3.

The light emitter group 29 is composed of a plurality of light emitters 29A to 29I. As shown in FIG. 3, the light emitters 29A to 29I are arranged in the vehicle interior of the vehicle 3. The positions of the light emitters 29A to 29I are different from each other. The light emitters 29A to 29I each generate light that is visible to the driver.

The light emitter 29A is attached to the end of the ceiling 31 of the vehicle 3 on the front window 33 side. The light emitter 29A is next to the rearview mirror 35. The light emitter 29A is located, for example, above the driver's head. The light emitter 29B is attached to the upper side of the instrument panel 37. The light emitter 29B is above the CID 39.

The light emitter 29C is attached to a portion of the instrument panel 37 below the light emitter 29B and the CID 39. A part of the light emitter 29C extends to the front of the steering wheel 40. A part of the light emitter 29C extends to the upper side of the meter hood 42. The light emitter 29D is attached to the upper end of the door 41 on the right side.

The light emitter 29E is attached to the door pocket 43 in the door 41 on the right side. The light emitter 29F is attached to the end of the driver seat 45. The light emitter 29G is attached to the upper end of the left door 47.

The light emitter 29H is attached to the door pocket 49 of the left door 47. The light emitter 29I is attached to the end of the passenger seat 51.

Each of the light emitters 29A to 29I has a structure in which a plurality of LED lamps are attached to a strip-shaped base material. The plurality of LED lamps are arranged along the longitudinal direction of the base material. The light emitters 29A to 29I are attached to the attachment target by, for example, an adhesive.

The HUD 53 displays an image superimposed on the landscape in front of the vehicle 3 in the display area 58 shown in FIG. In addition, HUD53 can generate a light stimulus. The light stimulus is reflected in the display area 58 and is directed to the driver's eyes.

MET55 and CID39 are respectively arranged at the positions shown in FIG. Each of the MET 55 and the CID 39 can display an image. In addition, MET55 and CID39 can generate light stimuli, respectively. The driver can visually recognize the optical stimulus generated by the MET 55 and the CID 39.

2. Processes executed by the awakening device 1 The processes executed by the awakening device 1 will be described with reference to FIGS. 4 to 7. The process shown in FIG. 4 is started when there is a predetermined trigger. Examples of the trigger include turning on the ignition of the vehicle 3, starting the running of the vehicle 3, and giving an instruction by the driver.

In step 1, the drowsiness level measuring unit 9 measures the drowsiness level of the driver. There are four levels of drowsiness, Lv0 to Lv3. Lv0 is the level with the lowest degree of drowsiness. The degree of drowsiness increases in the order of Lv1, Lv2, and Lv3. The drowsiness level measuring unit 9 determines which of Lv0 to Lv3 the driver's drowsiness level is.

A known method can be used as a method for measuring the drowsiness level. For example, the drowsiness level measuring unit 9 uses the DSM 23 to acquire an image showing the driver's face. The drowsiness level measuring unit 9 extracts features related to drowsiness from an image showing the driver's face. As a feature, for example, the amount of eye opening of the driver's eye and the like can be mentioned. The smaller the eye opening, the higher the driver's drowsiness level. The drowsiness level measuring unit 9 determines the drowsiness level based on the extracted characteristics.

Further, for example, the drowsiness level measuring unit 9 continuously acquires the detection result of the sensor mounted on the vehicle 3 from the vehicle-mounted network 25. The drowsiness level measuring unit 9 estimates the past running state of the vehicle 3 from the detection result of the sensor. The drowsiness level measuring unit 9 determines the drowsiness level based on the estimated running condition. For example, the smaller the change in speed or steering angle of vehicle 3, the higher the drowsiness level.

In step 2, the light stimulus generation unit 11 determines whether or not the drowsiness level measured in step 1 is Lv2 or higher. If the drowsiness level is less than Lv2, this process proceeds to step 3. If the drowsiness level is Lv2 or higher, this process proceeds to step 4.

Lv2 corresponds to a preset threshold. When proceeding to step 3, it corresponds to the second case. When proceeding to step 4, it corresponds to the first case.

In step 3, the light stimulus generation unit 11 sets the pattern A as a pattern in which the brightness of the light stimulus changes with the passage of time. Pattern A is the pattern shown in FIG. In the pattern A, the brightness changes periodically by repeating the cycle 57.

The cycle 57 is composed of a first part 59 and a second part 61. In

Part

1, 59, the luminance continuously rises from the lowest value at a constant rate to reach the highest value. Next, the brightness continuously decreases from the maximum value at a constant speed to reach the minimum value. In Part 2, 61, the luminance is always the lowest value.

The highest value is the highest brightness among the brightness that changes periodically. The lowest value is the lowest brightness among the periodically changing brightness. "Continuously" means that the difference between the brightness measured at an arbitrary measurement timing and the brightness measured at the next measurement timing is equal to or less than the upper limit value. The upper limit value is, for example, the difference between the maximum value and the minimum value.

Returning to FIG. 4, in step 4, the light stimulus generation unit 11 determines whether or not the drowsiness level measured in step 1 is Lv3. If the drowsiness level is Lv2, this process proceeds to step 5. If the drowsiness level is Lv3, this process proceeds to step 6. Lv3 corresponds to a preset reference value.

In step 5, the light stimulus generation unit 11 sets the pattern B as a pattern in which the brightness of the light stimulus changes with the passage of time. Pattern B is the pattern shown in FIG. In the pattern B, the brightness changes periodically by repeating the cycle 63.

The cycle 63 is composed of the first part 65 and the second part 67. In

Part

1, 65, the luminance is always the highest. In Part 2, 67, the luminance is always the lowest.

When shifting from Part 1 65 to Part 2 67, the brightness drops discontinuously. The change rate of the brightness at the time of transition from the first part 65 to the second part 67 is larger than the change rate of the brightness in the first part 59. The brightness change rate is an absolute value of the amount of change in brightness per unit time.

Further, when shifting from the second part 67 to the first part 65 of the next cycle 63, the brightness increases discontinuously. The change rate of the luminance when shifting from the second part 67 to the first part 65 of the next cycle 63 is larger than the change rate of the brightness in the first part 59. Discontinuous means that the above-mentioned non-continuously does not apply. Discontinuous means, for example, that the difference between the brightness measured at at least a part of the measurement timing and the brightness measured at the next measurement timing exceeds the upper limit value.

Returning to FIG. 4, in step 6, the light stimulus generation unit 11 sets the pattern C as a pattern in which the brightness of the light stimulus changes with the passage of time. Pattern C is basically the same as pattern B. However, the period 63 in the pattern C is shorter than the period 63 in the pattern B.

In step 7, the illuminance measuring unit 13 measures the illuminance around the vehicle 3 using the illuminance meter 27.

In step 8, the maximum value setting unit 15 sets the maximum value based on the illuminance measured in step 7. The memory 7 stores the map shown in FIG. 7 in advance. This map defines the relationship between the illuminance around the vehicle and the maximum value. The relationship defined by the map is that the higher the illuminance around the vehicle, the higher the maximum value. The maximum value setting unit 15 sets the maximum value corresponding to the illuminance measured in step 7 using the map.

In step 9, the line-of-sight direction detection unit 17 detects the line-of-sight direction of the driver. The line-of-sight direction detection unit 17 uses, for example, the DSM 23 to acquire an image representing the driver's face. The line-of-sight direction detection unit 17 detects the line-of-sight direction from an image showing the driver's face.

In step 10, the selection unit 19 determines whether or not there is any of the light emitters 29A to 29I, HUD53, MET55, and CID39 in the line-of-sight direction detected in step 9. When any of the light emitters 29A to 29I, HUD53, MET55, and CID39 is present in the line-of-sight direction, this process proceeds to step 11. If none of the light emitters 29A to 29I, HUD53, MET55, and CID39 is present in the line-of-sight direction, the process proceeds to step 12.

In step 11, the selection unit 19 selects the light emitters 29A to 29I, HUD53, MET55, and CID39 that are in the line-of-sight direction (hereinafter referred to as line-of-sight light emitters).

In step 12, the selection unit 19 selects the default light emitter. The default light emitter is one of the light emitters 29A to 29I, HUD53, MET55, and CID39, which is predetermined.

In step 13, the light stimulus generation unit 11 starts generating the light stimulus. When the process of step 11 is performed, the light stimulus generation unit 11 generates a light stimulus using a line-of-sight light emitter. Further, when the process of step 12 is performed, the light stimulus generation unit 11 generates a light stimulus using a predetermined light emitter.

The pattern in which the brightness of the light stimulus changes with the passage of time is the pattern set in any of

steps

3, 5 and 6. The maximum value is the value set in step 8. The light color is a color associated with the pattern set in any of

steps

3, 5 and 6 in advance. The color of the light in the pattern A and the pattern B is a color having a high effect of awakening the driver. Examples of colors that are highly effective in awakening the driver include white. The color of light in pattern C is different from the color of light in patterns A and B. The color of light in pattern C is a color that makes the driver aware of the meaning of the warning. Examples of the color of light in the pattern C include amber color and the like.

The generation of the light stimulus started in step 13 is determined to be the end timing in step 14 described later, or continues until the process of step 13 is executed next time.

In step 14, the end determination unit 21 determines whether or not the current time is the end timing. Examples of the end timing include the timing when the ignition of the vehicle 3 is already turned off, the timing when the running of the vehicle 3 has already ended, the timing when the end instruction has already been given by the driver, and the like. If the current time is not the end timing, the process proceeds to step 1. If the current time is the end timing, this process ends.

3. 3. Effect of Awakening Device 1 (1A) Awakening device 1 increases the rate of change in brightness when the drowsiness level is Lv2 or higher. Therefore, the awakening device 1 has a high effect of awakening the driver. When the drowsiness level is low, the driver and passengers are likely to feel annoyed by the light stimulus. The awakening device 1 reduces the rate of change in brightness when the drowsiness level is less than Lv2. Therefore, the driver and passengers are less likely to feel annoyed by the light stimulus.

(1B) The awakening device 1 changes the brightness discontinuously when the drowsiness level is Lv2 or higher. Therefore, the awakening device 1 has a higher effect of awakening the driver. The awakening device 1 continuously changes the brightness when the drowsiness level is less than Lv2. Therefore, the driver and passengers are less likely to feel annoyed by the light stimulus.

(1C) Generally, when the illuminance around the vehicle 3 is high, the driver is less likely to notice the light stimulus. The awakening device 1 measures the illuminance around the vehicle 3. The awakening device 1 sets the maximum value of the brightness higher as the illuminance around the vehicle 3 becomes higher. Therefore, the driver can easily notice the light stimulus even when the illuminance around the vehicle 3 is high.

Generally, when the illuminance around the vehicle 3 is low, the driver is attracted to the light stimulus and tends to feel annoyed. The awakening device 1 sets the maximum value of the brightness lower as the illuminance around the vehicle 3 becomes lower. As a result, even when the illuminance around the vehicle 3 is low, the driver is less likely to be attracted to the light stimulus and is less likely to feel annoyed.

(1D) The awakening device 1 detects the driver's line-of-sight direction. The awakening device 1 selects a light emitter in the detected line-of-sight direction from among a plurality of light emitters arranged in the vehicle interior of the vehicle 3. The awakening device 1 generates a light stimulus using the selected photophore. Therefore, the driver is more likely to notice the light stimulus.

(1E) When the drowsiness level is Lv3 or higher, the awakening device 1 changes the cycle in which the color of the light stimulus and the brightness of the light stimulus change as compared with the case where the drowsiness level is less than Lv3. Therefore, the effect of awakening the driver is higher when the drowsiness level is Lv3 or higher.
<Other Embodiments>
Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and can be implemented in various modifications.

(1) The waveform of pattern A may be different from the waveform shown in FIG. For example, the pattern A may be a pattern in which the brightness changes with a sinusoidal waveform.

(2) The waveform of pattern B may be different from the waveform shown in FIG. For example, in the first part 65 or the second part 67, the brightness may change continuously.

(3) The vehicle 3 is equipped with, for example, an auto light. The auto light measures the illuminance around the vehicle 3. The auto light turns off the headlight of the vehicle 3 when the illuminance around the vehicle 3 is equal to or higher than a predetermined value. Further, the auto light turns on the headlight of the vehicle 3 when the illuminance around the vehicle 3 is less than a predetermined value.

The processes of steps 7 and 8 may be, for example, the following processes. The maximum value setting unit 15 determines whether or not the headlight is lit. When the headlight is lit, the maximum value setting unit 15 sets the maximum value lower than when the headlight is not lit.

Also in the case of the above processing, the awakening device 1 sets the maximum value of the brightness higher as the illuminance around the vehicle 3 becomes higher.

(3) When the maximum value of brightness is set in step 8, the rate of change of the maximum value may be different depending on whether the maximum value increases or decreases. For example, in the daytime, when the vehicle 3 rushes into a tunnel, when it is sunset time, or when the weather deteriorates, the illuminance around the vehicle 3 decreases. In this case, the awakening device 1 immediately lowers the maximum value of the brightness to a value corresponding to the illuminance around the vehicle 3.

On the other hand, in the daytime, when the vehicle 3 exits the tunnel, when it is time for sunrise, or when the weather recovers, the illuminance around the vehicle 3 increases. In this case, the awakening device 1 gradually raises the maximum value of the brightness to a value corresponding to the illuminance around the vehicle 3.

(4) The drowsiness level may be, for example, data representing the drowsiness level output by DSM21, or may be converted from the data into abstract data.

(5) The awakening device 1 and its method described in the present disclosure are dedicated provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. It may be realized by a computer. Alternatively, the awakening device 1 and its method described in the present disclosure may be realized by a dedicated computer provided by configuring the processor with one or more dedicated hardware logic circuits. Alternatively, the awakening device 1 and its method described in the present disclosure are a combination of a processor and memory programmed to perform one or more functions and a processor composed of one or more hardware logic circuits. It may be realized by one or more dedicated computers configured by. The computer program may also be stored on a computer-readable non-transitional tangible recording medium as an instruction executed by the computer. The method for realizing the functions of each part included in the awakening device 1 does not necessarily include software, and all the functions may be realized by using one or a plurality of hardware.

(6) A plurality of functions possessed by one component in the above embodiment may be realized by a plurality of components, or one function possessed by one component may be realized by a plurality of components. .. Further, a plurality of functions possessed by the plurality of components may be realized by one component, or one function realized by the plurality of components may be realized by one component. Further, a part of the configuration of the above embodiment may be omitted. In addition, at least a part of the configuration of the above embodiment may be added or replaced with the configuration of the other above embodiment.

(7) In addition to the above-mentioned awakening device 1, a system having the awakening device 1 as a component, a program for operating a computer as the awakening device 1, a non-transitional actual record of a semiconductor memory or the like in which this program is recorded, etc. The present disclosure can also be realized in various forms such as a medium, a method of awakening the driver, and the like.

Claims

An awakening device (1) configured to awaken the driver.
A drowsiness level measuring unit (9) configured to measure the drowsiness level of the driver, and
A light stimulus generation unit (11) configured to generate a light stimulus whose brightness changes periodically, and
With
In the first case where the drowsiness level measured by the drowsiness level measuring unit is equal to or higher than a preset threshold value, the light stimulus generating unit is compared with the second case where the drowsiness level is less than the threshold value. An awakening device that increases the rate of change in brightness.
The awakening device according to claim 1.
The light stimulus generation unit is an awakening device that continuously changes the brightness in the first case and continuously changes the brightness in the second case.
The awakening device according to claim 1 or 2.
An awakening device further comprising a maximum value setting unit (15) configured to set the maximum value of the brightness higher as the illuminance around the vehicle (3) on which the driver rides is higher.
The awakening device according to any one of claims 1 to 3.
A line-of-sight direction detection unit (17) configured to detect the line-of-sight direction of the driver, and
Among the plurality of light emitters (29A to 29I, 39, 53, 55) arranged in the passenger compartment of the vehicle (3) on which the driver rides, the light emitters in the line-of-sight direction detected by the line-of-sight direction detection unit are used. A selection unit (19) configured to select, and
With more
The light stimulus generation unit is an awakening device configured to generate the light stimulus using the light emitter selected by the selection unit.
The awakening device according to any one of claims 1 to 4.
When the drowsiness level measured by the drowsiness level measuring unit is equal to or higher than a preset reference value, the light stimulus generating unit has a light stimulus as compared with a case where the drowsiness level is less than the reference value. An arousal device configured to change the period in which the color or the brightness of the light stimulus changes.