JP7196824B2 - awakening device - Google Patents

Description

The present disclosure relates to wakefulness devices.

A vibration control device is disclosed in Patent Document 1. The vibration control device generates vibration when detecting drowsiness of the driver. Vibration is an arousal stimulus for arousing the driver.

JP 2018-55527 A

When the wake-up device is generating wake-up stimuli, the driver's drowsiness level may drop. Even if the sleepiness level temporarily drops, the sleepiness level may rise again. Therefore, when the awakening device is generating the awakening stimulus, it is conceivable that the awakening stimulus will continue even if the driver's drowsiness level drops. The driver feels annoyed when the same wakeful stimulus continues even though the drowsiness level has decreased. In one aspect of the present disclosure, it is preferable to provide an awakening device that is less annoying for the driver.

One aspect of the present disclosure is a wake-up device (1) for waking up a driver. The awakening device comprises a drowsiness level measuring unit (9) configured to measure the drowsiness level of the driver, a change determination unit (11) configured to determine a change in the drowsiness level, and the drowsiness level a mode setting unit (13) configured to set a mode of arousal stimulation based on the drowsiness level measured by the measurement unit and the determination result of the change determination unit; and the mode set by the mode setting unit. an arousal stimulus generating unit (15) adapted to generate said arousal stimulus in response.

In at least some cases when the change determining unit determines that the drowsiness level has increased, the mode setting unit provides additional arousal in addition to the arousal stimulus included in the mode before the drowsiness level increased. Setting the aspect including stimulation.

In at least part of cases where the change determination unit determines that the sleepiness level has decreased, the mode setting unit replaces the arousal stimulus included in the mode before the sleepiness level decreased with a new wakefulness. Setting the aspect including stimulation.

According to the wake-up device, which is one aspect of the present disclosure, the driver is likely to notice that the wake-up stimulus is changing as the drowsiness level drops. Since the arousal stimulus has changed, the driver is less likely to feel annoyed.

It is a block diagram showing the structure of an awakening apparatus. It is a block diagram showing the functional composition of an awakening device. 4 is a flow chart showing a process executed by an awakening device; FIG. 4 is an explanatory diagram showing changes in drowsiness level and changes in drowsiness mode;

Exemplary embodiments of the present disclosure are described with reference to the drawings.
<First embodiment>
1. Configuration of Arousal Device 1 The configuration of the awakening device 1 will be described with reference to FIG. The awakening device 1 is mounted on a vehicle 3. Vehicle 3 is driven by a driver. The awakening device 1 includes a microcomputer having a CPU 5 and a semiconductor memory such as RAM or ROM (hereinafter referred to as memory 7).

Each function of the awakening device 1 is implemented by the CPU 5 executing a program stored in a non-transitional substantive recording medium. In this example, the memory 7 corresponds to a non-transitional substantive recording medium storing programs. Also, by executing this program, a method corresponding to the program is executed. The awakening device 1 may have one microcomputer or may have a plurality of microcomputers.

As shown in FIG. 2, the awakening device 1 includes a sleepiness level measurement unit 9, a change determination unit 11, a mode setting unit 13, a wakeful stimulus generation unit 15, a display unit 17, and an end determination unit 19. Prepare.

The awakening device 1 is connected to other components mounted on the vehicle 3 . As shown in FIG. 1, the components connected to the awakening device 1 include a driver status monitor (DSM) 21, an in-vehicle network 23, a light emitting device 25, an aroma shooter 27, a dialogue device 29, and an air conditioner 31. , a vibration speaker 33 , a head-up display (HUD) 35 and a speaker 37 .

The DSM 21 takes a picture of the driver's face and creates an image. The DSM 21 sends the generated image to the awakening device 1 . The in-vehicle network 23 sends the detection results of the sensors installed in the vehicle 3 to the awakening device 1 . Examples of sensors include sensors that detect vehicle speed, acceleration, steering angle, accelerator depression amount, brake depression amount, and the like.

The light emitting device 25 generates light that can be visually recognized by the driver. The light generated by the light emitting device 25 corresponds to the arousal stimulus. The awakening stimulus is a stimulus that the driver can feel with the five senses, and is a stimulus that awakens the driver. The light emitting device 25 can change the brightness, the color of the light, and the like. The light emitting device 25 can periodically change the luminance. When the luminance changes periodically, the light emitting device 25 can adjust the cycle length, waveform, luminance change amount per unit time, and the like. The light emitting device 25 has, for example, an LED as a light source.

The aroma shooter 27 injects perfume into the vehicle interior of the vehicle 3 . The driver perceives the scent of the sprayed perfume. The scent generated by the aroma shooter 27 corresponds to an awakening stimulus. The aroma shooter 27 can change the type of fragrance, the strength of the fragrance, and the like.

The dialogue device 29 conducts dialogue with the driver. That is, the dialogue device 29 recognizes the voice uttered by the driver, prepares an answer to the driver's voice, and pronounces the answer. The dialogue device 29 performs dialogue using, for example, artificial intelligence. The dialogue provided by dialogue device 29 corresponds to the arousal stimulus.

The air conditioner 31 generates cool air in the vehicle interior of the vehicle 3 . A cold wind corresponds to an arousal stimulus. The air conditioner 31 can change the temperature, air volume, and mode of cool air. Modes include an auto mode and a driver's face mode. Auto mode is a mode in which the blowing direction of cool air is changed by a preset algorithm. The driver's face mode is a mode in which cold air is always blown toward the driver's face.

A vibration speaker 33 is embedded in the buttocks or back of the driver seat. Vibration speaker 33 generates vibration. Vibrations correspond to arousal stimuli. The vibrations are, for example, vibrations based on bass notes in music.

The HUD 35 displays an image superimposed on the scenery in front of the vehicle 3 . Also, the HUD 35 can generate optical stimuli. A light stimulus corresponds to an arousal stimulus. Also, the HUD 35 can present information about arousal stimuli. Information related to the arousal stimulus includes activation information, continuation information, activation rest information, and continuation rest information. In addition, you may generate optical stimulation with a meter display or a center information display. Also, the information on the arousal stimulus may be presented on the meter display or the center information display.

Wake-up information is displayed before the arousal stimulus occurs. The activation information informs the driver that an arousal stimulus is about to be activated. Continuation information is displayed when the arousal stimulus continues. The continuation information informs the driver that the arousal stimulus is continuing.

Activation break information is displayed before the break suggestion occurs. It should be noted that the rest proposal is a display of contents suggesting that the driver take a rest. A break suggestion is displayed on one or more of HUD35, a meter display, and a center information display, for example.

The activated break information informs the driver that the proposed break is about to be activated. The continuous break information is displayed when the break suggestion continues. Information on ongoing breaks informs the driver that the proposed breaks are continuing.

The speaker 37 generates sound inside the cabin of the vehicle 3 . Sounds correspond to arousal stimuli. As the sound, there are music sound and alarm sound.
2. Processing Executed by Awakening Device 1 Processing executed by the awakening device 1 will be described with reference to FIG. The processing shown in FIG. 3 is started when a predetermined trigger occurs. Triggers include, for example, the ignition of the vehicle 3 being turned on, the vehicle 3 starting to run, and an instruction from the driver.

In step 1, the drowsiness level measuring unit 9 measures the drowsiness level of the driver. There are six sleepiness levels from Lv0 to Lv5. The awakening device 1 performs the same processing as in the case of Lv3 in the case of Lv4 to Lv5. In the following, descriptions for Lv4 and Lv5 are omitted. Lv0 is the lowest sleepiness level. The degree of drowsiness increases in the order of Lv1, Lv2, and Lv3. The drowsiness level measurement unit 9 determines which of Lv0 to Lv3 the drowsiness level of the driver is.

A known method can be used as a method for measuring the sleepiness level. For example, the drowsiness level measurement unit 9 uses the DSM 21 to acquire an image representing the driver's face. The drowsiness level measurement unit 9 extracts drowsiness-related features from the image representing the driver's face. The features include, for example, the amount of opening of the driver's eyes. The smaller the amount of eye opening, the higher the drowsiness level of the driver. A sleepiness level measurement unit 9 determines a sleepiness level based on the extracted features.

Further, for example, the drowsiness level measurement unit 9 continuously acquires detection results of sensors mounted on the vehicle 3 from the vehicle-mounted network 23 . The drowsiness level measurement unit 9 estimates the past running state of the vehicle 3 from the sensor detection results. A drowsiness level measurement unit 9 determines a drowsiness level based on the estimated running state. For example, the drowsiness level increases as the speed change and the steering angle change of the vehicle 3 decrease.

In step 2, the display unit 17 displays the drowsiness level measured in step 1 on one or more of the HUD 35, meter display, and center information display.

In step 3, the mode setting unit 13 sets the mode of awakening stimulation based on the drowsiness level measured in step 1 above. As modes of arousal stimulation, as shown in Table 1, there are modes L0 (A), L0 (B), L1 (A), L1 (B), L2, and L3. In each aspect, as shown in Table 1, the type of awakening stimulus to be generated is determined.

Types of arousal stimuli include light emission, scent, dialogue, cool air, vibration, and sound. Luminescence is an arousal stimulus of light generated by the light emitting device 25 and the HUD 35 . The scent is an awakening stimulus generated by the aroma shooter 27 . A dialogue is an arousal stimulus generated by the dialogue device 29 . Cold air is an awakening stimulus generated by the air conditioner 31 . Vibration is an arousal stimulus generated by the vibration speaker 33 . Voice is an arousal stimulus generated by the speaker 37 .

Moreover, in each aspect, the characteristics of the arousal stimulus are determined for each type of arousal stimulus. As shown in Table 1, the light arousal stimuli generated by the light emitting device 25 are classified into Light Emissions 1-4. Emissions 1-4 have different characteristics from each other. Features include, for example, the color of the light, the brightness, the pattern of light emission, the location where the light is generated, the device that generates the light, and the like. The effect of awakening the driver is higher for luminescence 2 than for luminescence 1, higher for luminescence 3 than for luminescence 2, and higher for luminescence 4 than for luminescence 3.

As shown in Table 1, the scent arousal stimuli are classified into scents 1-4. Scents 1-4 have different characteristics from each other. The characteristics include, for example, the type of fragrance, the strength of the fragrance, and the like. The effect of waking up the driver is higher for fragrance 2 than for fragrance 1, higher for fragrance 3 than for fragrance 2, and higher for fragrance 4 than for fragrance 3.

As shown in Table 1, the cold wind arousal stimulus consists of three elements: cold wind temperature, wind volume, and mode. The temperature of the cool air is auto or low temperature. Auto is to set the temperature according to a preset algorithm. The air volume is auto or strong. Auto is to set the air volume by a preset algorithm. The mode is the auto mode described above or the driver's face mode. Note that when the cold air temperature, air volume, and mode are all set to auto, it means that no cold air awakening stimulus has occurred. The effect of awakening the driver is higher when the cool air temperature is low than when the cool air temperature is auto. The effect of awakening the driver is higher when the air volume of the cool air is strong than when the air volume of the cool air is auto. The effect of awakening the driver is higher in the driver face mode than in the auto mode.

As shown in Table 1, audio arousal stimuli are classified into on and alarm. On is an arousal stimulus that outputs musical sounds. An alarm is an arousal stimulus that outputs an alarm sound. The effect of waking up the driver is higher when the alarm is on than when it is on.

Modes L0(B) and L1(B) are composed of patterns P0 and P1. When modes L0(B) and L1(B) are set, the time period of pattern P0 and the time period of pattern P1 are alternately repeated. No awakening stimulus occurs in the time period of pattern P0. In the time period of pattern P1, the arousal stimulus associated with pattern P1 in Table 1 occurs.

Mode L1(A) is composed of patterns P0, P1, P2, P3, and P4. When mode L1(A) is set, the time slot of pattern P0 is sequentially shifted to the time slot of pattern P4 through the time slot of pattern P1, the time slot of pattern P2, and the time slot of pattern P3. . When the time period of pattern P4 ends, the time period of pattern P0 is resumed.

No awakening stimulus occurs in the time period of pattern P0. In the time periods of patterns P1 to P4, awakening stimuli associated with the respective patterns in Table 1 are generated.
Modes L2 and L3 are composed of patterns P0, P1, P2, and P3. When modes L2 and L3 are set, the time zone of pattern P0 is sequentially shifted to the time zone of pattern P3 through the time zone of pattern P1 and the time zone of pattern P2. When the time period of pattern P3 ends, the time period of pattern P0 is resumed.

No awakening stimulus occurs in the time period of pattern P0. In the time periods of patterns P1 to P3, awakening stimuli associated with the respective patterns in Table 1 are generated.
When the drowsiness level measured in step 1 is Lv0, the mode setting unit 13 sets mode L0(A). When the drowsiness level measured in step 1 is Lv1, the mode setting unit 13 sets mode L1(A). When the drowsiness level measured in step 1 is Lv2, the mode setting unit 13 sets mode L2. When the drowsiness level measured in step 1 is Lv3, the mode setting unit 13 sets mode L3.

In step 4, the awakening stimulus generation unit 15 generates an awakening stimulus according to the mode set in step 3 above. The generation of the awakening stimulus continues until a new mode is set in step 8 or 11 described later, or until it is determined in step 13 that the end timing has come.

Also, the arousal stimulus generation unit 15 uses the HUD 35 to present information on the arousal stimulus. The information to be presented is determined for each pattern as shown in Table 1.
In step 5, the drowsiness level measuring unit 9 measures the drowsiness level of the driver. The method for measuring the sleepiness level is the same as in step 1 above.

In step 6, the display unit 17 displays the drowsiness level measured in step 5 on one or more of the HUD 35, meter display, and center information display.

In step 7, change determination unit 11 determines a change in sleepiness level. A change in drowsiness level is a change in the most recently measured drowsiness level (hereinafter referred to as the latest drowsiness level) relative to the drowsiness level measured one time before (hereinafter referred to as the previous drowsiness level). . The latest sleepiness level is the sleepiness level measured in step 5 above just before. The previous drowsiness level is the drowsiness level measured in step 5 above or the drowsiness level measured in step 1 one cycle before. The cycle is a cycle composed of steps 5-13.

Changes in sleepiness level include rising, staying the same, and falling. An increase means that the latest sleepiness level is higher than the previous sleepiness level. Same means that the latest sleepiness level is the same as the previous sleepiness level. Falling means that the latest sleepiness level is falling below the previous sleepiness level.

If the drowsiness level is rising, the process proceeds to step 8; If the sleepiness levels are the same, the process proceeds to step 10; If the drowsiness level is decreasing, the process proceeds to step 11;
In step 8, the mode setting unit 13 sets the mode of the awakening stimulus based on the latest drowsiness level and the determination result in step 7 that the drowsiness level is rising.

If the latest drowsiness level is Lv1, mode setting unit 13 sets mode L1(A). If the latest drowsiness level is Lv2, mode setting unit 13 sets mode L2. If the latest drowsiness level is Lv3, the mode setting unit 13 sets mode L3. FIG. 4 shows changes in the mode when the drowsiness level rises.

In step 9, the awakening stimulus generation unit 15 generates the awakening stimulus according to the mode set in step 8 immediately before. The generation of the awakening stimulus continues until a new mode is set in step 8 or 11 to be executed later, or until it is determined in step 13 that it is time to end.

In step 10, configuration unit 13 continues the current configuration. The awakening stimulus generation unit 15 also continues the awakening stimulus according to the current mode.
In step 11, the mode setting unit 13 sets the mode of the awakening stimulus based on the latest drowsiness level and the determination result in step 7 that the drowsiness level is falling.

If the latest drowsiness level is Lv0, mode setting unit 13 sets mode L0(B). If the latest drowsiness level is Lv1, mode setting unit 13 sets mode L1(B). Note that once the sleepiness level rises to Lv3, thereafter, the sleepiness level is maintained at Lv3 regardless of the measurement result of the sleepiness level. Therefore, the drowsiness level never drops from Lv3 to Lv2. FIG. 4 shows changes in behavior when the sleepiness level drops.

In step 12, the awakening stimulus generating unit 15 generates the awakening stimulus according to the mode set in step 11 immediately before. The generation of the awakening stimulus continues until a new mode is set in step 8 or 11 to be executed later, or until it is determined in step 13 that it is time to end.

In step 13, the end determination unit 19 determines whether or not the current time is the end timing. The end timing includes, for example, the timing at which the ignition of the vehicle 3 has already been turned off, the timing at which the vehicle 3 has already finished traveling, the timing at which the driver has already given an instruction to end the operation, and the like. If the current time is not the end timing, the process proceeds to step 5. If the current time is the end timing, this process ends.

3. Effects of Awakening Device 1 (1) When mode L1(A) is set and the drowsiness level rises from Lv1 to Lv2, awakening device 1 newly sets mode L2. Mode L2 includes a cold wind arousal stimulus in addition to the arousal stimulus included in mode L1(A). Mode L1(A) corresponds to the mode before the drowsiness level increases. The cold wind arousal stimulus corresponds to an additional arousal stimulus. The driver experiences additional arousal stimuli and notices that the arousal stimulus is changing as the level of drowsiness increases.
Further, when the drowsiness level rises from Lv2 to Lv3 while mode L2 is set, the awakening device 1 newly sets mode L3. Mode L3 includes a vibrational arousal stimulus in addition to the arousal stimulus included in mode L2. Mode L2 corresponds to the mode before the drowsiness level increases. A vibratory arousal stimulus corresponds to an additional arousal stimulus. The driver experiences additional arousal stimuli and notices that the arousal stimulus is changing as the level of drowsiness increases.

Mode L2 is a mode in which cold wind awakening stimulus is generated for a part of time. The driver is less likely to feel annoyed by the arousal stimulus compared to the case where the arousal stimulus of cool air is generated all the time.
(2) If the drowsiness level drops from Lv2 to Lv1 while mode L2 is set, the awakening device 1 newly sets mode L1(B). Mode L1 (B) includes light stimulation by the HUD 35 instead of the awakening stimulus included in mode L2. Mode L2 corresponds to the mode before the drowsiness level drops. The light stimulation by the HUD 35 corresponds to a new wakefulness stimulus that replaces the wakefulness stimulus included in the mode before the drowsiness level falls. When mode L1(B) is set, the driver feels that the awakening stimulus has changed significantly, and notices that the awakening stimulus has changed in accordance with the decrease in the drowsiness level. Therefore, the driver is less likely to feel annoyed even if the awakening stimulus continues after the drowsiness level has decreased.

Mode L2 includes light stimulation by light emitting device 25 . The optical stimulation by the HUD 35 is the same kind of arousal stimulation as the optical stimulation by the light emitting device 25, but is an arousal stimulation with different characteristics. Since the features are different, the driver can experience changes in the arousal stimulus.

(3) Modes L0(A), L0(B), L1(A), L1(B), L2, and L3 each include pattern P0. In pattern P0, no awakening stimulus occurs. When the mode is changed, the initial mode after the change is the pattern P0. Therefore, when the mode is changed, the initial stage of the mode after the change is the time during which no arousal stimulus occurs. The driver notices that the drowsiness level and state have changed by experiencing the time period during which no awakening stimulus occurs.
<Other embodiments>
Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above-described embodiments, and various modifications can be made.

(1) Mode L1(B) may include a different type of arousal stimulus from the arousal stimulus included in mode L2 instead of the arousal stimulus included in mode L2. Different types of arousal stimuli include, for example, a conversational arousal stimulus, a vibrational arousal stimulus, and an audio arousal stimulus. In the above case, mode L1(B) includes different types of arousal stimuli, so the driver can experience changes in arousal stimulus.

Mode L1(B) may not include any of the arousal stimuli included in mode L2. Mode L1(B) may also include some of the arousal stimuli included in mode L2.
(2) The Arousal Device 1 and techniques thereof described in the present disclosure are provided by configuring a processor and memory programmed to perform one or more functions embodied by a computer program. It may be implemented by a computer. Alternatively, the Arousal Device 1 and techniques described in this disclosure may be implemented by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the awakening device 1 and techniques thereof described in this disclosure are a combination of a processor and memory programmed to perform one or more functions and a processor configured by one or more hardware logic circuits. may be implemented by one or more dedicated computers configured by Computer programs may also be stored as computer-executable instructions on a computer-readable non-transitional tangible storage medium. The method for realizing the function of each part included in the awakening device 1 does not necessarily include software, and all the functions may be realized using one or more pieces of hardware.

(3) A plurality of functions possessed by one component in the above embodiment may be realized by a plurality of components, or a function possessed by one component may be realized by a plurality of components. . Also, a plurality of functions possessed by a plurality of components may be realized by a single component, or a function realized by a plurality of components may be realized by a single component. Also, part of the configuration of the above embodiment may be omitted. Moreover, at least part of the configuration of the above embodiment may be added or replaced with respect to the configuration of the other above embodiment.

(4) In addition to the above-described awakening device 1, a non-transitional actual record such as a system having the awakening device 1 as a component, a program for making a computer function as the awakening device 1, and a semiconductor memory in which this program is recorded The present disclosure can also be implemented in various forms such as a medium, a driver awakening method, and the like.

DESCRIPTION OF SYMBOLS 1... Awakening device, 3... Vehicle, 9... Drowsiness level measuring unit, 11... Change determination unit, 13... Mode setting unit, 15... Arousal stimulus generation unit, 17... Display unit, 19... End determination unit, 23... In-vehicle network , 25... Light emitting device, 27... Aroma shooter, 29... Dialogue device, 31... Air conditioner, 33... Vibration speaker, 37... Speaker

Claims (4)

An awakening device (1) for awakening a driver,
a drowsiness level measuring unit (9) configured to measure the drowsiness level of the driver;
a change determination unit (11) configured to determine a change in the drowsiness level;
a mode setting unit (13) configured to set a mode of arousal stimulation based on the drowsiness level measured by the drowsiness level measurement unit and the determination result of the change determination unit;
an arousal stimulus generation unit (15) configured to generate the arousal stimulus according to the mode set by the mode setting unit;
with
In at least some cases when the change determining unit determines that the drowsiness level has increased, the mode setting unit provides additional arousal in addition to the arousal stimulus included in the mode before the drowsiness level increased. setting the aspect comprising stimulation;
In at least part of cases where the change determination unit determines that the sleepiness level has decreased, the mode setting unit replaces the arousal stimulus included in the mode before the sleepiness level decreased with a new wakefulness. setting the aspect comprising stimulation;
The new arousal stimulus is the same type of arousal stimulus as the light arousal stimulus included in the aspect before the drowsiness level is lowered, and is a light arousal stimulus with different characteristics.
awakening device. The awakening device according to claim 1,
at least in part when the change determining unit determines that the drowsiness level has increased, the mode setting unit sets the mode to generate the additional wakefulness stimulus at a portion of time;
awakening device. An awakening device (1) for awakening a driver,
a drowsiness level measuring unit (9) configured to measure the drowsiness level of the driver;
a change determination unit (11) configured to determine a change in the drowsiness level;
a mode setting unit (13) configured to set a mode of arousal stimulation based on the drowsiness level measured by the drowsiness level measurement unit and the determination result of the change determination unit;
an arousal stimulus generation unit (15) configured to generate the arousal stimulus according to the mode set by the mode setting unit;
with
In at least some cases when the change determining unit determines that the drowsiness level has increased, the mode setting unit provides additional arousal in addition to the arousal stimulus included in the mode before the drowsiness level increased. setting the aspect comprising stimulation;
In at least part of cases where the change determination unit determines that the sleepiness level has decreased, the mode setting unit replaces the arousal stimulus included in the mode before the sleepiness level decreased with a new wakefulness. setting the aspect comprising stimulation;
The new arousal stimulus is a different type of arousal stimulus from the arousal stimulus included in the aspect before the drowsiness level is lowered,
awakening device. An awakening device (1) for awakening a driver,
a drowsiness level measuring unit (9) configured to measure the drowsiness level of the driver;
a change determination unit (11) configured to determine a change in the drowsiness level;
a mode setting unit (13) configured to set a mode of arousal stimulation based on the drowsiness level measured by the drowsiness level measurement unit and the determination result of the change determination unit;
an arousal stimulus generation unit (15) configured to generate the arousal stimulus according to the mode set by the mode setting unit;
with
In at least some cases when the change determining unit determines that the drowsiness level has increased, the mode setting unit provides additional arousal in addition to the arousal stimulus included in the mode before the drowsiness level increased. setting the aspect comprising stimulation;
In at least part of cases where the change determination unit determines that the sleepiness level has decreased, the mode setting unit replaces the arousal stimulus included in the mode before the sleepiness level decreased with a new wakefulness. setting the aspect comprising stimulation;
When changing the mode, the mode setting unit sets a time period during which the arousal stimulus does not occur at the beginning of the mode after the change.
awakening device.

Images