JP6039504B2 - Arousal maintenance support device - Google Patents

Description

  The present invention relates to a wakefulness maintenance support device that supports a user's wakefulness maintenance.

  2. Description of the Related Art Conventionally, various devices have been proposed that are mounted on automobiles and the like to support a driver (user) awakening maintenance. For example, if the lane width is wide, the change in curvature of the lane is small, there are no obstacles such as preceding cars or parked vehicles, and there is no risk of collision or lane departure, the driver's arousal level is judged to be lowered. Then, a device for generating an alarm has been proposed (see, for example, Patent Document 1).

JP-A-8-203000

  However, the apparatus of Patent Document 1 does not refer to whether or not the driver is making an awakening effort. For this reason, even when the driver is in a relatively weak state of wakefulness and the driver is making an effort to wake up, an alarm may be generated. In this case, the driver may feel annoying the alarm. Therefore, the present invention has been made with the object of more appropriately executing wakefulness maintenance support such as warning by referring to the wakefulness effort of the user as a parameter of a viewpoint different from the wakefulness reduction of the user.

  In the wakefulness maintenance support device of the present invention made to achieve the object, the wakefulness detection means detects the degree of wakefulness reduction of the user, and the wakefulness detection means detects the degree of wakefulness effort of the user. Then, the support means assists the user in maintaining wakefulness by a support method according to the degree of wakefulness detected by the wakefulness reduction detecting means and the degree of wakefulness effort detected by the wakefulness effort detecting means.

  For this reason, in the present invention, by referring to the user's wakefulness effort as a parameter of a viewpoint different from the user's wakefulness reduction, the wakefulness maintenance support for the user can be executed with an appropriate timing and support method. .

  The support means may be selected and executed from a plurality of types of support methods according to the degree of wakefulness reduction and the degree of wakefulness effort. In this case, since the support method by the support means is selected from a plurality of types of support methods, the support means can perform more appropriate awakening maintenance support.

  In this case, the support means reduces the arousal reduction of the user according to the degree of the arousal decrease or the change direction of the awakening degree, and the degree of the arousal effort or the change direction of the degree. One of the support method and the second support method for forcibly awakening the user may be selected and executed. In this case, the support means executes the first support method according to the degree of wakefulness reduction or the direction of change in the degree and the degree of wakefulness effort or the direction of change in the degree of wakefulness. Or whether the user is forcibly awakened by executing the second support method. Therefore, in that case, the awakening maintenance support for the user can be executed by a more appropriate support method.

It is a schematic diagram showing the structure of the arousal maintenance assistance apparatus to which this invention is applied. It is explanatory drawing showing a general driver | operator's arousal fall and the change of arousal effort. It is a flowchart showing the process which concerns on a 1st mode among the support processes performed by the said wakefulness maintenance assistance apparatus. It is a flowchart showing the process which concerns on 2nd mode among the said assistance processes. It is a flowchart showing the process which concerns on 3rd mode among the said assistance processes. It is a flowchart showing the process which concerns on 4th mode among the said assistance processes. It is a flowchart showing the process which concerns on 5th A mode among the said assistance processes. It is a flowchart showing the process which concerns on 5th B mode among the said assistance processes. It is a flowchart showing the process which concerns on 5th C mode among the said assistance processes.

[Configuration of the embodiment]
Next, an embodiment to which the present invention is applied will be described with reference to the drawings. As shown in FIG. 1, the wakefulness maintenance support device 1 of the present embodiment includes a wakefulness reduction and wakefulness effort detection unit 3 (for example, a camera), a wakefulness maintenance stimulus presentation unit 5 (for example, a car audio), and a control unit 7. They are all provided on the dashboard 10 of the automobile. The arousal reduction and arousal effort detection unit 3 is provided on the side end surface (that is, the rear surface) of the driver U of the dashboard 10 and captures an image of the face of the driver U seated on the driver seat 20. The awakening maintenance stimulus presentation unit 5 can generate a warning in response to a command from the control unit 7 in addition to a general operation such as playing music.

  The control unit 7 estimates the driver's arousal effort based on how the driver's U's eyebrows rise using the image taken by the arousal reduction and arousal effort detection unit 3, and the digitized arousal effort E To get. Moreover, the control part 7 estimates the driver | operator's U wakefulness fall based on the opening degree of the driver | operator's heel, and the looseness of a cheek using the said image, and acquires the digitized wakefulness fall A. . These processes are executed every predetermined time (for example, 5 seconds to 3 minutes) set in advance. Further, these processes are disclosed in, for example, Japanese Patent No. 4259585 (however, unlike the present application, the arousal effort is not treated as a viewpoint parameter different from the arousal reduction), and so on, and will not be described in detail here. Furthermore, the control part 7 performs the support process demonstrated below based on the arousal fall A and the arousal effort E which were acquired as mentioned above.

[Outline of Processing in Embodiment]
FIG. 2 shows changes in the general driver U's arousal reduction A and arousal effort E as theoretical assumptions in the assistance processing. As shown in FIG. 2, in the state where the driver U is most awakened, the awakening reduction A and the awakening effort E are low. From that state, the arousal reduction A and the arousal effort E increase (phase F1). However, the wakefulness drop A further increases, and the wakefulness effort E changes so as to decrease, eventually reaching a state of falling asleep or close to it (phase F2).

  On the other hand, from such extremely strong wakefulness reduction state, the wakefulness drop A of the driver U gradually decreases, and the wakefulness effort E increases (phase F3). Then, the arousal drop A decreases to a certain level or less, and the arousal effort E also decreases (phase F4).

As described above, when the wakefulness reduction A and the wakefulness effort E acquired at intervals of 5 seconds to 3 minutes are A _i and E _i and the differences ΔA and ΔE are calculated by the following equations, the values of ΔA and ΔE in each phase Is as shown in Table 1 below.

ΔA = A _i −A _i−1 where A _i is the current arousal reduction, A _i−1 is the previous arousal decrease ΔE = E _i −E _i−1 where E _i is the current arousal effort, E _i-1 is the previous awakening effort

また、図２では、覚醒低下Ａを横軸に、覚醒努力Ｅを縦軸に取った領域全体を、覚醒低下Ａ，覚醒努力Ｅにそれぞれ独立した閾値（それぞれ第１度合い，第２度合いに相当）を設定することで４つの領域に区分している。すなわち、覚醒低下Ａ，覚醒努力Ｅがいずれも閾値未満の領域を領域Ａ１とし、覚醒低下Ａが閾値未満で覚醒努力Ｅが閾値以上の領域を領域Ａ２とし、覚醒低下Ａ，覚醒努力Ｅがいずれも閾値以上の領域を領域Ａ３とし、覚醒低下Ａが閾値以上で覚醒努力Ｅが閾値未満の領域を領域Ａ４としている。なお、図２の例では、フェーズＦ１がフェーズＦ２に切り替わる切り替わり点と、フェーズＦ３がフェーズＦ４に切り替わる切り替わり点とが、いずれも領域Ａ２の同様の位置に描かれているが、各切り替わり点は位置が異なる場合や、他の領域にある場合もある。

In FIG. 2, the entire region in which the wakefulness reduction A is plotted on the horizontal axis and the wakefulness effort E is plotted on the vertical axis is a threshold independent of the wakefulness decrease A and the wakefulness effort E (corresponding to the first and second degrees, respectively). ) Is divided into four areas. That is, the region where both the arousal decrease A and the arousal effort E are less than the threshold is defined as region A1, the region where the arousal decrease A is less than the threshold and the arousal effort E is equal to or greater than the threshold is defined as region A2, and Also, a region above the threshold is defined as region A3, and a region where the arousal drop A is equal to or greater than the threshold and the arousal effort E is less than the threshold is defined as region A4. In the example of FIG. 2, the switching point at which the phase F1 switches to the phase F2 and the switching point at which the phase F3 switches to the phase F4 are both drawn at the same position in the area A2, but each switching point is The position may be different or in another area.

  The support process executed by the control unit 7 is a process of performing awakening maintenance support for the driver U using the concept of these areas and phases, and includes the following first to fifth modes, Of these, the fifth mode is further divided into fifth to fifth C modes. The driver U can set a desired mode by using a switch (not shown) provided on the dashboard 10. Prior to detailed description of the support process using a flowchart, an outline of each mode will be described.

  << First Mode >> In this mode, in phases F1 and F3, for example, the music flowing from the wakefulness maintenance stimulus presentation unit 5 is intermittently presented to assist the driver U in reducing the wakefulness. In phase F2, for example, Support for forcibly awakening the driver U, such as generating an alarm sound from the awakening maintenance stimulus presentation unit 5, is executed. In phase F4, none of the above support is executed. In this mode, the support method is selected and executed only based on the phase, that is, the change in the arousal reduction A and the arousal effort E acquired this time with respect to the arousal reduction A and the arousal effort E acquired at the previous timing. The For this reason, the change of the support method can be accelerated compared to the case where the support method is selected and executed based only on the area as in the fifth mode described later.

  << Second Mode >> In this mode, when the acquired wakefulness reduction A and wakefulness effort E are in the area A1, none of the above-mentioned support is executed, and when in the other areas, the phase is the same as in the first mode. Assistance according to is performed. In this mode, the awakening maintenance support is not executed in the area A1 in which safety is relatively secured, so the driver U rarely feels arousal maintenance support.

  << Third Mode >> In this mode, none of the above-mentioned support is executed when the acquired wakefulness reduction A and wakefulness effort E are in the area A1, and support for forcibly awakening is executed when in the area A4. If it is in any other area, the support corresponding to the phase is executed as in the first mode. In this mode, in the relatively high risk area A4 where the wakefulness reduction A is large and the wakefulness effort E is small, the support for forcibly awakening is executed regardless of the phase, so that the safety is high. Further, similarly to the second mode, in this mode, the awakening maintenance support is not executed in the area A1 in which the safety is relatively secured, so the driver U rarely feels the awakening maintenance support.

  << Fourth Mode >> In this mode, when the acquired wakefulness reduction A and wakefulness effort E are in the area A1, none of the above-mentioned support is executed, and when they are in the area A3 or the area A4, they are forcibly awakened. Support is executed, and when it is in an area other than that, support according to the phase is executed as in the first mode. In this mode, in areas A3 and A4 where the arousal reduction A is large and the risk is relatively high, the support for forcibly awakening is executed regardless of the phase, so that the safety is further improved. Further, similarly to the second mode, in this mode, the awakening maintenance support is not executed in the area A1 in which the safety is relatively secured, so the driver U rarely feels the awakening maintenance support.

  Also, in the second to fourth modes, there is an area where the support method can be switched according to the phase as in the first mode, so that the change in the support method can be accelerated as in the first mode. There is a case.

  << Fifth Mode >> In this mode, when the acquired wakefulness reduction A and wakefulness effort E are in the area A1, none of the above-mentioned support is executed, and when in the area A2, the support for reducing the wakefulness reduction is executed. When in the area A4, support for forcibly awakening is executed. In this mode, as in the third mode, the awakening maintenance support is not executed in the area A1, so the driver U rarely feels the awakening maintenance support, and in the area A4, the assistance for forcibly awakening regardless of the phase is provided. It is safe because it is executed. Then, the fifth mode depends on whether the support for reducing the arousal reduction is executed or the support for forcibly awakening is executed when the arousal reduction A and the arousal effort E are in the region A3. , 5B mode and 5C mode.

  << Fifth A Mode >> In this mode, when the wakefulness reduction A and the wakefulness effort E are in the area A3, support for reducing the wakefulness reduction is executed. For this reason, among the three modes of the fifth mode, the driver U rarely feels arousal maintenance support troublesome.

  << 5th B Mode >> In this mode, when the wakefulness reduction A and the wakefulness effort E are in the region A3, the support for forcibly awakening is executed. For this reason, safety is the highest among the three modes of the fifth mode.

  << Fifth C Mode >> In this mode, when the arousal reduction A and the arousal effort E are in the area A3, the support when the arousal reduction A and the arousal effort E shift to the area A3 is continuously performed. For this reason, the goodness of the two modes of the fifth mode can be made compatible.

[Details of Processing in Embodiment]
Next, the support process executed by the control unit 7 will be described in detail with reference to the flowcharts of FIGS. This process is executed by the CPU incorporated in the control unit 7 based on the program stored in the ROM built in the control unit 7 while the ignition key of the automobile is ACC or ON.

  As shown in FIG. 3, when the process is started, one of the first to fifth modes is selected by the driver U at S0 (S represents a step: the same applies hereinafter), and the selected mode is selected. Is read. In subsequent S1, it is determined whether or not the first mode is set. When the first mode is set (S1: Y), it is determined in S4 whether or not the change ΔA of the wakefulness decrease A is 0 or more. If ΔA is equal to or greater than 0 (S4: Y), it is determined in S5 whether or not the change ΔE in the arousal effort is equal to or greater than 0. If ΔE is also greater than or equal to 0 (S5: Y), if the support for forcibly awakening is in operation at that time, it is stopped (S6A), and then the support for reducing the decrease in arousal at S6 Is activated, and the process proceeds to S4 described above. That is, in the phase F1 in which ΔA is 0 or more (S4: Y) and ΔE is also 0 or more (S5: Y), support for reducing the arousal reduction is executed (S6).

  On the other hand, in the phase F2 in which ΔA is equal to or greater than 0 (S4: Y) and ΔE is less than 0 (S5: N), it is stopped if the support for reducing the decrease in alertness is in operation at that time. Later (S7A), the support for forcibly awakening is activated in S7, and the process proceeds to S4 described above. If ΔA is less than 0 (S4: N), the process proceeds to S8, and it is determined whether or not the change ΔE of the arousal effort is 0 or more. If ΔE is greater than or equal to 0 (S8: Y), the process proceeds to S6A described above. If ΔE is less than 0 (S8: N), the active support is stopped in S9. Thereafter, the process proceeds to S4 described above. That is, in the phase F3 in which ΔA is less than 0 (S4: N) and ΔE is 0 or more (S8: Y), support for reducing arousal reduction is executed (S6), and ΔA is less than 0 (S4: N), ΔE is also less than 0 (S8: N), and no support is executed in phase F4.

  As described above, when the first mode is set (S1: Y), depending on whether the phase is F1, F2, F3, or F4, the support for reducing the arousal drop, the forced awakening The support to be activated, the support to reduce arousal reduction, or no support is selected.

  On the other hand, when the first mode is not set (S1: N), the process proceeds to S10 shown in FIG. 4, and it is determined whether or not the second mode is set. When the second mode is set (S10: Y), it is determined in S11 whether or not the recently acquired wakefulness reduction A and wakefulness effort E are in a region other than A1.

  If it is in an area other than A1 (S11: Y), after the processes of S14 to S19 similar to S4 to S9 are executed, the process proceeds to S11 described above. That is, whether the phase is F1 (S14: Y, S15: Y), F2 (S14: Y, S15: N), F3 (S14: N, S18: Y), or F4 According to (S14: N, S18: N), support for reducing arousal reduction (S16A, S16), support for forcibly awakening (S17A, S17), support for reducing arousal reduction (S16A, S16) Or, no support (S19) is selected. On the other hand, when the recently acquired wakefulness reduction A and wakefulness effort E are in the area A1 (S11: N), after the support in operation is stopped in S119 as in S19, the process proceeds to S11 described above. Migrated and no assistance is provided.

  As described above, when the second mode is set (S10: Y), when the wakefulness reduction A and the wakefulness effort E are in the area A1 (S11: N), neither support is executed (S119). If it is in any other region (S11: Y), the support according to the phase is executed as in the first mode (S14 to S19).

  On the other hand, when the second mode is not set (S10: N), the process proceeds to S20 shown in FIG. 5, and it is determined whether or not the third mode is set. If the third mode is set (S20: Y), it is determined in S21 whether the most recently acquired wakefulness reduction A and wakefulness effort E are in a region other than A1.

  If it is in an area other than A1 (S21: Y), the process proceeds to S23, and it is determined whether or not the recently acquired arousal reduction A and arousal effort E are in area A4. If it is not in the area A4 (S23: N), after the processing of S24 to S29 similar to S4 to S9 described above is performed, the processing proceeds to S21 described above. That is, whether the phase is F1 (S24: Y, S25: Y), F2 (S24: Y, S25: N), F3 (S24: N, S28: Y), or F4 According to (S24: N, S28: N), support for reducing arousal reduction (S26A, S26), support for forcibly awakening (S27A, S27), support for reducing arousal reduction (S26A, S26) Or, no support (S29) is selected.

  On the other hand, if the most recently acquired wakefulness reduction A and wakefulness effort E are in the area A1 (S21: N), after the support in operation is stopped in S129 as in S29, the process proceeds to S21 described above. Migrated and no assistance is provided. If the recently acquired arousal reduction A and arousal effort E are in the area A4 (S21: Y, S23: Y), the process proceeds to S127A, 127 similar to S27A, S27, forcibly awakening. As a result, the process proceeds to S21 described above.

  As described above, when the third mode is set (S20: Y), when the wakefulness reduction A and the wakefulness effort E are in the area A1 (S21: N), neither support is executed (S129). When in the area A4 (S23: Y), support for forcibly awakening is executed (S127A, 127). When the wakefulness reduction A and the wakefulness effort E are in other regions (S23: N), the support corresponding to the phase is executed as in the first mode (S24 to S29).

  On the other hand, when the third mode is not set (S20: N), the process proceeds to S30 shown in FIG. 6, and it is determined whether or not the fourth mode is set. When the fourth mode is set (S30: Y), the processing of S31 to S139 shown in FIG. 6 is executed. Here, the processing of S31 to S139 is substantially the same as the processing of S21 to S129 described above, except for the following points. That is, in S23, it is determined whether or not it is in the area A4, but in S33, it is determined whether or not it is in the area A3 or A4.

  Therefore, when the fourth mode is set (S30: Y), when the wakefulness reduction A and the wakefulness effort E are in the area A1 (S31: N), neither support is executed (S139), When it is in the region A3 or A4 (S33: Y), support for forcibly awakening is executed (S137A, S137). When the wakefulness reduction A and the wakefulness effort E are in the other region (region A2) (S33: N), the support corresponding to the phase is executed as in the first mode (S34 to S39).

  On the other hand, when the fourth mode is not set (S30: N), the fifth mode is set, and the process proceeds to S40 shown in FIG. In S40, any one of the 5A mode, the 5B mode, and the 5C mode is selected by the driver U, and the selected mode is read. In the subsequent S42, it is determined whether or not the 5A mode is set. If the 5A mode is not set (S42: N), it is determined in S43 whether or not the 5B mode is set. The

  When the fifth A mode is set (S42: Y), the process proceeds to S51, and it is determined whether or not the recently acquired arousal reduction A and arousal effort E are in the region A2 or A3. When the arousal reduction A and the arousal effort E are in the region A2 or A3 (S51: Y), the process proceeds to S53 after the support for reducing the arousal reduction is activated in S52. In S53, it is determined again whether or not the most recently acquired wakefulness reduction A and wakefulness effort E are in region A2 or A3. If they are in region A2 or A3 (S53: Y), the process waits in S53. To do. When the process enters a standby state after the support for reducing the arousal reduction is activated in this way, the above-described arousal reduction is reduced while the awakening reduction A and the arousal effort E are in the region A2 or A3 (S53: Y). Support is repeatedly executed.

  When the most recently acquired wakefulness reduction A and wakefulness effort E disappear in both area A2 and A3 (S53: N), the support for reducing the wakefulness drop is stopped in S54, and the process proceeds to S55. . If it is determined in S51 that the most recently acquired wakefulness reduction A and wakefulness effort E are neither in the area A2 nor A3 (S51: N), the process proceeds directly from S51 to S55.

  In S55, it is determined whether or not the most recently acquired wakefulness reduction A and wakefulness effort E are in the area A4. When the arousal drop A and the arousal effort E are in the area A4 (S55: Y), the process proceeds to S57 after the support for forcibly awakening is activated in S56. In S57, it is determined again whether or not the most recently acquired wakefulness reduction A and wakefulness effort E are in the region A4. If they are in the region A4 (S57: Y), the process waits in S57. When the process enters a standby state after the support for forcibly awakening is performed in this manner, while the awakening reduction A and the arousal effort E are in the area A4 (S57: Y), the above-mentioned forcible awakening is performed. Support is repeatedly executed.

  Then, when the recently acquired wakefulness reduction A and wakefulness effort E disappear in the region A4 (S57: N), the support for forcibly awakening is stopped in S58, and the process proceeds to S51 described above. If it is determined in S55 that the most recently acquired wakefulness reduction A and wakefulness effort E are not in the area A4 (S55: N), the process proceeds directly from S55 to S51.

  As described above, when the 5A mode is set (S42: Y), while the awakening reduction A and the awakening effort E are in the area A2 or A3 (S51: Y, S53: Y), the reduction of the awakening is reduced. The support to be executed is repeatedly executed (S52). Further, while the wakefulness reduction A and the wakefulness effort E are in the region A4 (S55: Y, S57: Y), the support for forcibly awakening is repeatedly executed (S56). Further, while the arousal reduction A and the arousal effort E are in the area A1 (S51: N, S55: N), neither support is executed.

  On the other hand, when the fifth B mode is set (S43: Y), the processing of S61 to S68 shown in FIG. 8 is executed. Here, the processing of S61 to S68 is substantially the same as the processing of S51 to S58 described above, except for the following points. That is, in S51 and S53, it is determined whether or not it is in the area A2 or A3, whereas in S61 and S63, it is determined whether or not it is in the area A2. In S55 and S57, it is determined whether or not it is in the area A4. In S65 and S67, it is determined whether or not it is in the area A3 or A4.

  For this reason, when the 5B mode is set (S43: Y), while the wakefulness reduction A and the wakefulness effort E are in the area A2 (S61; Y, S63: Y), support for reducing the wakefulness reduction is provided. It is repeatedly executed (S62). Further, while the wakefulness reduction A and the wakefulness effort E are in the region A3 or A4 (S65: Y, S67: Y), the support for forcibly awakening is repeatedly executed (S66). Further, while the arousal reduction A and the arousal effort E are in the area A1 (S61: N, S65: N), neither support is executed.

  Further, when the fifth B mode is not set (S43: N), the fifth C mode is set, and the processing of S71 to S78 shown in FIG. 9 is executed. Here, the processing of S71 to S78 is substantially the same as the processing of S51 to S58 described above, except for the following points. That is, in S51, it is determined whether or not it is in the area A2 or A3, but in S71, it is determined whether or not it is in the area A2. In S57, it is determined whether or not it is in the area A4. In S77, it is determined whether or not it is in the area A3 or A4.

  For this reason, when the 5C mode is set (S43: N), while the wakefulness reduction A and the wakefulness effort E are in the area A2 (S71: Y, S73: Y), support for reducing the wakefulness reduction is provided. It is repeatedly executed (S72). From this state, even if the arousal reduction A and the arousal effort E shift to the region A3 (S73: Y), the support for reducing the arousal reduction is continued. Further, while the wakefulness reduction A and the wakefulness effort E are in the area A4 (S75: Y, S77: Y), the support for forcibly awakening is repeatedly executed (S76). From this state, even if the arousal reduction A and the arousal effort E shift to the area A3 (S77: Y), the support for forcibly awakening is continued. Furthermore, while the arousal reduction A and the arousal effort E are in the area A1 (S71: N, S75: N), neither support is executed.

[Effects of the embodiment and modifications thereof]
Thus, in this embodiment, by referring to the awakening effort E of the driver U as a parameter of a viewpoint different from the awakening reduction A of the driver U, the awakening maintenance support for the user at an appropriate timing and support method Can be executed. Moreover, the selection of the support method according to the arousal reduction A and the arousal effort E is also made according to the above-described mode so that the driver U is not bothered and safety can be ensured. Can be performed properly.

  In the above-described embodiment, the process of the arousal reduction and arousal effort detection unit 3 and the control unit 7 that acquires the arousal reduction A from the captured image is used as the arousal reduction detection means. The process of the control unit 7 for acquiring the wakeful effort E from the wakefulness effort detecting means, the wakefulness maintenance stimulus presenting part 5 and the process of FIG. 3 to FIG. Each corresponds.

  The present invention is not limited to the above-described embodiment, and can be implemented in various forms without departing from the gist of the present invention. For example, the support for reducing the arousal drop and the support for forcibly awakening may be the same type of support, such as simply different alarm sounds. Further, the present invention may include one that only switches whether or not to support wakefulness based on wakefulness reduction A and wakefulness effort E. However, when selecting and executing from a plurality of types of support methods as in the above-described embodiment, more appropriate wakefulness maintenance support can be executed.

  Further, the method for supporting awakening is not limited to the method using the auditory stimulus as in the supporting method using the awakening maintaining stimulus presenting unit 5 described above, but the visual stimulus, the tactile stimulus, the olfactory stimulus, the taste sense. It is also possible to use a support method such as stimulation, motion induction, brain activity induction, or the like. Specifically, as a visual stimulus, it is conceivable to present flashing light as support for reducing arousal reduction and present stronger flashing light as support for forcibly awakening. In this case, as support for forcibly awakening, it is conceivable to increase the blinking cycle or to continuously turn on strong light.

  As a method of using a tactile stimulus, a method of vibrating the headrest, the steering, the upper part of the seat, and the lower part of the seat at random and intermittently can be considered as support for reducing the reduction in arousal. Further, as a support for forcibly awakening, a method of continuously oscillating vibrations at all locations simultaneously with a stronger vibration stimulus is conceivable.

  As a method of using olfactory stimulation, a method of intermittently sending a scent such as mint from the air outlet of an air conditioner can be considered as an aid for reducing the decrease in arousal. Moreover, as a support to forcibly awaken, a method of continuously sending a strong scent such as wasabi and mustard from the air blower of the air conditioner can be considered.

  As a method of using taste stimuli, as a support to reduce arousal decline, the driver U is provided with a bite of water with sour, bitter, sweet, and pungent taste added at regular intervals and allowed to drink (lick) Method). In addition, as a support for forcibly awakening, a method of strengthening a stimulus applied to water can be considered.

  As a method of using motion induction, a method of issuing an instruction for prompting a change in posture is considered as support for reducing a decrease in arousal. Further, as support for forcibly awakening, a method of forcibly changing the seat and changing the posture of the driver U can be considered.

  As a method of using brain activity induction, a method of giving a mental arithmetic task of about one or two digits can be considered as support for reducing arousal reduction. Moreover, as a support to forcibly awaken, a method of giving a mental arithmetic task with a high load such as 3 digits or more can be considered.

  Furthermore, as a support for reducing the reduction in arousal, any one of the above methods may be randomly executed at regular intervals, or as a support for forcibly awakening, You may perform at random for every fixed time so that irritation | stimulation may become stronger.

  Furthermore, a combination of a plurality of support methods from the above support methods may be used as a support for reducing arousal reduction, and a combination of other support methods may be used as a support for forcibly awakening.

  Various methods for acquiring the arousal reduction A and the arousal effort E are also conceivable. For example, a method of using information from a CAN (Controller Area Network) as an in-vehicle network is conceivable. More specifically, the wakefulness decrease A is acquired using the operation amount, angular velocity, angular acceleration, dispersion value, etc. of the steering operation, and the wakefulness decrease A is acquired using the operation amount, speed, acceleration, etc. of the accelerator operation, A method is conceivable, such as obtaining the arousal reduction A using the operation amount, speed, acceleration, etc. of the brake operation.

  Further, a method of acquiring the arousal reduction A and the arousal effort E based on the biological information is also conceivable. Specifically, a decrease in arousal A is obtained using electroencephalogram (α wave and β wave), electrooculogram, myoelectric potential of facial muscles, electrocardiogram, electrodermal activity, cerebral blood flow, etc. A method of acquiring the arousal effort E using myoelectric potential, electrocardiogram, cerebral blood flow, or the like is also conceivable. Furthermore, a method of acquiring the arousal reduction A and the arousal effort E based on the body movement is also conceivable. Specifically, a decrease in wakefulness A is acquired based on the tilt of the head of the driver U, and the driver U has re-sitted and stretched, that is, the wakefulness effort based on the shoulder movement and neck movement. A method of acquiring E is also conceivable. Furthermore, the degree of arousal reduction and the degree of arousal effort do not necessarily have to be detected as numerical values, and may be detected as, for example, large, medium, and small.

[Various aspects of the present invention]
In the present invention, as shown as the first mode, the support means selects and executes the first support method when the degree of the arousal effort is increasing, and reduces the arousal reduction. When the degree increases and the degree of wakefulness effort decreases, the second support method is selected and executed, and the degree of wakefulness reduction and the degree of wakefulness effort are both reduced. In any case, none of the above support methods need to be executed, and although not shown, when the degree of arousal effort does not change and only the degree of arousal reduction increases, the second support method May be selected and executed. In this case, since the support method is selected based only on the change in the degree of wakefulness reduction and the level of wakefulness effort, the change in the support method can be accelerated.

  Further, as shown in the second mode, the support means has a predetermined degree in which the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is set in advance. When the degree is less than the second degree, none of the support methods is executed, and the degree of wakefulness is not less than the first degree, or the degree of wakefulness effort is not less than the second degree When the degree of arousal effort is increasing, the first support method is selected and executed. When the degree of arousal reduction is increased and the degree of arousal effort is decreased When the second support method is selected and executed, and both the degree of wakefulness reduction and the level of wakefulness effort are reduced, none of the support methods may be executed, and Not The degree of 醒努 force is not changed may be performed by selecting the second support method when only the degree of awakening has been increasing.

  In that case, none of the above-described support methods are executed in a state where the necessity of support is relatively low, such as the degree of arousal reduction being less than the first degree and the degree of arousal effort being less than the second degree. , Users rarely feel annoying support. Also in this case, depending on the degree of wakefulness reduction and the degree of wakefulness effort, the support method may be selected based only on the change, and the change in the support method may be accelerated.

  Further, as shown in the third mode, the support means has a predetermined degree in which the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is set in advance. When the degree is less than the second degree, none of the support methods is executed, and when the degree of the arousal effort is equal to or more than the second degree, the first degree is increased when the degree of the arousal effort is increased. And selecting and executing the second support method when the degree of arousal reduction increases and the degree of arousal effort decreases, and When both the degree and the degree of arousal effort are reduced, none of the above support methods are executed, and although not shown, the degree of arousal effort does not change and only the degree of arousal reduction increases. When you are When the second support method is selected and executed, and the degree of wakefulness is not less than the first degree and the degree of wakefulness effort is less than the second degree, the second support method A method may be selected and executed.

  In that case, when the degree of wakefulness is greater than or equal to the first degree and the degree of wakefulness effort is less than the second degree, the second support method is selected, so that the user's sleep is further improved. Can be suppressed. Also in this case, if the degree of wakefulness is less than the first degree and the degree of wakefulness effort is less than the second degree, neither support method is executed, and the user feels troublesome to support. Less is. Also in this case, depending on the degree of wakefulness reduction and the degree of wakefulness effort, the support method may be selected based only on the change, and the change in the support method may be accelerated.

  Further, as shown in the fourth mode, the support means has a predetermined degree in which the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is set in advance. If the degree is less than the second degree, none of the support methods are executed, the degree of wakefulness is less than the first degree, and the degree of wakefulness effort is greater than or equal to the second degree The first support method is selected and executed when the degree of arousal effort is increasing, the degree of arousal reduction is increasing, and the degree of arousal effort is decreasing When the second support method is selected and executed, and when the degree of wakefulness reduction and the degree of wakefulness effort are both reduced, none of the support methods are executed, and although not shown, Awakening effort Is not changed, and when only the degree of arousal reduction is increased, the second support method is selected and executed. When the degree of arousal reduction is not less than the first degree, the second assistance method is selected. A support method may be selected and executed.

  In that case, when the degree of arousal reduction is greater than or equal to the first degree, the second support method is selected, so that the user's doze can be more effectively suppressed. Also in this case, if the degree of wakefulness is less than the first degree and the degree of wakefulness effort is less than the second degree, neither support method is executed, and the user feels troublesome to support. Less is. Also in this case, depending on the degree of wakefulness reduction and the degree of wakefulness effort, the support method may be selected based only on the change, and the change in the support method may be accelerated.

  Further, as shown in the fifth mode, the support means has a predetermined degree in which the degree of wakefulness reduction is less than a predetermined first degree that is set in advance and the degree of wakefulness effort is set in advance. If the degree is less than the second degree, none of the support methods are executed, the degree of wakefulness is less than the first degree, and the degree of wakefulness effort is greater than or equal to the second degree , When the first support method is selected and executed, the degree of arousal reduction is not less than the first degree, and the degree of arousal effort is not less than the second degree, When the support method or the second support method is selected and executed, the degree of wakefulness is equal to or higher than the first degree, and the degree of wakefulness effort is less than the second degree, the first 2 support methods -Option to may be executed.

  In that case, when the degree of wakefulness is greater than or equal to the first degree and the degree of wakefulness effort is less than the second degree, the second support method is selected, so that the user's sleep is further improved. Can be suppressed. Also in this case, if the degree of wakefulness is less than the first degree and the degree of wakefulness effort is less than the second degree, neither support method is executed, and the user feels troublesome to support. Less is.

  In that case, when the degree of wakefulness is not less than the first degree and the degree of wakefulness effort is not less than the second degree, the support means may include the first support method or the Of the second support methods, a predetermined method may be selected and executed. In addition, when the degree of wakefulness reduction is equal to or greater than the first degree and the degree of wakefulness effort is equal to or greater than the second degree, the support means includes the first support method or the second Of the support methods, the support method selected at that time may be continuously executed.

  In the former case, if the predetermined support method is the first support method, the user is less likely to feel annoying the support, and if the second support method is used, the user's sleep is further improved. Can be suppressed. Moreover, in the latter case, the goodness of the two forms in the former can be made compatible.

  In the present invention, as described above, visual stimulation may be used for one or both of the first support method and the second support method. In the present invention, as described above, auditory stimulation may be used for one or both of the first support method and the second support method. In the present invention, as described above, tactile stimulation may be used for one or both of the first support method and the second support method. In the present invention, as described above, olfactory stimulation may be used for one or both of the first support method and the second support method. In the present invention, as described above, taste stimulation may be used for one or both of the first support method and the second support method. In the present invention, as described above, a stimulus that induces a user's action may be used in one or both of the first support method and the second support method. Furthermore, in the present invention, as described above, auditory stimulation, visual stimulation, tactile stimulation, olfactory stimulation, taste stimulation, and user action are induced in one or both of the first assistance method and the second assistance method. Seven types of stimuli, i.e. stimuli that induce the user's brain activity, may be used by randomly changing them.

  Further, as described above, the arousal reduction detecting means may detect the degree of arousal reduction based on the CAN information. In this case, the wakefulness detection means may detect the degree of wakefulness reduction based on the steering operation information, may detect the degree of wakefulness decrease based on the operation information of the accelerator operation, and may be detected based on the operation information of the brake operation. The degree of decrease may be detected.

  Further, as described above, the wakefulness detection means may detect the degree of wakefulness reduction by facial expression, may detect the degree of wakefulness reduction by biological information, and may determine the degree of wakefulness reduction by body movement. It may be detected. The arousal effort detection means may also detect the degree of arousal effort based on facial expression, may detect the level of arousal effort based on biological information, or may detect the level of arousal effort based on body movements. .

  In addition, the present invention is not limited to an awakening maintenance support device mounted on an automobile, and can be applied to a use for supporting awakening maintenance of a learner or a guard in a learning room or a guard room. Furthermore, various modified examples can be considered as a method of selecting a support method according to the degree of arousal reduction and the degree of arousal effort. For example, when supporting a learner's arousal maintenance, the degree of arousal reduction is not less than a third degree set larger than the first degree, and the degree of arousal effort is set smaller than the second degree. If the degree is less than the fourth degree, none of the support methods may be executed, and after promoting a nap, support for forcibly awakening may be executed after a predetermined time has elapsed.

DESCRIPTION OF SYMBOLS 1 ... Arousal maintenance support apparatus 3 ... Arousal fall and arousal effort detection part 5 ... Arousal maintenance stimulus presentation part 7 ... Control part U ... Driver

Claims (4)

Arousal reduction detecting means (3, 7) for detecting the degree of arousal reduction of the user;
Awakening effort detection means (3, 7) for detecting the degree of awakening effort of the user;
The support method selected from a plurality of types of support methods according to the degree of arousal reduction detected by the arousal reduction detection means and the degree of arousal effort detected by the arousal effort detection means, and maintaining the user's arousal Support means (5, 7) to support;
Equipped with a,
The support means reduces the arousal reduction of the user when the degree of the arousal effort is increased according to the change direction of the arousal reduction degree and the change direction of the arousal effort degree. A second support method for forcibly awakening the user when the degree of wakefulness decrease is increased and the level of wakefulness effort is decreased; The wakefulness maintenance support apparatus, which is selected and executed, and does not execute any of the support methods when the degree of wakefulness reduction and the degree of wakefulness effort are both reduced . The support means, depending on the degree of wakefulness reduction and the direction of change of the degree, and the degree of wakefulness effort and the direction of change of the degree,
If the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is less than a predetermined second degree, execute any of the above support methods. Without
If the degree of wakefulness is greater than or equal to the first degree, or if the degree of wakefulness is greater than or equal to the second degree, the first support when the degree of wakefulness is increasing Select and execute a method, and when the degree of wakefulness increases and when the degree of wakefulness effort decreases, select and execute the second support method, and 2. The wakefulness maintenance support device according to claim 1 , wherein none of the support methods is executed when the degree of the wakefulness effort is reduced. The support means, depending on the degree of wakefulness reduction and the direction of change of the degree, and the degree of wakefulness effort and the direction of change of the degree,
If the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is less than a predetermined second degree, execute any of the above support methods. Without
When the degree of the arousal effort is equal to or greater than the second degree, when the degree of the arousal effort is increased, the first support method is selected and executed, and the degree of the arousal decrease is increased, And, when the degree of the arousal effort is reduced, the second support method is selected and executed, and when both the degree of the arousal reduction and the degree of the arousal effort are reduced, We do not execute support method,
The second support method is selected and executed when the degree of wakefulness is not less than the first degree and the degree of wakefulness is less than the second degree. Item 4. The wakefulness maintenance support device according to item 1 . The support means, depending on the degree of wakefulness reduction and the direction of change of the degree, and the degree of wakefulness effort and the direction of change of the degree,
If the degree of wakefulness reduction is less than a predetermined first degree and the degree of wakefulness effort is less than a predetermined second degree, execute any of the above support methods. Without
When the degree of wakefulness is less than the first degree and the degree of wakefulness is greater than or equal to the second degree, when the degree of wakefulness is increasing, the first support method Is selected and executed, and when the degree of arousal reduction is increased and the degree of arousal effort is reduced, the second support method is selected and executed, and the degree of arousal reduction and the When all of the awakening efforts are decreasing, none of the above support methods are executed,
Wherein if the degree of awakening decreases is the first degree or more, awakening An apparatus as claimed in claim 1, characterized in that selects and executes the second support method.

Images