JP2011159108A - Awakening support device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To suppress a fright reaction while avoiding a situation that an awakening support effect does not appear since a stimulus is too weak. <P>SOLUTION: Whether it is an awakening support period or not is determined (S1210), and when determining that it is not the awakening support period (NO in S1210), whether a sleepiness level is not less than a threshold or not is determined (S1220). When determining that the sleepiness level is not less than the threshold (YES in S1220), whether start of awakening support is desired or not is inquired (S1230). Whether or not a request for starting awakening support is input within predetermined time from the inquiry is determined (S1240). When determining that request for the start of awakening support is input (YES in S1240), the awakening support is started (S1270). Then, whether the fright reaction appears or not is determined (S1275). When determining the appearance of the fright reaction (YES in S1275), stimulus intensity is reduced only by one level (S1280). Then, when the awakening support effect does not appear, the stimulus intensity is increased. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a device that supports user awakening.

  If you fall asleep during operation, support users to awaken by giving a stimulus to a user in a dangerous machine (such as a car) (for example, making a warning sound or hitting a cold wind on their face). Awakening support devices are already known. Such an awakening support apparatus often has a problem of how to set the intensity of stimulation.

  In other words, if the stimulus for arousal support is too weak, the effect of the awakening support will not appear, while if the stimulus is too strong, the user will be surprised (generally “surprise” is very surprised, It is used in the meaning that includes a slightly surprised state.), Which leads to induction of machine misoperation and discomfort. Therefore, it should be set to a stimulus with an appropriate intensity, but the appropriate intensity varies depending on individual differences and situations of the user (for example, if the stimulus is a warning sound, the appropriate volume depends on the quietness of the surroundings. Therefore, it is difficult to set appropriately in advance.

  As a technique related to such a problem, for example, Patent Document 1 discloses a technique that applies a reaction force to a steering operation of an automobile immediately after awakening support. In other words, even if the driver misoperates the steering wheel due to the startle response caused by the awakening support, the steering angle is prevented from changing greatly.

JP 2009-98731 A

  The problem with the prior art described above is that the startle response cannot be suppressed. The startle response may be discomforting to the user and is preferably suppressed. In view of this problem, an object of the present invention is to suppress a startle reaction while avoiding a situation where “a stimulus is too weak and an effect of arousal support does not appear”.

The invention of claim 1 for solving this object is an awakening support device comprising awakening support means, startle determination means, first setting means, drowsiness level estimation means, and second setting means.
The awakening support means supports the user's awakening by applying a stimulus. The startle determination means determines whether the user was startled by the stimulus from the awakening support means based on the change in the user's physiological index. And the 1st setting means weakens the intensity | strength of the stimulus provided by the awakening assistance means, when it is determined by the startle determination means that the user is startled. On the other hand, the sleepiness level estimation means estimates the sleepiness level of the user based on the user's facial expression. The second setting means increases the strength of the stimulus when the sleepiness level estimated by the sleepiness level estimation means tends to increase during the awakening support by the awakening support means.

  According to the present invention, it is possible to suppress a startle reaction while avoiding a situation where “the stimulus is too weak and the effect of awakening support does not appear”. That is, when the user is surprised by the stimulus by the awakening support means, the future startle response can be suppressed by weakening the stimulus. On the other hand, when the drowsiness level tends to increase in spite of performing the awakening support by the awakening support means, the effect of the awakening support can be easily exhibited by increasing the stimulation.

That is, it is easier than before to make the intensity of the stimulus fall within a range (appropriate range) that does not cause a startle response and the effect of arousal support appears.
The “physiological index” mentioned here is at least a numerical expression of facial expression, a perspiration amount, a heart rate, and a muscular contraction degree (an index for detecting a jump) The blood pressure value is included and indicates at least one of the general numerical values indicating the physiological state.

  By the way, there is a possibility that the user may feel uncomfortable if the awakening support is continued even though the sleepiness is awakened by the awakening support. In order to reduce this possibility, it is better to do the following.

The wakefulness support means included in the wakefulness support device according to claim 2 terminates the wakefulness support when the sleepiness level estimated by the sleepiness level estimation means becomes less than the threshold during the execution of the wakefulness support.
According to the present invention, when the drowsiness level becomes less than a threshold value (a value that is a reference for whether or not wake-up support is necessary) and the wake-up support is no longer necessary, the wake-up support can be terminated. By avoiding unnecessary awakening support in this way, the possibility that the user feels uncomfortable can be reduced.

  By the way, memorize the intensity of the stimulus at the end of wakefulness support, and when resuming wakefulness support, give the stimulus with the memorized intensity, so Granting is considered possible. On the other hand, startle responses are often triggered at the beginning. Therefore, even if the intensity is within an appropriate range at the end of the previous time, if a stimulus of that intensity is applied at the start, a startle reaction may be caused. Therefore, the following is recommended.

  The awakening support apparatus according to claim 3 includes a third setting unit. The third setting means sets the intensity of the stimulus applied by the wake-up support means to be weaker than the previous end time when the wake-up support by the wake-up support means is resumed once it is finished.

  According to this invention, the startle reaction can be further suppressed. In other words, attention is given to the feature that startle response is likely to occur at the start of stimulus application, and at start of wakefulness support, startle response is caused by applying a stimulus with a strength lower than the proven strength that has been effective. The possibility can be reduced. Moreover, since the intensity | strength will become strong with a 2nd setting means if an effect does not appear, the effect of arousal support can be anticipated.

  By the way, if there is only one type of awakening support, there are cases where it does not meet the user's preference or the user gets used to it while performing several times. Therefore, it is desirable that the type of awakening support can be selected from a plurality of types, but when such a selection can be made, it is necessary to determine the selection method. For example, the user can select it, but it is troublesome to select it every time the awakening support is started. Therefore, the following should be done.

  The wake-up support means included in the wake-up support apparatus according to claim 4 selects and executes one of a plurality of types of wake-up support that can be executed. On the other hand, this awakening support apparatus includes an evaluation unit. This evaluation means evaluates each of a plurality of types of wakefulness support based on the sleepiness level estimated by the sleepiness level estimation means. Then, the awakening support means preferentially selects the awakening support that is highly evaluated by the evaluation means.

  According to this invention, even if the user does not make a selection, the awakening support device automatically selects, so that the user does not feel bothered. Furthermore, according to the present invention, it is possible to select appropriate awakening support based on the evaluation determined by the estimated sleepiness level.

By the way, the evaluation means is preferably as follows.
The evaluation means included in the wakefulness support device according to claim 5 evaluates the wakefulness support low when the sleepiness level estimated by the sleepiness level estimation means tends to increase during the wakefulness support by the wakefulness support means. .

According to the present invention, it is possible to more appropriately select the awakening support by evaluating low the awakening support that does not show an effect.
By the way, if the effect does not appear even if the awakening support is continued to some extent, the effect cannot be expected even if it is continued as it is, and the user becomes accustomed to the awakening support, and the effect becomes even less likely to appear. Therefore, the following is recommended.

  The wakefulness support device according to claim 6 includes a switching unit. This switching means switches the type of wake-up support when the evaluation by the evaluation means for the wake-up support falls below the standard during the wake-up support by the wake-up support means.

  According to the present invention, it is possible to switch the awakening support that has no effect even though the awakening support is continued to some extent to another type. And since it switches based not on time etc. but the evaluation by an evaluation means, it can perform at an appropriate timing.

  By the way, the reference for the first setting means to increase the intensity of the stimulus and the reference for the evaluation means to lower the evaluation are the same. Therefore, when the arousal support is switched as described above, it is considered that the intensity of the stimulus is stronger than the initial setting immediately before the switching. If this awakening support is executed again, it will be likely to cause a startle response if it starts with the intensity of the stimulus immediately before the switching. Therefore, the following is recommended.

  The wake-up support means provided in the wake-up support device according to claim 7 starts the wake-up support stopped by switching the switching means again, regardless of the intensity of the stimulus at the time of the stop. Give the user a stimulus with the default intensity.

According to the present invention, it is easy to suppress the startle response when the awakening support stopped by switching is executed again.
By the way, the evaluation means may be specifically as follows.

  The evaluation means included in the wakefulness support device according to claim 8 increases the wakefulness support when the sleepiness level estimated by the sleepiness level estimation means becomes less than a predetermined value during the wakefulness support by the wakefulness support means. evaluate.

  According to the present invention, it is possible to more appropriately select the awakening support by highly evaluating the awakening support in which the effect appears. The predetermined value may be the same as or different from the threshold value of claim 1.

The block diagram which shows schematic structure of an awakening assistance system. The figure which showed the vehicle interior of the motor vehicle carrying an awakening assistance system. The flowchart which shows an awakening assistance process. The flowchart which shows sleepiness estimation processing. The figure which showed the feature point which comprises facial expression data. The figure which showed learning data. The flowchart which shows an operation | movement process. The flowchart which shows an effect determination process.

[1. Hardware configuration (FIGS. 1 and 2)]
FIG. 1 is a block diagram showing a schematic configuration of an awakening support system 1 to which the present invention is applied. The awakening support system 1 is mounted on an automobile and supports the driver's awakening according to the driver's sleepiness. On the other hand, FIG. 2 is a diagram showing a state in which each part constituting the awakening support system 1 is arranged in the vehicle interior. As shown in FIGS. 1 and 2, the wakefulness support system 1 includes a wakefulness support control device 10, a speaker 16, a vibration device 17, a blower device 18, a camera 20, a drowsiness estimation device 21, a touch panel screen 30, and a heart rate measurement device 40. Prepare.

  The camera 20 is disposed in the instrument panel and captures an image including the driver's face (specifically, an image of the upper part from the vicinity of the shoulder). The touch panel screen 30 functions as a user interface for displaying information and inputting information related to navigation devices and other in-vehicle devices (air conditioners, etc.), and for asking questions about whether to start or end awakening support, which will be described later. Used for display and input of answers (details will be described later).

  The heart rate measuring device 40 is provided on the steering wheel and measures the driver's heart rate by capturing the pulsation of the finger. The speaker 16 is used to output sound for music and navigation functions, and warning sound for awakening support. The vibration device 17 applies vibration (low frequency) to the driver's buttocks and the back to support awakening, and is installed inside the seat surface and backrest of the driver's seat. The blower 18 applies wind to the driver's back and is installed on the surface of the backrest of the driver's seat.

  The awakening support control device 10 and the drowsiness estimation device 21 are microcomputers composed of a CPU, a ROM, a RAM, and the like. The sleepiness estimation device 21 estimates the driver's sleepiness level based on the image taken by the camera 20. Based on the sleepiness level estimated by the sleepiness estimation device 21, the information input to the touch panel screen 30, and the heart rate measured by the heartbeat measurement device 40, the awakening support control device 10 includes the speaker 16, the vibration device 17, And the awakening support is realized by controlling the blower 18. In addition, the speaker 16, the vibration device 17, and the air blower 18 which give the stimulus for awakening support are collectively referred to as “wakeup support device”. Next, processing executed by the awakening support control device 10 and the drowsiness estimation device 21 for awakening support will be described.

[2. Awakening support processing (Figure 3)]
FIG. 3 is a flowchart showing the awakening support process. This awakening support process is a process that is always executed during a period during which the vehicle can travel (when the prime mover (engine or motor) operates). When the awakening support process is executed as shown in FIG. 3, the sleepiness estimation process is first executed (S110).

[2-1. Sleepiness estimation processing (Fig. 4)]
FIG. 4 is a flowchart showing sleepiness estimation processing. The sleepiness estimation process is a process in which the sleepiness estimation apparatus 21 is an execution subject. When the sleepiness estimation device 21 starts the sleepiness estimation process, the sleepiness estimation device 21 acquires a photographed image including the driver's face from the camera 20 (S1110). Then, expression data is generated based on the photographed image (S1120). In order to explain the facial expression data, the processing moves to FIG.

  FIG. 5 is a diagram showing feature points on the face constituting the expression data. In this embodiment, left and right upper eyelids 101L and 101R, left and right lower eyelids 102L and 102R, left and right eye heads 103L and 103R, left and right eye corners 104L and 104R, left and right eyebrows 105L and 105R, left and right eyebrow upper ends 106L and 106R, 25 points of left and right eyebrows 107L and 107R, left and right noses 108L and 108R, upper lip 109, lower lip 110, left and right mouth corners 111L and 111R, and contours 112 to 116 are defined. Note that “left and right” as used herein refers to the left and right when viewed toward the driver, and is reversed from the left and right viewed from the driver.

  Then, a two-dimensional coordinate value of each point is calculated using a straight line connecting both the left and right noses 108L and 108R as an x axis, a straight line passing through the middle point of both points, and a straight line orthogonal to the x axis as a y axis. This calculation result becomes facial expression data.

Returning to FIG. When the facial expression data is generated, learning data is acquired from the ROM included in the sleepiness estimation device 21 itself (S1130). To explain the learning data, move to FIG.
FIG. 6 is a diagram showing learning data. The learning data is a database composed of sample data obtained from experiments performed in advance on the relationship between the facial expression data and the drowsiness level described above. In this experiment, the sleepiness level (six levels of 0 (wakefulness) to 5 (strong sleepiness)) of the subject is determined by listening and observation, and the sleepiness level is associated with facial expression data at that time. There are a plurality of subjects, and an experiment is performed for each subject until a plurality of data of each sleepiness level can be acquired.

  Then, each acquired data is normalized by taking a difference from a coordinate value obtained as an average of facial expression data associated with drowsiness level 0. Learning data is obtained in this way.

  Returning to FIG. Next, the driver's facial expression data is normalized by the above "coordinate value obtained as an average of facial expression data associated with sleepiness level 0" (S1140). Then, the driver's sleepiness level is estimated based on the standardized driver's facial expression data and learning data (S1150). Specifically, the driver's facial expression data is collated with the learning data, and the facial expression data composing the learning data is selected to be closest to the driver's facial expression data (the Euclidean distance is the shortest). Note that the Euclidean distance is a distance in a 25-dimensional space because the facial expression data is composed of 25 feature points. Then, the sleepiness level associated with the selected facial expression data is estimated as the driver's sleepiness level.

Returning to FIG. When the sleepiness estimation process is finished, the operation process is executed next (S120).
[2-2. Operation process (Fig. 7)]
FIG. 7 is a flowchart showing the operation process. The operation process is a process in which the awakening support control device 10 is an execution subject, and is a process for starting or ending awakening support. Note that the execution subject of the sleepiness determination process (S110 and S150 described later) is the sleepiness estimation device 21, and the execution subject of the other steps is the wakefulness support control device 10.

  When the wake-up support control device 10 starts the operation process, it determines whether the wake-up support is being performed (S1210). If it is determined that the awakening support is not being performed (NO in S1210), it is determined whether the sleepiness level estimated in the previous S110 is equal to or higher than a threshold (for example, sleepiness level 2) (S1220). If it determines with it being less than a threshold value (S1220NO), an operation | movement process will be complete | finished, without starting arousal support.

  On the other hand, if it is determined that the drowsiness level is greater than or equal to the threshold (YES in S1220), the driver is asked whether he / she wants to start awakening support through the speaker 16 and the touch panel screen 30 (S1230). Specifically, a message “Do you want to start awakening support?” Is output to the speaker 16 as a voice and displayed on the touch panel screen 30 as a character. Furthermore, icons “Yes” and “No” are displayed on the touch panel screen 30 in order to allow the driver to input the answer.

  Then, it is determined whether or not an input indicating that the start of awakening support is desired (that is, whether “Yes” is touched) within a predetermined time after the above question has been asked (S1240). When it is determined that there is no input for requesting the start of awakening support within a predetermined time (that is, “No” has been touched or a predetermined time has passed without any touch) (S1240 NO), awakening support is started. The operation process is finished without doing.

  On the other hand, if it is determined that there is an input indicating that it is desired to start awakening support (YES in S1240), it is determined whether the input is the first time from the start of the prime mover (S1250). If it is determined that the input for requesting the start of wakefulness support is the second or subsequent count from the start of the prime mover (NO in S1250), the stimulus intensity stored for the wakeup support device with the highest evaluation score is reduced by one level. (S1260), the wake-up support is started by operating the wake-up support device (S1270).

  The evaluation score and stimulus intensity will be described. First, the evaluation score is a numerical value of the performance of each wake-up support device. The default is 0, which varies in the range of −2 to 3. This variation is realized in S1620 and S1660 of the effect determination process described later. In addition, when there are a plurality of evaluation scores having the largest evaluation score, the largest evaluation score is selected at random.

  The stimulus intensity is the intensity of the stimulus that each wake-up support device gives to the driver. In the case of the speaker 16, three levels (weak… a1dB & 1Hz, medium ... a2 (> a1) dB & 1.5Hz, strong ... a3 (> a2) dB & 2Hz) are prepared for the volume and output cycle of the warning sound. In the case of the vibration device 17, three stages (weak ... 1 Hz, medium ... 1.5 Hz, strong ... 2 Hz) are prepared for the output period of vibration. In the case of the blower 18, three levels of air volume (weak… 4 V (voltage applied to the fan motor), medium… 8 V, strong… 12 V) are prepared.

  Further, the stimulus intensity is increased or decreased in S1280 and S1640 described later, and the intensity at the end is stored in S1290 described later. In S1260 described above, reducing the stimulus intensity by one step means reducing the stimulus intensity by one step with respect to the stored stimulus intensity, and the purpose is to suppress the startle response. Since startle responses are likely to occur at the start of awakening support, reducing the stimulus intensity at the start is effective in suppressing startle responses. If the stimulus intensity is weak, it cannot be lowered any further, and the current state is maintained.

  On the other hand, if it is determined that the input indicating that the awakening support is desired is the first input from the start of the prime mover (YES at S1250), S1260 is skipped and the process proceeds to S1270. In this case, in consideration of the possibility that the driver is changing, a default intensity stimulus (for example, a medium stimulus) is adopted.

  Next to S1270, it is determined whether or not the driver has a startle response based on the captured image acquired through the camera 20 and the fluctuation of the driver's heart rate acquired through the heartbeat measuring device 40 (S1275). Specifically, when based on a photographed image, the determination is made by a method similar to the method described in the sleepiness estimation process in S110. That is, the learning data for the startle response determination is stored in advance, and the presence or absence of the startle response is determined by matching with the driver's facial expression data.

  On the other hand, when it is based on the fluctuation of the heart rate, it is determined that a startle reaction has occurred when it is detected that the increase width per unit time has become a predetermined value or more. In step S1275, determination is made based on “OR”. In other words, if the result of “a startle response” is obtained by at least one of the method based on the photographed image and the heart rate, it is determined to be YES, and if both result “no startle response”, it is determined to be NO. Yes.

  And if it determines with the driver not having the startle reaction (S1275NO), an operation process will be complete | finished. On the other hand, if it is determined that a startle reaction has occurred to the driver (S1275 YES), the stimulation intensity is lowered by one step (S1280), and the operation process is finished. The reason why the stimulation intensity is lowered is to prevent a startle response from the next time.

  On the other hand, if it is determined in S1210 that the awakening is being supported (S1210 YES), it is determined whether the sleepiness level estimated in the immediately preceding S110 is greater than or equal to a threshold value (S1285). If it determines with it being more than a threshold value (S1285YES), an operation process will be complete | finished. In other words, keep awakening support continued. On the other hand, if it is determined that the drowsiness level is less than the threshold (NO in S1285), the evaluation score of the active wakefulness support device and the currently set stimulus intensity are stored as values at the end of wakefulness support (S1290). Then, the operation of the awakening support device is stopped (S1295), and the operation process is finished. Note that the stimulus intensity stored in S1290 is used in the next S1260 as described above.

[2-3. S130 to S150 (FIG. 3)]
Returning to FIG. When the operation process is finished, it is determined whether or not the awakening is currently being supported (S130). If it is determined that the awakening is not being supported (NO at S130), the process returns to S110. On the other hand, if it is determined that wakefulness is being supported (S130 YES), after waiting for 10 seconds (S140), the drowsiness estimation device 21 executes drowsiness estimation processing (S150). Since this sleepiness estimation process is the same as that described in S110, a detailed description is omitted.

  The reason for waiting for 10 seconds in S140 is that it is inconvenient if S150 and S160 (effect determination process described later) are executed immediately after the operation process. The inconvenience will be described together with the description of the next effect determination process.

[2-4. Effect determination process (FIG. 8) and S170 (FIG. 3)]
FIG. 8 is a flowchart showing the effect determination process. First, it is determined whether or not the sleepiness level estimated in the immediately preceding S150 is greater than or equal to a threshold value (S1610). If it determines with it being less than a threshold value (S1610NO), an evaluation score will be raised by 1 (S1620) and an effect determination process will be complete | finished. If it is less than the threshold, it means that the effect of arousal support has appeared, so the evaluation score is raised.

  On the other hand, if it is determined that the drowsiness level is equal to or higher than the threshold (YES in S1610), it is determined whether the drowsiness level has been improved (S1630). That is, it is determined whether the value of the drowsiness level has been reduced, or the same or increased as compared to the previous time of S1630.

  If it is determined that the drowsiness level has not improved (NO in S1630), the stimulation intensity is increased by one level (S1640). Then, it is determined whether the effect determination process currently being executed is the first time after the awakening support process is started (S1650). If it is determined that it is the second time or later (NO in S1650), the evaluation score of the active awakening support device is lowered by 1 (S1660), and the process proceeds to S1670.

  On the other hand, if it is determined that it is the first time (YES in S1650), S1660 is skipped and the process proceeds to S1670. On the other hand, if it is determined that the drowsiness level has improved compared to the previous time (YES in S1630), S1640, S1650, and S1660 are skipped, and the process proceeds to S1670.

  Thus, S1630 to S1660 are steps for raising the stimulation intensity and lowering the evaluation score when the drowsiness level has not improved. The reason why the evaluation score is not lowered in the first effect determination process (in the case of S1650 YES) is to match with S1260. That is, in order to suppress the startle response, the stimulus intensity is lowered in S1260 and the awakening support is started. Nevertheless, if the evaluation score is lowered, it is considered that the evaluation score is underestimated. Therefore, the evaluation score is not lowered in the first effect determination process.

  Here, the reason for waiting for 10 seconds in the above-described S140 will be described. The awakening support process has a repeated structure of S110 to S170 as shown in FIG. If there is no step for waiting for a predetermined time, it is considered that the repetition cycle is very short (for example, less than 1 second). If the repetition period of the awakening support process is short, naturally, the period in which S1630 to S1660 are repeated is also short. On the other hand, the drowsiness level does not easily improve in such a short time even if the awakening support is started. That is, if there is no step to wait for a predetermined time, immediately after the awakening support process is started, the stimulation intensity becomes the strongest and the evaluation score becomes the lowest by S1630 to S1660.

  If it becomes such a result, the meaning of the step which raises / lowers a stimulus intensity and an evaluation score will fade. Therefore, in order to lengthen the repetition cycle of the awakening support process, the process waits for 10 seconds in S140. Also, the reason for waiting for 20 seconds in S170 described later is the same reason.

  Return to the step description. If it progresses to S1670, it will be determined whether the evaluation score of the active awakening assistance apparatus is below a reference value (for example, -2). If it is determined that the reference value is exceeded (NO in S1670), the effect determination process is completed while continuing the awakening support by the active awakening support device.

  On the other hand, if it determines with an evaluation score being below a reference value (S1670 YES), it will switch the awakening assistance apparatus to operate | move to the thing with the largest evaluation score (S1680). That is, the wake-up support device that has been operated so far is stopped, and the other wake-up support device with the highest evaluation score is turned on. The reason for executing S1680 is that the evaluation score has become below the reference value because the effect cannot be expected even if it continues further.

  Then, the stimulation intensity of the awakening support device stopped in S1680 is returned to the default (S1690), and the effect determination process is finished. The purpose of lowering the stimulus intensity to the default is to prevent the startle response from occurring during the next operation because the possibility that the stimulus intensity is the strongest is high when the evaluation score is below the reference value.

  Returning to FIG. When the effect determination process is completed, the process waits for 20 seconds (S170) and returns to S110. The purpose of waiting for 20 seconds is to lengthen the repetition period of the awakening support process as described above.

[3. effect]
According to the awakening support system 1, it is possible to suppress the startle response while avoiding the situation that “the stimulus is too weak and the effect of the awakening support does not appear”. In other words, the stimulus intensity of the arousal support can be converged to a desired intensity by feedback control that “the stimulus intensity is weakened if a startle reaction occurs and the stimulus intensity is increased if the awakening support effect does not appear”.

In addition, since a startle reaction is likely to occur at the start, the startle reaction can be further suppressed by weakening the stimulus intensity at the start in S1260.
Moreover, while evaluating the effect by each wake-up support device and using the evaluation for selection of the wake-up support device, the selection can be appropriately performed (S1270, S1680).

[4. Correspondence with Claims]
The correspondence between the embodiments and the claims will be described. S110 / S150 is sleepiness level estimation means, S1260 is third setting means, S1270 is awakening support means, S1275 is startle determination means, S1280 is first setting means, S1620 and S1660 are evaluation means, S1640 is second setting means, S1680 Corresponds to the software of the switching means.

[5. Other forms]
(A) In the example, when the drowsiness level did not change in S1630, the stimulation intensity was raised and the evaluation score was lowered. However, the stimulation intensity and the evaluation score are set as in the case where the drowsiness level is improved. It is not necessary to change.
(A) As a criterion for determining whether or not a startle reaction has occurred, a value obtained by digitizing the amount of sweating or the degree of muscle contraction, a blood pressure value, or other physiological indices may be used. Note that an electromyogram or the like may be used as “the value of the degree of muscle contraction”, but it may be determined based on the vibration applied to the seat of the driver's seat. This determination uses the reaction that the leg muscles contract and stand up when surprised while sitting. When such a reaction occurs, vibration (impact) is applied to the seat, and by detecting this, the presence or absence of a startle reaction can be determined.
(C) In the embodiment, it is a necessary condition for the operation of the wake-up support device that the sleepiness level above the threshold is estimated, but the wake-up support is started according to the input from the driver regardless of the sleepiness level. You may make it do. In addition, when a drowsiness level equal to or higher than the threshold value is detected, awakening support may be started regardless of the driver's desire.
(D) Although two-dimensional coordinates are used for expression data in the embodiment, three-dimensional coordinates may be used.
(E) The estimation of the drowsiness level may not be described in the embodiment, but may be another method. For example, the heart rate measured by the heart rate measuring device 40 may be used. Alternatively, statistical processing may be performed in matching between driver's facial expression data and learning data (for example, the knn method).
(F) Various values described in the embodiments (threshold level threshold etc.) may be changed.
(G) The present invention may be applied to an operator of a two-wheeled vehicle or another machine, or a user who is in a situation where he / she wants to avoid falling asleep, even if it is not mounted on an automobile.

DESCRIPTION OF SYMBOLS 1 ... Awakening support system, 10 ... Awakening support control apparatus, 16 ... Speaker, 17 ... Vibration apparatus, 18 ... Blower, 20 ... Camera, 21 ... Drowsiness estimation apparatus, 30 ... Touch panel screen, 40 ... Heart rate measuring apparatus

Claims (8)

Awakening support means for supporting the user's awakening by applying a stimulus;
Startle determination means for determining whether the user was startled by stimulation by the awakening support means based on a change in the user's physiological index;
A first setting unit that weakens the intensity of the stimulus applied by the awakening support unit when the startle determination unit determines that the user is startled;
Sleepiness level estimation means for estimating a user's sleepiness level based on the user's facial expression;
And a second setting means for increasing the intensity of the stimulus when the sleepiness level estimated by the sleepiness level estimation means tends to increase during the awakening support by the awakening support means. Support device. The wakefulness support device according to claim 1, wherein the wakefulness support means ends the wakefulness support when the sleepiness level estimated by the sleepiness level estimation means becomes less than a threshold during execution of the wakefulness support. When the awakening support by the awakening support means is resumed after it has once ended, it comprises a third setting means for setting the intensity of the stimulus applied by the awakening support means to be lower than the previous end time. The awakening support apparatus according to claim 2. The awakening support means selects and executes one of a plurality of types of waking support that can be executed,
Evaluation means for evaluating each of the plurality of types of wakefulness support based on the sleepiness level estimated by the sleepiness level estimation means;
The wake support device according to claim 2 or 3, wherein the wake support device preferentially selects wake support that is highly evaluated by the evaluation device. 5. The evaluation means, when the sleepiness level estimated by the sleepiness level estimation means tends to increase during the wakefulness support by the wakefulness support means, evaluates the wakefulness support low. Awakening support apparatus according to 1. The wakefulness according to claim 5, further comprising switching means for switching a kind of wakefulness support when the evaluation by the evaluation means for the wakefulness support falls below a standard during the wakefulness support by the wakefulness support means. Support device. When the awakening support means restarts the awakening support that has been stopped by the switching of the switching means, regardless of the intensity of the stimulus at the time of the stop, the awakening support means gives the user a stimulus with the initial strength at the start. The awakening support apparatus according to claim 6, wherein the waking support apparatus is provided. The evaluation means highly evaluates the wakefulness support when the sleepiness level estimated by the sleepiness level estimation means becomes less than a predetermined value during the wakefulness support by the wakefulness support means. The awakening support apparatus according to any one of claims 4 to 7.