JP2010187810A - Apparatus and method for doze prevention - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a doze prevention apparatus capable of optimizing stimulation given to an operator by grasping a direct effect of each stimulation clearly. <P>SOLUTION: The doze prevention apparatus detects a condition of an operator driving a vehicle by a heart beat sensor 4 and a heart beat signal processing section 12, and the awakening degree of the operator is determined from the condition of the operator by a main processing section 14. Additionally, if the apparatus determines that the awakening degree of the operator is lowered, the main processing section 14 determines the induced effect by self-action from the condition of the operator when a microphone 2, a speaker 3, and a conversation processing section 11 are controlled to give the stimulation (conversation) inducing the self-action for the operator, and controls the stimulation content (conversation) given to the operator since then, corresponding to the determined induced effect. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for detecting a person's dozing state and, when a dozing state is detected, promoting awakening and preventing the dozing.

  2. Description of the Related Art Conventionally, there has been proposed an apparatus that gives a predetermined stimulus to an operator in order to estimate the psychosomatic state of the operator and adjust the estimated psychosomatic state to a target state set for each operator (for example, a patent) Reference 1).

JP 2007-130454 A

  In the conventional technology described above, the adjustment effect of the psychosomatic state by the presented stimulus is the adjustment effect up to the target value obtained from the psychosomatic information after the stimulus presentation. Therefore, there is a problem that the direct effects of individual stimuli are not known, and excessive stimulus presentation or ineffective stimulus presentation is repeated.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and is a stimulus that is given to a person (hereinafter referred to as an operator) who performs a driving operation or the like by clearly grasping the direct effect of each stimulus. It aims to optimize.

  The present invention detects the state of the operator and determines the awakening level of the operator based on the state of the operator. And when it is determined that the awakening level of the operator is lowered, the guidance effect by the self-issued motion is based on the state of the operator when the stimulus for inducing the self-issued motion is given to the operator. Then, according to the determined inductive effect, the content of the stimulus to be given to the operator thereafter is controlled.

  According to the present invention, since the guidance effect by the self-issued movement is determined, the optimum self-issued movement guidance according to the state of the operator is performed by clearly grasping the effect of the self-issued movement induced by each stimulus. Therefore, the effect of maintaining the wakefulness of the operator with high accuracy can be obtained.

It is a block diagram shown about the composition of the dozing prevention device shown as a 1st embodiment of the present invention. It is a figure shown about the vehicle arrangement | positioning relationship of the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing basic operation | movement in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing the measurement process of a heart rate signal in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a figure for demonstrating the content of the measurement process of the heart rate signal in the dozing prevention apparatus shown as 1st Embodiment of this invention, (a) is a time series of heart rate fluctuation dispersion | variation when an operator's arousal level falls. (B) is a figure which shows the time-sequential change of instantaneous heart rate when an operator's arousal level falls. It is a flowchart shown about a series of procedures at the time of performing a dialogue process in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a figure shown about the specific example of the dialog set information used by the dialog processing in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing a heartbeat and a self-issued dynamic effect confirmation process in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a figure for demonstrating the content of the heart rate and the self-issued movement effect confirmation process in the snooze prevention apparatus shown as 1st Embodiment of this invention, (a) makes a conversation load high and makes a self-issued movement with respect to an operator. (B) is a diagram showing the time-series change in the instantaneous heart rate when the self-issued movement is induced to the operator by lowering the dialogue load. is there. It is a flowchart shown about a series of procedures at the time of performing a self-issued movement setting value change process in the dozing prevention apparatus shown as 1st Embodiment of this invention. It is a figure for demonstrating the content of the self-issued movement setting value change process in the dozing prevention apparatus shown as 1st Embodiment of this invention, (a) is a result of having induced the self-issued movement to the operator whose state is favorable, FIG. 5B shows a time-series change of the instantaneous heart rate when the inductive effect is not obtained, and FIG. 6B shows the instantaneous heart rate when the inductive effect is not obtained as a result of inducing self-issued motion to an operator whose condition is not good. It is a figure which shows the time-sequential change of a number. It is a block diagram shown about the structure of the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a figure shown about the vehicle arrangement | positioning relationship of the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing basic operation | movement in the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing a blood-pressure-signal measurement process in the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a figure for demonstrating the content of the blood pressure signal measurement process in the snoozing prevention apparatus shown as 2nd Embodiment of this invention, (a) is in the time difference between the minimum blood pressure values when an operator's arousal level falls. The time series change of a dispersion | distribution is shown, (b) is a figure which shows the time series change of the minimum blood pressure value when an operator's arousal level falls. It is a flowchart shown about a series of procedures at the time of performing a muscular exercise | movement process in the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing a blood pressure and the self-issued dynamic effect confirmation process in the dozing prevention apparatus shown as 2nd Embodiment of this invention. It is a figure for demonstrating the content of the blood pressure and the self-issued movement effect confirmation process in the snoozing prevention apparatus shown as 2nd Embodiment of this invention, (a) makes muscle exercise load high and is spontaneous with respect to an operator. The minimum blood pressure value (b) when the action is induced is a diagram showing a time-series change in the minimum blood pressure value when the muscle exercise load is lowered and the self-issued movement is induced for the operator. It is a figure for demonstrating the content of the self-issued movement setting value change process in the dozing prevention apparatus shown as 2nd Embodiment of this invention, (a) is a result of having induced the self-issued movement to the operator whose state is favorable, The time series change of the minimum blood pressure value when the induction effect is not obtained is shown, and (b) shows the minimum blood pressure when the induction effect is not obtained as a result of inducing self-issued movement to an operator who is not in a good state. It is a figure which shows the time-sequential change of a value. It is a block diagram shown about the structure of the dozing prevention apparatus shown as 3rd Embodiment of this invention. It is a figure shown about the vehicle arrangement | positioning relationship of the dozing prevention apparatus shown as 3rd Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing basic operation | movement in the dozing prevention apparatus shown as 3rd Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing a biological signal measurement process in the dozing prevention apparatus shown as 3rd Embodiment of this invention. It is a block diagram shown about the structure of the dozing prevention apparatus shown as 4th Embodiment of this invention. It is a figure shown about the vehicle arrangement | positioning relationship of the dozing prevention apparatus shown as 4th Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing basic operation | movement in the dozing prevention apparatus shown as 4th Embodiment of this invention. It is a flowchart shown about a series of procedures at the time of performing a self-issued movement guidance process in the dozing prevention apparatus shown as 4th Embodiment of this invention.

[First Embodiment]
[Configuration of dozing prevention device]
As shown in FIG. 1, the snoozing prevention apparatus shown as the first embodiment of the present invention includes a control device 1 that controls the snoozing prevention apparatus in an integrated manner, and an utterance of an operator as a person who performs an operation / operation. A microphone 2 which is an operator utterance input means for detecting and inputting contents, a speaker 3 which is an operator call means for presenting a call and warning by a dialogue from the control device 1, and a heartbeat of the operator And a heart rate sensor 4 which is a heart rate signal detecting means for detecting a signal. In the following description, a scene in which a vehicle is driven as an example of an operation / operation performed by a person will be described as an embodiment, but as an operation / operation performed by a person, ship steering, aircraft operation, operation of an electronic computer may be performed. In addition, for example, an operation in which a person writes a character or the like on paper is also included.

  The control device 1 includes a dialogue processing unit 11 that is a dialogue control unit that controls the self-issued movement by dialogue with the operator, a heart rate signal processing unit 12 that is a heart rate signal analysis unit that calculates the heart rate information of the operator, and a main process A recording device 13 that records information input / output to / from the unit 14 and a main processing unit 14 that is a control unit that performs overall control of work for inducing the self-issued motion to the operator. The main processing unit 14 is actually composed of a ROM, a RAM, a CPU, and the like. However, the main processing unit 14 has a function that can be realized by performing processing according to a control program for preventing the snoozing stored in the ROM. It will be described as a block.

  The main processing unit 14 performs overall control of the work for inducing the self-issued motion to the operator based on the state of arousal level of the operator obtained from the heart rate information of the operator calculated by the heart rate signal processing unit 12. When the main processing unit 14 determines that the wakefulness level of the operator has decreased, the main processing unit 14 controls the dialogue processing unit 11 to cause the operator to perform a dialogue as a self-issued motion. Further, the main processing unit 14 causes the recording device 13 to record the heart rate information supplied from the heartbeat signal processing unit 12.

  The heartbeat signal processing unit 12 performs predetermined signal processing using the heartbeat signal detected by the heartbeat sensor 4 and calculates the heart rate information of the operator. Then, the heart rate signal processing unit 12 calculates a wakefulness level decrease determination value for determining a decrease in the wakefulness level of the operator based on the calculated heart rate information. The heartbeat signal processing unit 12 supplies the calculated heart rate information and the arousal level decrease determination value to the main processing unit 14.

  The dialogue processing unit 11 performs control when allowing the operator to perform dialogue as a self-issued movement via the microphone 2 and the speaker 3 based on the dialogue set information read from the recording device 13 according to the control of the main processing unit 14. .

  The recording device 13 records information such as heart rate information and arousal level decrease determination value input to the main processing unit 14. In addition, the recording device 13 records dialog set information that the operator performs as a self-issued motion. This dialogue set information is read by the dialogue processing unit 11 under the control of the main processing unit 14.

  Such a control device 1, a heart rate sensor 4, a microphone 2, and a speaker 3 are disposed in the vehicle interior as shown in FIG. 2, for example. That is, for example, the control device 1 is implemented as software in a navigation system mounted on a vehicle, and is built in the instrument panel 23. The control device 1 may be implemented by hardware as long as it can provide the control according to the present invention, and is not particularly limited to this form.

  The heart rate sensor 4 is built in the seat 24 so as to hit the back of the operator seated in the driver's seat. Thereby, the heart rate sensor 4 can stably detect the heart rate signal of the operator regardless of the operation posture of the operator. Further, the microphone 2 is built in the center of the steering wheel 21 so that the operator can easily input voice. Furthermore, the speaker 3 is installed on the inner surface of the door panel 22 on the driver's seat side so that it is easy to listen to calls and warnings through dialogue from the control device 1.

[Operation of dozing prevention device]
"basic action"
Such a dozing prevention apparatus including each unit performs an operation for preventing an operator from falling asleep according to a series of procedures as shown in FIG.

  First, as shown in FIG. 3, the snoozing prevention device is an initial value of a wakefulness reduction determination reference value that can be arbitrarily set as a threshold value for determining whether or not to output a snoozing prevention alarm by the control device 1 in step S <b> 1. Do.

  In the next step S <b> 2, the control device 1 initializes a self-issued movement setting value that defines a load amount of the self-issued movement.

  In the next step S3, the control device 1 initializes a guide effect determination reference value that can be arbitrarily set as a threshold value for determining the guide effect by the self-issued movement.

  Subsequently, in step S <b> 4, the dozing prevention apparatus calculates heartbeat signal information based on the heartbeat signal detected by the heartbeat sensor 4 by the heartbeat signal processing unit 12. Then, the heartbeat signal processing unit 12 converts the calculated heartbeat signal information into a wakefulness decrease determination value that can be compared with the above-described wakefulness decrease determination reference value. The heartbeat signal processing unit 12 supplies the heartbeat signal information and the arousal level decrease determination value to the main processing unit 14. The process in step S4 will be described in detail later.

  Subsequently, in step S5, the main processing unit 14 compares the arousal level decrease determination value acquired in step S4 with the arousal level decrease determination reference value. If the arousal level decrease determination value is smaller than the arousal level decrease determination reference value, the main processing unit 14 determines that the operator's arousal level has not decreased and repeats the processing from step S4. On the other hand, when the wakefulness level decrease determination value is equal to or greater than the wakefulness level decrease determination reference value, the main processing unit 14 determines that the wakefulness level of the operator has decreased, and proceeds to step S6.

  Then, in step S6, the main processing unit 14 controls the dialogue processing unit 11 to cause the operator to perform a dialogue as a self-issued motion, and urges the operator to awaken. The process in step S6 will be described in detail later.

  Subsequently, in step S7, the heart rate signal processing unit 12 determines the heart rate based on the heart rate signal detected by the heart rate sensor 4 in order to confirm the effect that the wakefulness level is improved by the self-issued motion performed in step S6. Signal information is calculated, and the calculated heartbeat signal information is converted into a guidance effect determination value that can be compared with the above-described guidance effect determination reference value. The heartbeat signal processing unit 12 supplies the heartbeat signal information and the guidance effect determination value to the main processing unit 14. The process in step S7 will be described in detail later.

  Subsequently, in step S8, the main processing unit 14 compares the induced effect determination value with the induced effect determination reference value, and confirms the effect of the self-issued action performed in step S6. When the guidance effect determination value is greater than or equal to the guidance effect determination reference value, the main processing unit 14 repeats the processing from step S4 on the assumption that there is a guidance effect by the self-issued movement. On the other hand, when the induced effect determination value is smaller than the induced effect determination reference value, the main processing unit 14 determines that the induced effect due to the self-issued movement is small and shifts the process to step S9.

  In step S9, the main processing unit 14 changes the self-issued movement setting value and repeats the processing from step S6. The process in step S9 will be described in detail later.

  The dozing prevention apparatus can perform an operation for preventing an operator from falling asleep according to such a series of procedures. Usually, there are operators who are easy to react to a predetermined stimulus and operators that are difficult to react, but in the conventional technology, when the current operator's state is a sleep state and the target state is an awake state, For operators who are responsive to stimuli, it is determined that the target value has not been reached, so meaningless stimuli will continue to be given for a predetermined time, and for operators who are less responsive to stimuli Even if the target value is reached, it is considered that the operator is sensitive to the stimulus, and discomfort may be caused by the stimulus being applied for a predetermined time. Since the dozing prevention apparatus shown as this embodiment performs feedforward control in order to give a stimulus after confirming the induction effect by the self-issued movement, the stimulus given to the operator can be optimized.

“Details of Heart Rate Signal Measurement Process (Step S4)”
Next, details of the heartbeat signal measurement process in step S4 will be described with reference to FIG.

  First, as shown in FIG. 4, the heartbeat signal processing unit 12 detects an operator's heartbeat signal from the heartbeat sensor 4 in step S <b> 10. The detected heartbeat signal is recorded in the recording device 13 as a detection history under the control of the main processing unit 14.

  Subsequently, in step S11, the heartbeat signal processing unit 12 calculates an instantaneous heart rate based on the heartbeat signal detected in step S10 and the heartbeat signal history recorded in the recording device 13.

  Subsequently, in step S12, the heartbeat signal processing unit 12 calculates a heartbeat fluctuation variance RRV based on the heartbeat signal detected in step S10 and the heartbeat signal history recorded in the recording device 13.

  Then, in step S13, the heartbeat signal processing unit 12 calculates a wakefulness reduction determination value based on the instantaneous heart rate calculated in step S11 and the heartbeat fluctuation variance RRV calculated in step S12. . The calculation of the arousal level decrease determination value is performed as follows.

  FIG. 5 (a) shows a time-series change in the variance RRV of heart rate fluctuation when the operator's arousal level is lowered, and FIG. 5 (b) shows the instantaneous heart rate when the operator's arousal level is lowered. Shows time-series changes. Looking at these two graphs, there is a section where the instantaneous heart rate and the heartbeat fluctuation variance RRV exceeding the arousal level lowering criterion value occur in the central part of the figure. In this section, the wakefulness of the operator is reduced, and the operator is in a state of conflict with sleepiness. That is, when the operator feels drowsiness during driving, the operator performs a resistance operation such as extension or body movement in an attempt to overcome the sleepiness, and according to this resistance operation, the instantaneous heart rate increases and the heart rate fluctuation RRV Also rises. This phenomenon appears in the section described above.

  Therefore, the heart rate signal processing unit 12 compares the instantaneous heart rate calculated in step S11 and the variance RRV of the heart rate fluctuation calculated in step S12 with the arousal level reduction determination reference value, and reduces the arousal level. The difference value from the determination reference value is added to the arousal level decrease determination value. Thereby, an operator's arousal level fall state is computable.

  The heartbeat signal processing unit 12 can calculate the arousal level decrease determination value according to such a series of procedures.

“Details of Dialogue Processing (Step S6)”
Next, details of the dialogue processing in step S6 in FIG. 3 will be described with reference to FIG.

  First, as shown in FIG. 6, the main processing unit 14 causes the dialogue processing unit 11 to read dialogue set information that guides the operator as a self-issued movement from the recording device 13 in step S <b> 20.

  Here, for example, as shown in FIG. 7, the dialogue set information is composed of dialogue sentences such as contents that present a question sentence such as a quiz to the operator and a response to an answer spoken by the operator to the operator. Is done. In FIG. 7, a plurality of (maximum 4 and minimum 2) words from a preset word group are interactively presented to the operator, and the size ranking (nth order) of the objects indicated by the words is shown. , Large / Small) as a quiz. In such a dialogue set, the target that is assumed to be uttered by the operator is limited to the group of words to be presented, so the system for speech recognition can be simplified.

  When the main processing unit 14 causes the dialogue processing unit 11 to read such dialogue set information, the load of the dialogue set read into the dialogue processing unit 11 in step S20 based on the self-issued movement setting value in step S21. Determine the amount (difficulty).

  Specifically, in the case of the dialogue set shown in FIG. 7, the maximum number of words to be given is four, and the magnitude order for which questions are given is “nth largest / smaller”. This is the maximum amount of conversation load in the example of this conversation set to be presented. Therefore, the main processing unit 14 decreases the number of words when the self-issued movement setting value is small. Thereby, it is possible to reduce the storage load amount as the dialogue load amount of the dialogue set. In addition, the main processing unit 14 calculates the conversation load amount of the conversation set by changing the magnitude order of the questions to “largest / smallest” assuming that the number of words to be presented is fixed. The amount of load can be reduced. Furthermore, the main processing unit 14 can change not only the storage load amount but also the calculation load amount by adjusting the number of words to be given as the conversation load amount in the example of this dialogue set. The example of the dialogue set shown in FIG. 7 is a dialogue set that allows an operator to perform a self-issued action by dialogue and adjust the calculation load amount and the storage load amount as the dialogue load amount. In addition to this example, the dialogue set can cause the operator to perform a self-issued action by dialogue and adjust the calculation load amount and / or the storage load amount as the dialogue load amount. Anything is acceptable.

  Subsequently, in step S22, the main processing unit 14 provides the operator with a dialogue based on the dialogue set read in the dialogue processing unit 11 in step S20 according to the dialogue load set in step S21. Build a question to call.

  Then, the main processing unit 14 controls the dialogue processing unit 11 in step S23 to call the question sentence constructed in step S22 to the operator via the speaker 3. In response, the operator will speak the answer.

  When the answer is uttered by the operator, the main processing unit 14 controls the dialogue processing unit 11 to input the utterance of the operator via the microphone 2 in step S24.

  Subsequently, in step S25, the main processing unit 14 determines the utterance content of the operator input in step S24.

  Here, when the utterance content of the operator is a correct answer to the question called to by the operator in step S23, the main processing unit 14 proceeds to step S27, and the dialogue processing unit 11 is changed. Control is made to indicate to the operator via the speaker 3 that the answer is correct, and the series of processing ends. If the utterance content of the operator is an incorrect answer to the question called by the operator in step S23, the main processing unit 14 proceeds to step S28, and the dialog processing unit 11 is Control is performed to indicate to the operator via the speaker 3 that the answer is incorrect or the correct answer content, and the series of processing ends. Further, when the utterance input fails because the operator does not speak within the predetermined time in step S24, the main processing unit 14 proceeds to step S26 and controls the dialogue processing unit 11. Then, the operator is called through the speaker 3 so as to speak again, and the processing from step S23 is repeated.

  The main processing unit 14 can cause the operator to perform a dialogue as a self-issued motion according to such a series of procedures.

“Details of Heart Rate / Self-issued Motion Effect Confirmation Process (Step S7)”
Next, the details of the heartbeat / self-issued movement effect confirmation process in step S7 in FIG. 3 will be described with reference to FIG.

  First, as shown in FIG. 8, when the heartbeat signal processing unit 12 detects an operator's heartbeat signal from the heartbeat sensor 4 in step S30, the heartbeat signal processing unit 12 calculates an instantaneous heart rate in step S31. Note that the processes in steps S30 and S31 are performed in the same manner as the heartbeat signal measurement process in step S4 in FIG.

  In step S32, the heart rate signal processing unit 12 calculates a guidance effect determination value based on the instantaneous heart rate calculated in step S31. The calculation of the guidance effect determination value is performed as follows.

  FIG. 9 (a) shows the time series change of the instantaneous heart rate when the dialogue load is increased and the self-issued movement is induced to the operator, and FIG. 9 (b) shows the dialogue load is lowered. The time-series change of the instantaneous heart rate when the self-issued movement is induced to the operator is shown. Looking at these two graphs, when the conversation load is high, large heart rate increases A1, A2, and A3 are detected during the period in which the self-issued movement is performed, whereas the conversation load is small. It can be seen that changes in heart rate increases B1, B2 and B3 are small. That is, the operator tends to increase the instantaneous heart rate in the case of performing a dialogue with a high dialogue load than in the case of performing a dialogue with a low dialogue load.

  Therefore, the heartbeat signal processing unit 12 can calculate the induction effect by the self-issued movement by comparing the amount of heart rate increase during the self-issued movement period. In addition, since the heart rate increase during this self-issued motion period uses the difference between the instantaneous heart rate during the self-issued motion period and the instantaneous heart rate before and after the self-issued motion, FIG. 5 (a) and FIG. It can be distinguished from the increase in heart rate due to the decrease in the arousal level shown.

  The heartbeat signal processing unit 12 can confirm the effect of improving the state of arousal level by the self-issued motion according to such a series of procedures.

“Details of Self-issued Set Value Change Process (Step S9)”
Next, details of the self-issued movement setting value change process in step S9 in FIG. 3 will be described with reference to FIG.

  First, as shown in FIG. 10, in step S40, the main processing unit 14 determines whether or not the currently set self-issued movement setting value is a settable maximum value.

  Here, the main process part 14 transfers a process to step S42, when the now self-issued movement setting value is not the maximum value. In this case, the current self-issued movement setting value has a small guidance effect on the operator. Therefore, in step S42, the main processing unit 14 increases the self-issued movement set value by one step, and ends the series of processes.

  On the other hand, the main process part 14 transfers a process to step S41, when the now self-issued movement setting value is the maximum value. In this case, since the current self-issued movement setting value is the maximum value, even if the self-issued movement of the maximum load amount to be induced is not expected to improve the arousal level.

  11 (a) and 11 (b), when the self-issued motion is induced to the operator, the instantaneous heart rate when the induced effect is not obtained even though the self-issued motion set value is maximum. Show the trend. FIG. 11A shows a time-series change in the instantaneous heart rate when the operator's state is good, and FIG. 11B shows the instantaneous when the operator's state is not good because the arousal level is low. It is a time series change of heart rate. Looking at these two graphs, large heart rate increases A1, A2, A3 are seen when the operator's condition is good, but when the operator's condition is not good with a low degree of arousal, The rises B1, B2, and B3 become smaller. That is, the guidance effect determination value calculated in step S7 in FIG. 3 is a small value.

  Therefore, when the state of the operator is not good because the degree of awakening is not good, the main processing unit 14 proceeds to step S41, controls the dialogue processing unit 11, and issues an alarm via the speaker 3. This is presented to the operator, prompts the driver to stop driving, and the series of processes is terminated.

  The main processing unit 14 can appropriately change the self-issued movement setting value according to such a series of procedures.

[Effect of the first embodiment]
As described above in detail, the dozing prevention device shown as the first embodiment of the present invention performs the self-issued motion to the operator when it is determined that the arousal level is lowered based on the state of the operator. Gives stimuli to induce. Then, the guidance effect by the self-issued movement is determined based on the state of the operator detected after giving the stimulus to the operator, and the stimulus content given to the operator is controlled according to the guidance effect.

  Therefore, according to this snooze prevention apparatus, the effect of the self-issued movement induced by each stimulus can be clearly grasped by determining the induction effect of the self-issued movement. As a result, it is possible to induce optimal self-issued movement according to the driver's state without repeating excessive stimulus presentation or ineffective stimulus presentation, and the state in which the driver's arousal level is reduced By giving a stimulus with, a high driver arousal level maintaining effect can be obtained.

  In addition, this dozing prevention device determines the induction effect by the self-issued movement based on the heartbeat state of the operator detected after stimulating the operator. Thus, in this dozing prevention apparatus, since only a single index called a heartbeat state is detected, it is possible to more easily measure the state of the operator.

  Further, this doze prevention device records the history of the heartbeat signal of the operator in the recording device 13, and based on the heartbeat signal history recorded in the recording device 13, the amount of change in the instantaneous heart rate and the variance RRV of heart rate fluctuations. Analysis is performed, and the analysis result is output as a heartbeat state. In this way, according to this doze prevention device, since only the change amount of the instantaneous heart rate and the variance RRV of the heart rate fluctuation is extracted from the heart rate signal and output, information on the reduction in the arousal level of the operator based on the heart rate signal is output. Can be obtained efficiently.

  Furthermore, this doze prevention device determines a decrease in the arousal level of the operator based on the amount of change in the analyzed instantaneous heart rate and heart rate fluctuation variance RRV, so that the heart rate rises and the heart rate fluctuation variance RRV increases. It is possible to detect a state in which the operator is struggling with sleepiness. Therefore, according to this snoozing prevention device, it is possible to detect a state of reduced arousal level that is not uncomfortable for the operator.

  Further, according to this snooze prevention device, since the guidance effect by the self-issued movement is determined based on the tendency of the operator to increase the heart rate detected according to the induced self-issued movement, the self-issued movement suitable for the condition of the operator Can be selected and guided.

  In addition, this doze prevention device stimulates the operator to instruct the operator to perform the self-issued action by the dialogue, and the dialogue content as the self-issued motion performed by the operator corresponds to the instruction. Depending on whether or not there is, the amount of conversation load given as a stimulus is changed. As described above, according to the snoozing prevention apparatus, since the self-issued movement by the dialogue can be guided to the operator, it is possible to have an affinity for the self-issued movement guided by the operator.

  Furthermore, the dozing prevention device changes the load amount of the self-issued motion induced by the operator by changing the instruction amount of the stimulus given to the operator according to the determination result of the guidance effect, Adjust the induction effect. Specifically, the dozing prevention device changes the at least one of the memory load amount or the calculation load amount necessary for establishing the dialogue given to the operator as a stimulus in accordance with the determination result of the guidance effect. Change the load amount of the self-issued movements that are guided by, and adjust the induction effect of the self-issued movements. In this way, according to this snooze prevention device, only the memory load amount and the calculation load amount are used to change the load amount of the self-issued motion by the dialogue, so that the dialogue induced as the self-issued motion is established. A necessary amount of information can be suppressed.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  The snoozing prevention apparatus shown as the second embodiment determines a decrease in arousal level based on an operator's blood pressure, and induces a self-issued movement by muscle movement rather than a dialogue to the operator. Therefore, in the second embodiment, the same parts as those described in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

[Configuration of dozing prevention device]
As shown in FIG. 12, the snoozing prevention device shown as the second embodiment of the present invention detects a muscle motion of a display 31 that is a muscle motion presenting means for displaying a self-issued motion state due to muscle motion to the operator, and an operator's muscle motion. A pressure sensor 32 that is a muscular motion detection means for detecting the blood pressure signal and a blood pressure sensor 33 that is a blood pressure signal detection means for detecting a blood pressure signal of the operator.

  The control device 1 includes a main processing unit 14 that is a control unit that performs overall control of work for inducing self-issued movements to an operator, a blood pressure signal processing unit 16 that is a blood pressure signal analysis unit that calculates blood pressure information of the operator, A muscle movement processing unit 15 which is a muscle movement control means for controlling the self-issued movement caused by the muscle movement with respect to the person, and a recording device 13 for recording information inputted to and outputted from the main processing unit 14.

  The main processing unit 14 comprehensively controls the work for inducing the self-issued motion to the operator based on the operator's arousal level obtained from the blood pressure information of the operator calculated by the blood pressure signal processing unit 16. When the main processing unit 14 determines that the awakening level of the operator is decreasing, the main processing unit 14 controls the muscle exercise processing unit 15 to cause the operator to perform muscle exercise as a self-issued motion. Further, the main processing unit 14 causes the recording device 13 to record the blood pressure information supplied from the blood pressure signal processing unit 16.

  The blood pressure signal processing unit 16 calculates the blood pressure information of the operator based on the blood pressure signal detected by the blood pressure sensor 33. Then, the blood pressure signal processing unit 16 calculates an operator's arousal level decrease determination value based on the calculated blood pressure information. The blood pressure signal processing unit 16 supplies the calculated blood pressure information and the arousal level decrease determination value to the main processing unit 14.

  The muscle exercise processing unit 15 is configured to cause the operator to perform muscle exercise as a self-issued movement via the display 31 and the speaker 3 based on the muscle exercise set information read from the recording device 13 according to the control of the main processing unit 14. Take control. Note that the muscle movement as the self-issued movement by the operator is detected by the pressure sensor 32, and the pressure signal is supplied to the main processing unit 14.

  The recording device 13 records information such as blood pressure information and arousal level decrease determination value input to the main processing unit 14. In addition, the recording device 13 records muscle exercise set information that the operator performs as a self-issued motion. This muscle exercise set information is read out by the muscle exercise processing unit 15 under the control of the main processing unit 14.

  Such a control device 1, blood pressure sensor 33, pressure sensor 32, display 31, and speaker 3 are disposed in the vehicle interior as shown in FIG. 13, for example. That is, similarly to the control device 1, the control device 1 is implemented as software in a navigation system mounted on a vehicle or by predetermined hardware. The blood pressure sensor 33 is attached to the wrist of the operator in order to stably detect the blood pressure signal of the operator regardless of the operation posture of the operator. Furthermore, the pressure sensor 32 is installed on the surface of the vehicle footrest. Thereby, the operator can perform the self-issued movement by the muscular movement without hindering the driving operation. In addition, the pressure sensor 32 may be installed in any place as long as it can provide the self-issued movement by the muscular movement without hindering the driving operation of the operator. Furthermore, the display 31 can be a liquid crystal display for a navigation system mounted on a vehicle. The speaker 3 is installed on the inner surface of the door on the driver's seat side so that an alarm from the control device 1 can be easily heard.

[Operation of dozing prevention device]
"basic action"
The dozing prevention apparatus including such units performs an operation for preventing an operator from falling asleep according to a series of procedures as shown in FIG.

  First, as shown in FIG. 14, the dozing prevention device performs the same processing as step S <b> 1 to step S <b> 3 in FIG. Initialize the effect criterion value.

  In the next step S51, the blood pressure signal processing unit 16 calculates blood pressure signal information based on the blood pressure signal detected by the blood pressure sensor 33. Then, the blood pressure signal processing unit 16 converts the calculated blood pressure signal information into a wakefulness level decrease determination value that can be compared with the above-described wakefulness level decrease determination reference value. The blood pressure signal processing unit 16 supplies the blood pressure signal information and the arousal level decrease determination value to the main processing unit 14. The process in step S51 will be described in detail later.

  Subsequently, the main processing unit 14 performs the same process as step S5 in FIG. 3, and when the arousal level lowering determination value is smaller than the arousal level lowering determination reference value, the operator's arousal level is not decreased. And the process from step S51 is repeated. On the other hand, when the wakefulness level decrease determination value is equal to or greater than the wakefulness level decrease determination reference value, the main processing unit 14 determines that the wakefulness level of the operator has decreased, and proceeds to step S52.

  Then, in step S52, the main processing unit 14 controls the muscle exercise processing unit 15 to cause the operator to perform muscle exercise as a self-issued motion, thereby prompting the operator to wake up. The process in step S52 will be described in detail later.

  Subsequently, in step S53, the blood pressure signal processing unit 16 checks the blood pressure signal based on the blood pressure signal detected by the blood pressure sensor 33 in order to confirm the effect of improving the arousal level state by the self-issued motion performed in step S52. Information is calculated, and the calculated blood pressure signal information is converted into an induction effect determination value that can be compared with the above-described induction effect determination reference value. The blood pressure signal processing unit 16 supplies the blood pressure signal information and the guidance effect determination value to the main processing unit 14. The process in step S53 will be described in detail later.

  After that, the main processing unit 14 performs the same processing as Step S8 and Step S9 in FIG.

  The dozing prevention apparatus can perform an operation for preventing an operator from falling asleep according to such a series of procedures. In addition, when the dozing prevention device also detects the heart rate information of the operator, for example, even if only the blood pressure information is used for the determination of the operator's arousal level, the heart rate information is used for the determination of the induction effect. Both blood pressure information and blood pressure information may be used, and the indicators used for determination of arousal level reduction and determination of induction effect may not be the same.

“Details of Blood Pressure Signal Measurement Process (Step S51)”
Next, details of the blood pressure signal measurement process in step S51 will be described with reference to FIG.

  First, as shown in FIG. 15, the blood pressure signal processing unit 16 detects an operator's blood pressure signal from the blood pressure sensor 33 in step S60. The detected blood pressure signal is recorded in the recording device 13 as a detection history under the control of the main processing unit 14.

  Subsequently, in step S61, the blood pressure signal processing unit 16 calculates a minimum blood pressure value based on the blood pressure signal detected in step S60 and the blood pressure signal history recorded in the recording device 13.

  Subsequently, in step S62, the blood pressure signal processing unit 16 calculates a variance in the time difference between the minimum blood pressure values based on the blood pressure signal detected in step S60 and the blood pressure signal history recorded in the recording device 13. . That is, the blood pressure detected continuously in time is a signal having a waveform linked to the motion of the heart. The variance in time difference between diastolic blood pressure values is a value indicating such waveform variation, and means the variance in time difference between peaks of diastolic blood pressure values.

  In step S63, the blood pressure signal processing unit 16 determines the arousal level decrease determination value based on the minimum blood pressure value calculated in step S61 and the variance in the time difference between the minimum blood pressure values calculated in step S62. Is calculated. The calculation of the arousal level decrease determination value is performed as follows.

  FIG. 16 (a) shows a time-series change in variance in the time difference between the minimum blood pressure values when the operator's arousal level decreases, and FIG. 16 (b) shows the minimum when the operator's arousal level decreases. The time series change of a blood pressure value is shown. Looking at these two graphs, there is a section in which a variance occurs in the time difference between the minimum blood pressure value and the minimum blood pressure value exceeding the arousal level decrease determination reference value in the central portion indicated by the dotted line in the figure. In this section, the wakefulness of the operator is reduced, and the operator is in a state of conflict with sleepiness. That is, when the operator feels sleepy while driving, the blood pressure decreases, and accordingly, the minimum blood pressure value increases, and the variance in the time difference between the minimum blood pressure values also increases. This phenomenon appears in the section described above.

  Therefore, the blood pressure signal processing unit 16 compares the diastolic blood pressure value calculated in step S61 and the variance in the time difference between the diastolic blood pressure values calculated in step S62 with the arousal level decrease determination reference value. By adding a difference value from the arousal level decrease determination reference value to the arousal level decrease determination value, the operator's arousal level decreased state can be calculated.

  The blood pressure signal processing unit 16 can calculate the arousal level decrease determination value according to such a series of procedures.

“Details of Muscle Movement Processing (Step S52)”
Next, the details of the muscle exercise process in step S52 in FIG. 14 will be described with reference to FIG.

  First, as illustrated in FIG. 17, the main processing unit 14 causes the muscle exercise processing unit 15 to read muscle exercise set information to be guided to the operator as a self-issued movement from the recording device 13 in step S <b> 70.

  Here, the muscle exercise set information is composed of a depression pressure with respect to the pressure sensor 32 installed on the surface of the vehicle footrest and the depression time at the specified pressure.

  When the main processing unit 14 causes the muscle exercise processing unit 15 to read such muscle exercise set information, the muscle read into the muscle exercise processing unit 15 in step S70 based on the self-issued movement setting value in step S71. Determine the amount of exercise set load. Specifically, the main processing unit 14 increases the input pressure threshold value and the force presentation time for the pressure sensor 32 in order to cause the operator to perform greater muscle movement as the self-issued movement setting value is larger.

  Subsequently, in step S72, the main processing unit 14 performs muscle exercise based on the muscle exercise set read in the muscle exercise processing unit 15 in step S70 in accordance with the muscle exercise load amount set in step S71. Information to be presented to the operator via the display 31 is constructed as a presentation.

  In step S73, the main processing unit 14 controls the muscle exercise processing unit 15 to display the information constructed in step S72 to the operator via the display 31. In addition, the main processing unit 14 controls the muscle exercise processing unit 15 to reproduce music notifying that the start of muscle exercise has been displayed via the speaker 3. In response to this, the operator starts muscle exercise.

  When muscle motion is started by the operator, the main processing unit 14 controls the muscle motion processing unit 15 to input the muscle motion of the operator from the pressure sensor 32 in step S74.

  Subsequently, in step S75, the main processing unit 14 determines whether or not the operator's muscle exercise result input in step S74 is the appropriate exercise set in step S71.

  Here, when the muscular motion of the operator is appropriate, the main processing unit 14 proceeds to step S77 and controls the muscular motion processing unit 15 to succeed in appropriate muscular motion input. A display indicating the effect is presented to the operator via the display 31, and further music that presents the input success is reproduced via the speaker 3, and the series of processing ends. If the operator's muscle movement is inappropriate, the main processing unit 14 proceeds to step S76, and controls the muscle movement processing unit 15 to fail the appropriate muscle movement input. A display indicating the effect is presented to the operator via the display 31 and, further, the music presenting the input failure is reproduced via the speaker 3, and then the processing from step S73 is repeated.

  The main processing unit 14 can cause the operator to perform muscle exercise as a self-issued motion according to such a series of procedures.

“Details of Blood Pressure / Self-issued Movement Effect Confirmation Process (Step S53)”
Next, the details of the blood pressure / self-issued movement effect confirmation process in step S53 in FIG. 14 will be described with reference to FIG.

  First, as shown in FIG. 18, when the blood pressure signal processing unit 16 detects an operator's blood pressure signal from the blood pressure sensor 33 in step S80, the blood pressure signal processing unit 16 calculates a minimum blood pressure value in step S81. Note that the processing in step S80 and step S81 is performed in the same manner as the blood pressure signal measurement processing in step S51 in FIG.

  In step S82, the blood pressure signal processing unit 16 calculates an induction effect determination value based on the minimum blood pressure value calculated in step S81. The calculation of the guidance effect determination value is performed as follows.

  FIG. 19A shows a time-series change of the minimum blood pressure value when the muscle exercise load is increased to induce the self-issued movement to the operator, and FIG. 19B shows the muscle exercise load reduced. Then, the time series change of the minimum blood pressure value when the self-issued movement is induced to the operator is shown. Looking at these two graphs, when the muscle exercise load is high, large minimum blood pressure rises A1, A2, and A3 are detected during the period in which the self-issued movement is performed, whereas the muscle exercise load is When is small, it can be seen that changes in the minimum blood pressure rises B1, B2, and B3 are small. That is, the operator tends to increase the minimum blood pressure value when performing muscle exercise with a high load amount than when performing muscle exercise with a low load amount.

  Therefore, the blood pressure signal processing unit 16 can calculate the induction effect by the self-issued movement by comparing the amount of increase in the minimum blood pressure value during the self-issued movement period. Note that the increase in the minimum blood pressure value during the self-issued exercise period uses the difference between the minimum blood pressure value within the self-issued exercise period and the minimum blood pressure value before and after the self-issued exercise period, and therefore, FIG. 16A and FIG. It can be distinguished from the increase in the minimum blood pressure due to the decrease in the arousal level shown in.

  The blood pressure signal processing unit 16 can confirm the effect of improving the arousal level state by the self-issued motion according to such a series of procedures.

  20 (a) and 20 (b), when the self-issued motion is induced to the operator, the minimum blood pressure when the induced effect is not obtained even though the self-issued motion set value is maximum. Indicates the value trend. FIG. 20A shows a time series change in the minimum blood pressure value when the operator's state is good, and FIG. 20B shows the minimum when the operator's state is low and the state of wakefulness is not good. It is a time-series change in blood pressure value. Looking at these two graphs, when the operator's condition is good, large minimum blood pressure increases A1, A2, and A3 are seen, but when the operator's condition is low and the condition is not good, the minimum The blood pressure increases B1, B2, B3 become smaller. That is, the guidance effect determination value calculated in step S82 in FIG. 18 is a small value.

  Therefore, the main processing unit 14 controls the muscle movement processing unit 15 to present an alarm to the operator via the speaker 3 when the state of the operator is not good because the degree of arousal is not good. You will be prompted to cancel.

[Effects of Second Embodiment]
As described above in detail, the dozing prevention device shown as the second embodiment of the present invention is the blood pressure state of the operator detected by the blood pressure sensor 33 and the blood pressure signal processing unit 16 after stimulating the operator. Based on the above, in accordance with the control of the main processing unit 14 and the blood pressure signal processing unit 16, the induction effect by the self-issued movement is determined.

  Thus, while having the same effects as those of the first embodiment of the present invention, according to this doze prevention device, only a single indicator of blood pressure state is detected, thereby making it easier to measure the state of the driver. be able to. In addition, by determining the induction effect by self-issued movement, the effect of the self-issued movement induced by each stimulus can be clearly grasped, and excessive stimulus presentation or ineffective stimulus presentation may be repeated. In addition, optimal self-issued movement guidance according to the driver's condition can be performed.

  Further, according to this doze prevention device, the history of the blood pressure signal of the operator is recorded in the recording device 13, and the time difference between the minimum blood pressure value and the minimum blood pressure value is recorded based on the blood pressure signal history recorded in the recording device 13. The variance change amount is analyzed, and the analysis result is output as a blood pressure state. As described above, according to this dozing prevention apparatus, since only the variance change amount in the time difference between the minimum blood pressure value and the minimum blood pressure value is extracted from the blood pressure signal and the blood pressure state is output, the operator is based on the blood pressure signal. It is possible to efficiently acquire information relating to a decrease in arousal level.

  Furthermore, according to this doze prevention device, since the decrease in the arousal level of the operator is determined based on the analyzed minimum blood pressure value and the variance variation in the time difference between the minimum blood pressure values, the minimum blood pressure value increases and the minimum blood pressure It is possible to detect a state in which the variance in time difference between values increases, that is, a state in which the operator is struggling with sleepiness. Therefore, this dozing prevention device can detect a reduced state of arousal level that does not make the operator feel uncomfortable.

  Furthermore, according to this snooze prevention device, the induction effect by the self-issued movement is determined based on the rising tendency of the minimum blood pressure value of the operator detected according to the induced self-issued movement. You can select and guide a suitable self-issued action.

  In addition, this dozing prevention device stimulates the operator to instruct the operator to perform self-issued movement by muscle exercise, and the muscle exercise content as the self-issued movement performed by the operator corresponds to the instruction. The amount of muscle exercise load to be given as a stimulus is changed according to whether it is a thing. As described above, according to this snoozing prevention device, the operator can be induced to perform self-issued motion by muscle exercise, and therefore, the operator can be given muscle exercise that is self-issued motion with high blood pressure rise.

  Furthermore, this dozing prevention device is a self-issued motion that is induced by the operator by changing the required amount of muscle exercise given to the operator as a stimulus according to the determination result of the induction effect according to the control of the main processing unit 14. Change the amount of load and adjust the induction effect of self-issued movement. As described above, according to this snooze prevention device, since the necessary freight amount is used to change the load amount of the self-issued movement due to the muscle exercise, the change in the load amount that can be intuitively grasped by the operator is spontaneously caused by the muscle exercise. Can be guided by action.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.

  This third embodiment improves the dozing prevention device shown as the first embodiment and the second embodiment, and determines a decrease in arousal level using not only the heart rate of the operator but also the blood pressure. Therefore, in the third embodiment, the same parts as those described in the first embodiment and the second embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

[Configuration of dozing prevention device]
As shown in FIG. 21, the snoozing prevention apparatus shown as the third embodiment of the present invention has the blood pressure shown in FIG. 12 in addition to the heart rate sensor 4, the microphone 2 and the speaker 3 shown in FIG. A sensor 33 is provided, and a control device 1 that controls the dozing prevention device in an integrated manner.

  The control device 1 has the blood pressure signal processing unit 16 previously shown in FIG. 12 in addition to the heartbeat signal processing unit 12, the dialogue processing unit 11, and the recording device 13 previously shown in FIG. The main processing unit 14 is a control unit that performs overall control of work for inducing self-issued movement to the user.

  The main processing unit 14 is in the state of arousal level of the operator obtained from the heart rate information of the operator calculated by the heart rate signal processing unit 12 and the blood pressure information of the operator calculated by the blood pressure signal processing unit 16. Based on this, the work for guiding the self-issued movement to the operator is controlled in an integrated manner. When the main processing unit 14 determines that the wakefulness level of the operator has decreased, the main processing unit 14 controls the dialogue processing unit 11 to cause the operator to perform a dialogue as a self-issued motion. In addition, the main processing unit 14 causes the recording device 13 to record the heart rate information supplied from the heart rate signal processing unit 12 and the blood pressure information supplied from the blood pressure signal processing unit 16.

  In addition to the heart rate and blood pressure of the operator, the control device 1 is captured by a biological signal such as an operator's brain wave and skin potential detected by a biological signal sensor (not shown), and a face image capturing camera (not shown). It is also possible to determine the arousal level of the operator using the facial image of the operator.

  The heart rate sensor 4, the microphone 2, the speaker 3, the blood pressure sensor 33, and the control device 1 are arranged in the vehicle interior as shown in FIG. 22, for example. That is, similarly to the control device 1 described above, the control device 1 is implemented as software in a navigation system mounted on a vehicle or by predetermined hardware. Other elements are arranged in the same manner as the arrangements shown in FIGS.

[Operation of dozing prevention device]
"basic action"
The dozing prevention apparatus including each unit performs an operation for preventing the operator from falling asleep according to a series of procedures as shown in FIG.

  First, as shown in FIG. 23, the dozing prevention device performs the same processing as step S <b> 1 to step S <b> 3 in FIG. 3 according to the control of the control device 1, and the wakefulness reduction determination reference value, the self-issued movement setting value, and the guidance Initialize the effect criterion value.

  In the next step S91, the heartbeat signal processing unit 12 calculates heartbeat signal information based on the heartbeat signal detected by the heartbeat sensor 4, and compares the calculated heartbeat signal information with the above-described arousal level decrease determination reference value. It is converted into a wakefulness decrease determination value that can be performed. The heartbeat signal processing unit 12 supplies the heartbeat signal information and the arousal level decrease determination value to the main processing unit 14. In addition, the blood pressure signal processing unit 16 can calculate blood pressure signal information based on the blood pressure signal detected by the blood pressure sensor 33, and can compare the calculated blood pressure signal information with a reference level for determining arousal level reduction. It is converted into a wakefulness decrease judgment value. The blood pressure signal processing unit 16 supplies the blood pressure signal information and the arousal level decrease determination value to the main processing unit 14. The process in step S91 will be described in detail later.

  After that, the main processing unit 14 performs the same processing as step S5 and step S6 in FIG. 3 and controls the dialogue processing unit 11 to cause the operator to perform a dialogue as a self-issued action and to urge the operator to wake up.

  Then, the dozing prevention device performs the heart rate / self-issued motion effect confirmation processing similar to step S7 in FIG. 3 and the blood pressure / self-issued motion effect confirmation processing similar to step S53 in FIG. .

  After that, the main processing unit 14 performs the same processing as Step S8 and Step S9 in FIG.

  The dozing prevention apparatus can perform an operation for preventing an operator from falling asleep according to such a series of procedures.

“Details of Biological Signal Measurement Processing (Step S91)”
Next, details of the biological signal measurement process in step S91 will be described with reference to FIG.

  First, as shown in FIG. 24, the dozing prevention apparatus performs measurement processing of the heart rate signal by the heart rate signal processing unit 12 in step S101, calculates the instantaneous heart rate based on the heart rate signal of the operator, and step S102. , The blood pressure signal processing unit 16 performs blood pressure signal measurement processing, and calculates a minimum blood pressure value based on the blood pressure signal of the operator. Note that the processes in steps S101 and S102 are performed in the same manner as the heartbeat signal measurement process in step S4 in FIG. 3 and the blood pressure signal measurement process in step S51 in FIG.

  In step S103, the main processing unit 14 calculates the arousal level decrease determination value based on the instantaneous heart rate calculated in step S101 and the minimum blood pressure value calculated in step S102. The calculation of the arousal level lowering determination value is based on the time-series change of the instantaneous heart rate when the operator's arousal level is reduced as shown in FIG. 5 (b), and the motion shown in FIG. 16 (b). This is performed based on the time series change of the minimum blood pressure value when the awakening level of the person is reduced. That is, as described above, in the section where the instantaneous heart rate and the minimum blood pressure value exceeding the arousal level decrease determination reference value are generated, the awakening level of the operator is decreased, and the operator is in a state of conflict with drowsiness. The main processing unit 14 compares these instantaneous heart rate and diastolic blood pressure value with a wakefulness level decrease determination reference value, and adds a difference value with the wakefulness level decrease determination reference value to the wakefulness level decrease determination value. Can be calculated.

  The dozing prevention apparatus can calculate the arousal level decrease determination value according to such a series of procedures.

[Effect of the third embodiment]
As described above in detail, the snoozing prevention apparatus shown as the third embodiment of the present invention has the analyzed instantaneous heart rate according to the control of the main processing unit 14, the heart rate signal processing unit 12, and the blood pressure signal processing unit 16. Based on the amount of change and the amount of change in the minimum blood pressure value, it is determined whether the wakefulness level of the operator is reduced.

  As described above, since it has the same effect as that of the first embodiment of the present invention and determines a decrease in the driver's arousal level based on the relationship between the change amount of the instantaneous heart rate and the change amount of the minimum blood pressure value, It is possible to detect a state where the number increases and the minimum blood pressure value decreases, that is, a state where the driver is struggling with sleepiness. Therefore, according to this snooze driving prevention device, it is possible to detect a state of reduced arousal level that is comfortable for the driver.

  And according to this dozing prevention device, by determining the induction effect by the self-issued movement, the effect of the self-issued movement induced by the individual stimulus can be clearly grasped, excessive stimulation presentation or no effect It is possible to guide the optimal self-issued motion according to the state of the operator without repeating the stimulus presentation.

  In addition, according to this doze prevention device, it is possible to determine the state of arousal level of an operator that combines heart rate information and blood pressure information and to determine the induction effect by the self-issued movement. It can be improved further.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.

  This fourth embodiment improves the dozing prevention device shown as the first embodiment and the second embodiment, determines a decrease in arousal level using the heart rate and blood pressure signals of the operator, and for the operator It induces not only dialogue but also self-issued movement by muscle movement, and further determines whether or not the self-issued movement can be induced based on the running state of the vehicle. Therefore, in the fourth embodiment, the same parts as those described in the first embodiment and the second embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

[Configuration of dozing prevention device]
As shown in FIG. 25, the snoozing prevention apparatus shown as the fourth embodiment of the present invention includes the blood pressure sensor previously shown in FIG. 12 in addition to the microphone 2, the speaker 3 and the heart rate sensor 4 previously shown in FIG. 33, a control device 1 that comprehensively controls the snooze prevention device, a steering angle sensor 41 that detects the steering angle of the steering 21, a lateral G sensor 42 that detects lateral acceleration of the vehicle, and a vehicle And a traveling road imaging camera 43 that captures a forward traveling road image. The speaker 3 here also has the function of the speaker 3 shown in FIG.

  The steering angle sensor 41, the lateral G sensor 42, and the traveling road imaging camera 43 are sensors that output a traveling state detection signal to a traveling state processing unit 17 in the control device 1 described later.

  The steering angle sensor 41 detects the steering angle of the steering. The steering angle signal detected by the steering angle sensor 41 is read by the traveling state processing unit 17. The lateral G sensor 42 detects the acceleration in the lateral direction of the vehicle. The lateral acceleration signal detected by the lateral G sensor 42 is read by the traveling state processing unit 17. The travel road imaging camera 43 captures a travel road image in front of the vehicle and outputs it to the travel situation processing unit 17. The traveling road imaging camera 43 can also incorporate an image processing device. In this case, the travel road imaging camera 43 recognizes the travel zone and the forward vehicle from the captured road image ahead of the vehicle, calculates the distance between the vehicle and the travel zone, and the distance between the forward vehicle and these distances. The information may be output to the traveling state processing unit 17.

  Note that the snooze prevention device may include other sensors as long as it outputs a signal for detecting the driving situation. Further, the dozing prevention device does not have to include all of the steering angle sensor 41, the lateral G sensor 42, and the traveling road imaging camera 43. Among these, according to the design concept of the dozing prevention device, only one sensor may be provided, or a plurality of sensors may be arbitrarily combined.

  The control device 1 includes the blood pressure signal processing unit 16 previously shown in FIG. 12 in addition to the heartbeat signal processing unit 12, the dialogue processing unit 11, and the recording device 13 previously shown in FIG. Furthermore, the control device 1 includes a main processing unit 14 that is a control unit that performs overall control of work for inducing the self-issued movement to the operator, and a traveling state processing unit 17 that is a traveling state detection unit that detects the current traveling state of the vehicle. And have.

  The main processing unit 14 is in the state of arousal level of the operator obtained from the heart rate information of the operator calculated by the heart rate signal processing unit 12 and the blood pressure information of the operator calculated by the blood pressure signal processing unit 16. Based on this, the work for guiding the self-issued movement to the operator is controlled in an integrated manner. If the main processing unit 14 determines that the wakefulness level of the operator has decreased, the main processing unit 14 controls the dialog processing unit 11 to cause the operator to perform a dialogue as a self-issued motion, and to set the muscle exercise processing unit 15 to Control and let the operator perform muscle exercise as a self-issued movement. At this time, the main processing unit 14 determines whether or not the self-issued movement can be guided based on the current traveling state of the vehicle detected by the traveling state processing unit 17, and according to the determination result. To induce self-issued movement. In addition, the main processing unit 14 stores the heart rate information supplied from the heart rate signal processing unit 12, the blood pressure information supplied from the blood pressure signal processing unit 16, and the running status information supplied from the running status processing unit 17 in the recording device 13. Let me record.

  The traveling state processing unit 17 is configured to detect the steering angle of the steering detected by the steering angle sensor 41, the lateral acceleration of the vehicle detected by the lateral G sensor 42, and the traveling road ahead of the vehicle imaged by the traveling road imaging camera 43. Based on the video, the current driving situation of the vehicle is detected. The traveling state processing unit 17 supplies the detected traveling state information to the main processing unit 14.

  Note that the control device 1 may determine the arousal level of the operator based on the steering angle signal detected by the steering angle sensor 41 by using, for example, a method described in Japanese Patent Application Laid-Open No. 5-58192. it can. Further, the control device 1 can also determine the awakening level of the operator based on the acceleration in the vehicle lateral direction detected by the lateral G sensor 42. In this case, the control device 1 performs the process of converting the change in the steering angle into the lateral G or the distance change between the vehicle and the travel zone based on the method described in, for example, Japanese Patent Laid-Open No. 5-58192. By converting to G, the awakening level of the operator can be determined. Furthermore, the control device 1 uses, for example, a technique described in Japanese Patent Application Laid-Open No. 5-69757 to determine the wakefulness of the operator based on the road image in front of the vehicle imaged by the road image camera 43. It can also be determined.

  Such a microphone 2, speaker 3, heart rate sensor 4, blood pressure sensor 33, control device 1, steering angle sensor 41, lateral G sensor 42, and travel road imaging camera 43 are, for example, shown in FIG. Is arranged. That is, the control device 1 is implemented as software in a navigation system mounted on a vehicle, or by predetermined hardware, like the control device 1 described above. Other elements are arranged in the same manner as the arrangements shown in FIGS. 2, 13, and 22.

[Operation of dozing prevention device]
"basic action"
Such a dozing prevention apparatus including each unit performs an operation for preventing the operator from falling asleep according to a series of procedures as shown in FIG.

  First, as shown in FIG. 27, the dozing prevention device performs the same processing as steps S <b> 1 to S <b> 3 in FIG. 3 according to the control of the control device 1, so Initialize the effect criterion value.

  Next, the same processing as step S91 in FIG. 23 is performed, and the heartbeat signal processing unit 12 calculates heartbeat signal information based on the heartbeat signal detected by the heartbeat sensor 4, and the calculated heartbeat signal information is used as the awakening described above. It converts into a wakefulness fall determination value which can be compared with a fall degree determination reference value. The heartbeat signal processing unit 12 supplies the heartbeat signal information and the arousal level decrease determination value to the main processing unit 14. In addition, the blood pressure signal processing unit 16 can calculate blood pressure signal information based on the blood pressure signal detected by the blood pressure sensor 33, and can compare the calculated blood pressure signal information with a reference level for determining arousal level reduction. It is converted into a wakefulness decrease judgment value. The blood pressure signal processing unit 16 supplies the blood pressure signal information and the arousal level decrease determination value to the main processing unit 14.

  Thereafter, the main processing unit 14 performs the same process as step S5 in FIG. 3 and compares the arousal level decrease determination value with the arousal level decrease determination reference value. When the arousal level decrease determination value is smaller than the arousal level decrease determination reference value, the main processing unit 14 determines that the operator's arousal level has not decreased and repeats the processing from step S91. On the other hand, the main processing unit 14 determines that the wakefulness level of the operator has decreased when the wakefulness level decrease determination value is equal to or greater than the wakefulness level decrease determination reference value, performs the self-issued motion guidance process in step S111, and The process ends. The process in step S111 will be described in detail later.

  The dozing prevention apparatus can perform an operation for preventing an operator from falling asleep according to such a series of procedures.

[Details of Self-issued Movement Guidance Process (Step S111)]
Next, details of the self-issued movement guidance process in step S111 will be described with reference to FIG.

  First, as shown in FIG. 28, the dozing prevention apparatus detects the current traveling state of the vehicle by the traveling state processing unit 17 in step S121. This traveling state is detected using information detected by each of the steering angle sensor 41, the lateral G sensor 42, and the traveling road imaging camera 43. The traveling state processing unit 17 supplies the detected traveling state information to the main processing unit 14.

  In step S122, the main processing unit 14 determines whether or not the self-issued movement can be guided based on the traveling state information detected in step S121. That is, the main processing unit 14 determines whether or not the driving load amount corresponding to the current traveling state of the vehicle is a driving load amount to which the self-issued movement can be guided.

  Here, the main processing unit 14 terminates the series of processes as it is in a high driving load state in which the self-issued movement cannot be guided. On the other hand, the main processing unit 14 shifts the process to step S112 when the operation load amount is such that the self-issued movement can be guided, and selects the type of self-issued movement to be guided to the operator. Determine the load level.

  When the driving load is low, the main processing unit 14 determines that the operator can perform a self-issued action through dialogue, and performs dialogue processing similar to step S6 in FIG. In addition, when the driving load is high, the main processing unit 14 determines that the operator cannot perform the self-issued motion by the dialogue, but can perform the self-issued motion by the muscle exercise. 14, the same muscle movement process as in step S52 is performed.

  Then, the dozing prevention device performs the heart rate / self-issued motion effect confirmation processing similar to step S7 in FIG. 3 and the blood pressure / self-issued motion effect confirmation processing similar to step S53 in FIG. .

  After that, the main processing unit 14 performs the same processing as Step S8 and Step S9 in FIG.

  The dozing prevention device can appropriately guide the self-issued motion to the operator according to such a series of procedures.

[Effect of Fourth Embodiment]
As described above in detail, the snooze prevention apparatus shown as the fourth embodiment of the present invention is based on at least one of the determination result of the guidance effect and the detected traveling state of the vehicle. The stimulus content to be given is selected from a plurality of stimulus content. Therefore, according to this snooze prevention device, since it is possible to select an appropriate self-issued motion according to the driving load, it is possible to eliminate an operator's uncomfortable feeling with respect to the guided self-issued motion, Since the self-issued movement induced according to the situation can be selected from dialogue and muscle movement, it is possible to reduce the discomfort that the operator has with respect to the guidance of the self-issued movement.

  And while having the effect similar to 1st Embodiment of this invention, the effect of the self-issued movement induced | guided | derived by each irritation | stimulation can be clearly grasped | ascertained by determining the induction effect by self-issued movement, and it is excessive. Stimulus presentation and ineffective stimulation presentation are not repeated, and optimal self-issued movement guidance according to the state of the operator can be performed.

  Further, according to this snooze prevention device, when the detected traveling state of the vehicle is in a high load state in which the self-issued movement cannot be guided, the guidance operation of the self-issued movement is suppressed to the operator. The discomfort with respect to the self-issued movement can be reduced.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and even if it is a form other than this embodiment, as long as it does not depart from the technical idea according to the present invention, the design and the like Of course, various modifications are possible.

DESCRIPTION OF SYMBOLS 1 Control apparatus 2 Microphone 3 Speaker 4 Heart rate sensor 11 Dialog processing part 12 Heart rate signal processing part 13 Recording apparatus 14 Main processing part 15 Muscle movement processing part 16 Blood pressure signal processing part 17 Running condition processing part 21 Steering 22 Door panel 23 Instrument panel 24 Seat 31 Display 32 Pressure sensor 33 Blood pressure sensor 41 Steering angle sensor 42 Sensor 43 Traveling path imaging camera

Claims (12)

An operator state detecting means for detecting an operator's state;
Based on the state of the operator detected by the operator state detection means, the arousal level determination means for determining the level of arousal of the operator;
A self-issuing motion inducing means for providing a stimulus for inducing self-issuing motion to the operator when the awakening level is determined by the awakening level determining means;
A guidance effect determining means for determining a guidance effect by a self-issued motion based on the state of the operator detected by the operator state detection means after stimulating the operator by the self-issued motion guidance means;
A dozing prevention apparatus comprising: control means for controlling the content of the stimulus given to the operator by the self-issued motion guidance means in accordance with the guidance effect determined by the guidance effect determination means. The operator state detecting means detects a heartbeat state and / or a blood pressure state of the operator,
The inductive effect determining means is either one of the heartbeat state or blood pressure state of the operator detected by the operator state detecting means after stimulating the operator by the self-issued motion inducing means, or the The dozing prevention device according to claim 1, wherein the guidance effect by the self-issued movement is determined based on both the heartbeat state and the blood pressure state of the operator. The operator state detection means records the detected heart rate signal and / or blood pressure signal history of the operator in a recording means,
The arousal level determination means is based on the heart rate signal history and / or blood pressure signal history recorded in the recording means, and / or the variance change amount of the instantaneous heart rate and heart rate fluctuation and / or between the minimum blood pressure value and the minimum blood pressure value. The amount of variance change in the time difference between the two is analyzed, and the analysis result is output as the heartbeat state and / or the blood pressure state.   The arousal level determination means may decrease the awakening level of the operator based on the analyzed variance change amount of the instantaneous heart rate and heart rate fluctuation and / or the variance change amount in the time difference between the minimum blood pressure value and the minimum blood pressure value. The dozing prevention apparatus according to claim 3, wherein:   The said arousal level determination means determines the fall of the awakening level of the said operator based on the analyzed variation | change_quantity of the instantaneous heart rate and the variation | change_quantity of the diastolic blood pressure value. Dozing prevention device.   The guidance effect determination means is either the heart rate increase tendency or the minimum blood pressure value increase tendency of the operator detected by the operator state detection means in accordance with the self-issued motion induced by the self-issued motion guidance means. The guidance effect by self-issued movement is determined based on both the heart rate increase tendency and the minimum blood pressure value increase tendency of the operator. Snooze prevention device. The self-issued motion guiding means gives the stimulus to the operator so as to instruct the operator to perform a self-issued motion by dialogue and / or muscle movement,
The control means determines whether the content of dialogue and / or muscle movement as self-issued movement performed by the operator corresponds to an instruction from the self-issued movement guidance means. The dozing prevention apparatus according to any one of claims 1 to 6, wherein a load amount of dialogue and / or muscle exercise given as the stimulus is changed by means.   The control means is guided to the operator by changing an instruction amount of a stimulus given to the operator by the self-issued motion guidance means in accordance with the guidance effect by the self-issued motion determined by the guidance effect judgment means. The dozing prevention device according to claim 1 or 7, wherein a load amount of the self-issued movement is changed to adjust a guidance effect of the self-issued movement.   The control means is configured to determine a storage load amount or a calculation load amount necessary for establishing a dialogue to be given to the operator as the stimulus by the self-issued motion guide means according to the guide effect by the self-issued motion determined by the guide effect determination means. 9. The load effect of the self-issued motion induced by the operator by changing at least one and / or the required amount of exercise of muscle exercise is adjusted, and the induction effect of the self-issued motion is adjusted. The dozing prevention device according to 1. A driving condition detecting means for detecting the driving condition of the vehicle;
The control means is a stimulus given by the self-issued movement inducing means based on at least one of a guidance effect by the self-issued movement determined by the guidance effect judging means and a running situation detected by the running situation detecting means. The doze prevention device according to any one of claims 1 to 9, wherein the content is selected from a plurality of stimulus contents.   The control means suppresses the operation by the self-issued movement guiding means when the running condition detected by the running condition detection means is a high load state where the self-issued movement cannot be induced. The dozing prevention apparatus according to claim 10. Detecting the state of the operator, determining the awakening level of the operator based on the state of the operator,
When it is determined that the wakefulness level of the operator is lowered, the guidance effect by the self-issued motion is obtained based on the state of the operator when a stimulus for inducing the self-issued motion is given to the operator. Judgment,
A dozing prevention method comprising: controlling a content of a stimulus given to the operator thereafter according to the determined induction effect.

Images