JP2023005632A - Awakening Device, Awakening System, and Awakening Program - Google Patents

Abstract

To provide an awakening device capable of further reliably awakening a driver using awakening stimulus, an awakening system, and an awakening program.SOLUTION: An awakening device 10 includes a detection unit 19, a determination unit 21, and an execution unit 23. When the determination unit determines that an awake state detected by the detection unit satisfies awakening execution conditions, the execution unit uses awakening means to generate arousal stimuli in a vehicle. When the determination unit determines that the awake state detected by the detection unit again does not satisfy the awakening execution conditions, the execution unit instructs an outside of the vehicle to check whether or not a driver is awake. When it is notified from the outside of the vehicle that the driver is awake, the execution unit stops generation of the arousal stimuli using the awakening means.SELECTED DRAWING: Figure 2

Description

The present invention relates to an awakening device, an awakening system, and an awakening program.

2. Description of the Related Art Conventionally, there has been known a device for detecting a drowsiness level of a driver based on the state of the driver of the vehicle (see, for example, Patent Document 1).

When the device disclosed in Patent Document 1 determines that the drowsiness level of the driver exceeds the threshold, it generates an awakening stimulus in the vehicle according to the drowsiness level of the driver.

The device re-detects the driver's drowsiness level when the arousal stimulus is generated in the vehicle. As a result of the re-detection, when it is determined that the drowsiness level of the driver has fallen below the threshold, the device stops the awakening stimulus.

Japanese Unexamined Patent Application Publication No. 2020-52482

However, even if the device described above determines that the drowsiness level of the driver has fallen below the threshold, it does not mean that the driver is actually awake.

If the device determines that the driver's drowsiness level has fallen below the threshold, even though the driver is not actually awake, the wake-up stimulus is immediately stopped. In this case, the device will not be able to awaken the driver using the awakening stimulus.

Therefore, further improvements have been desired in order to more reliably awaken the driver using the awakening stimulus.

The present invention has been made in view of the problems of the prior art. An object of the present invention is to provide an awakening device, an awakening system, and an awakening program that can more reliably awaken a driver using an awakening stimulus.

An awakening device according to an aspect of the present invention includes a detection unit that detects an awakening state of a driver of a vehicle, and a determination unit that determines whether the awakening state detected by the detection unit satisfies an awakening execution condition. an execution unit for generating an awakening stimulus in the vehicle using an awakening means when the determining unit determines that the detected arousal state satisfies the awakening execution condition, the detecting unit comprising: When the arousal stimulus occurs, the arousal state of the driver is re-detected, and the determination section determines whether or not the arousal state re-detected by the detection section satisfies the arousal execution condition. When the unit determines that the re-detected arousal state does not satisfy the wakefulness execution condition, the execution unit instructs the outside of the vehicle to confirm whether the driver is awake, The execution unit stops generation of the awakening stimulus using the awakening means when notified from the outside of the vehicle that it is confirmed that the driver is awake.

A wake-up system according to an aspect of the present invention includes the above-described wake-up device and an external device connected to the wake-up device via wireless communication. receiving instruction information instructing the exterior of the vehicle to confirm whether or not the vehicle is awake, the external device transmitting a response request to the vehicle in response to the reception of the instruction information; receives from the vehicle a response from the driver to the response request, notifies the awakening device that it is confirmed that the driver is awake.

An awakening program according to an aspect of the present invention includes a first detecting step of detecting an awakening state of a driver of a vehicle, and determining whether or not the awakening state detected by the first detecting step satisfies an awakening execution condition. an execution step of generating an arousal stimulus in the vehicle using an arousal means when the first judging step determines that the detected arousal state satisfies an arousal execution condition; a second detection step of re-detecting the arousal state of the driver when an arousal stimulus occurs; If the determination step and the second determination step determine that the re-detected awake state does not satisfy the wake-up execution condition, instructing the outside of the vehicle to confirm whether the driver is awake. and a stop step of stopping generation of the awakening stimulus using the awakening means when notified from the outside of the vehicle that the driver has confirmed that the driver is awake. Let

Advantageous Effects of Invention According to the present invention, it is possible to provide an awakening device, an awakening system, and an awakening program that are capable of more reliably awakening a driver using an awakening stimulus.

FIG. 1 is an overall schematic configuration diagram of the awakening system according to this embodiment. FIG. 2 is a functional block configuration diagram of the awakening device according to this embodiment. FIG. 3 is a diagram showing an example of an awakening execution condition according to this embodiment. FIG. 4 is a diagram showing an example of the hardware configuration of the awakening device according to this embodiment. FIG. 5 is a block configuration diagram of the operation recorder according to this embodiment. FIG. 6 is a block configuration diagram of an office PC according to this embodiment. FIG. 7 is a diagram showing the sequence of the awakening procedure by the awakening device and the office PC according to this embodiment. FIG. 8 is a diagram showing an example of an awakening execution condition according to a modification of this embodiment.

Hereinafter, the awakening device, the awakening system, and the awakening program according to the present embodiment will be described in detail with reference to the drawings. Note that the same or similar reference numerals are given to the same functions and configurations, and the description thereof will be omitted as appropriate.

[Overall schematic configuration of arousal system]
First, the configuration of the awakening system 1 according to this embodiment will be described. Arousal system 1 is used to awaken a driver (not shown) of vehicle 3 using an arousal stimulus.

FIG. 1 is an overall schematic configuration diagram of an awakening system 1. As shown in FIG. As shown in FIG. 1 , the awakening system 1 includes an awakening device 10 , an operation recorder 100 , a terminal device 200 , an in-vehicle camera 210 , an exterior camera 220 , and an office PC (PERSONAL COMPUTER) 300 . Arousal device 10 , operation recorder 100 , in-vehicle camera 210 , and out-vehicle camera 220 are mounted on vehicle 3 .

The awakening device 10 is communicably connected to the operation recorder 100, the terminal device 200, the vehicle interior camera 210, and the vehicle exterior camera 220. FIG. The awakening device 10 detects the driver's awakening state based on information from the operation recorder 100, the vehicle interior camera 210, and the vehicle exterior camera 220. FIG. When the detected arousal state of the driver satisfies an awakening execution condition described later, the awakening device 10 continuously generates an awakening stimulus in the vehicle 3 using the later-described awakening means 25 . Thus, the awakening device 10 warns the driver with an awakening stimulus according to the driver's awakening state.

The awakening device 10 is communicably connected to the office PC 300 via the network 7 (Internet network). The awakening device 10 re-detects the driver's awakening state after generating the awakening stimulus. When the re-detected arousal state of the driver no longer satisfies the awakening execution condition, the office PC 300 is instructed to confirm whether or not the driver is awake. When the office PC 300 notifies the awakening device 10 that the driver of the vehicle 3 is awake, the awakening device 10 stops generating the awakening stimulus using the awakening means 25 .

The awakening device 10 can continuously generate an awakening stimulus in the vehicle 3 using the terminal device 200 when the driver's awakening state satisfies the awakening execution condition. In this case, when the office PC 300 notifies the awakening device 10 that the driver of the vehicle 3 is awake, the awakening device 10 stops generating the awakening stimulus using the terminal device 200 .

The operation recorder 100 records operation information related to the operation of the vehicle 3 and the operation of the vehicle 3 at regular time intervals. The travel recorder 100 is also called a digital tachograph. The operation recorder 100 continuously transmits designated operation data among the operation information to the awakening device 10 based on a transmission instruction from the awakening device 10 . The operation information recorded by the operation recorder 100 includes, for example, the following operation data D1 to D9.
Operation data D1: Current time (date and time)
Operation data D2: Current position of vehicle 3 (longitude/latitude)
Operation data D3: Travel time of vehicle 3 Operation data D4: Travel distance of vehicle 3 Operation data D5: Speed of vehicle 3 Operation data D6: Acceleration of vehicle 3 Operation data D7: Engine speed of vehicle 3 Operation data D8: ON/OFF of brake operation Operation data D9: ON/OFF of accelerator operation

The terminal device 200 is a portable electronic device such as a smart phone. The terminal device 200 is owned by the driver of the vehicle 3, and held in the driver's pocket, for example. The terminal device 200 generates an awakening stimulus according to instructions from the awakening device 10 .

The in-vehicle camera 210 is installed inside the vehicle 3 at a position facing the driver of the vehicle 3 . The in-vehicle camera 210 captures images of the driver of the vehicle 3 at regular time intervals to generate image data of the driver. The in-vehicle camera 210 continuously transmits image data of the driver to the awakening device 10 based on the transmission instruction from the awakening device 10 . When the in-vehicle camera 210 transmits the image data of the driver to the awakening device 10 , it transmits to the awakening device 10 information about the time when the image data was generated.

The exterior camera 220 is installed outside the vehicle 3 . The exterior camera 220 captures an image of the surroundings of the vehicle 3 (for example, the front of the vehicle 3) at regular time intervals to generate image data of the surroundings of the vehicle 3. The exterior camera 220 continuously transmits image data around the vehicle 3 to the awakening device 10 based on the transmission instruction from the awakening device 10 . When transmitting image data around the vehicle 3 to the awakening device 10 , the exterior camera 220 transmits to the awakening device 10 information about the time when the image data was generated.

The office PC 300 is installed in the office 5 and manages the operation status of the vehicle 3, the driving status of the vehicle 3, the status of the driver of the vehicle 3, and the like. Based on the instruction from the awakening device 10, the office PC 300 transmits a response request to the vehicle 3 in order to confirm whether the driver of the vehicle 3 is awake. When the office PC 300 receives a response from the driver of the vehicle 3 to the response request from the vehicle 3, the office PC 300 notifies the awakening device 10 that it is confirmed that the driver of the vehicle 3 is awake. Office PC 300 is also called an external device.

[Functional block configuration of awakening device]
Next, the functional block configuration of the awakening device 10 will be described. FIG. 2 is a functional block configuration diagram of the awakening device 10. As shown in FIG. As shown in FIG. 2 , the awakening device 10 includes a receiver 11 , a transmitter 13 , a controller 15 , a memory 17 , a detector 19 , a determiner 21 , an execution unit 23 , and awakening means 25 .

The receiving unit 11 and the transmitting unit 13 execute communication between the awakening device 10 and the operation recorder 100 . The transmission unit 13 transmits a transmission instruction to the operation recorder 100, and instructs the operation recorder 100 to transmit specified operation data among the operation information. The receiving unit 11 receives the designated operation data from the operation recorder 100 . The transmission instruction includes identification information of operation data to be specified.

The receiving unit 11 and the transmitting unit 13 perform communication between the awakening device 10 and the in-vehicle camera 210 . The transmission unit 13 transmits a transmission instruction to the in-vehicle camera 210 and instructs the in-vehicle camera 210 to transmit image data of the driver. The receiving unit 11 receives image data of the driver from the in-vehicle camera 210 .

The receiving unit 11 and the transmitting unit 13 perform communication between the awakening device 10 and the vehicle exterior camera 220 . The transmission unit 13 transmits a transmission instruction to the exterior camera 220 and instructs the exterior camera 220 to transmit image data around the vehicle 3 . The receiving unit 11 receives image data around the vehicle 3 from the vehicle exterior camera 220 .

The receiving unit 11 and the transmitting unit 13 perform wireless communication between the awakening device 10 and the terminal device 200 . The receiving unit 11 receives a connection request from the terminal device 200 . When the awakening device 10 connects to the terminal device 200 in response to the connection request, the transmission unit 13 transmits connection completion to the terminal device 200 .

The transmission unit 13 can transmit an alarm signal and an alarm stop signal to the terminal device 200 . The terminal device 200 generates an awakening stimulus upon receiving the alarm signal. Upon receiving the alarm stop signal, the terminal device 200 stops generating the awakening stimulus.

The receiving unit 11 and the transmitting unit 13 perform wireless communication via the network 7 between the awakening device 10 and the office PC 300 . The transmission unit 13 transmits instruction information to the office PC 300 to instruct whether or not the driver of the vehicle 3 is awake. The receiving unit 11 receives from the office PC 300 a confirmation that the driver of the vehicle 3 is awake. When the arousal state of the driver satisfies the arousal execution condition, the transmitting unit 13 notifies the office PC 300 of the occurrence of an alarm. When the generation of the awakening stimulus using the awakening means 25 or the terminal device 200 is stopped, the transmitter 13 notifies the office PC 300 of the end of the alarm.

The control unit 15 controls the entire processing in the awakening device 10 . Specifically, the control unit 15 controls the operations of the reception unit 11 , the transmission unit 13 , the storage unit 17 , the detection unit 19 , the determination unit 21 , the execution unit 23 and the awakening means 25 .

The storage unit 17 stores the specified operation data, the image data of the driver, and the image data around the vehicle 3 that are received by the reception unit 11 . The storage unit 17 pre-stores the awakening execution condition. As will be described later, when a family member's voice or the like is output from the speaker 230 as an arousal stimulus, the storage unit 17 stores voice data such as the family member's voice recorded in advance.

The detection unit 19 detects the arousal state of the driver based on the specified operation data, the image data of the driver, and the image data of the surroundings of the vehicle 3 within the same period, which are stored in the storage unit 17. . The detection unit 19 performs the detection at regular time intervals.

The arousal state of the driver can be directly detected from the driving operation of the driver, the state of the driver, and the running state of the vehicle. Therefore, in the present embodiment, the detection unit 19 detects the following information from the specified operation data, the image data of the driver, and the image data around the vehicle 3 as the driver's arousal state.

The detection unit 19 detects the speed of the vehicle 3 from the designated operation data D5. The detection unit 19 analyzes the image data of the driver and detects the state of the driver's eyelids and the inclination of the driver's body. The detection unit 19 performs image analysis on the image data around the vehicle 3 to detect whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3 .

The designated operation data is not limited to the operation data D5, and may be any data that can detect the driver's driving operation characteristically appearing in a dangerous driving state, which will be described later. The information detected from the driver's image data is not limited to the state of the driver's eyelids and the inclination of the driver's body, and any information that can detect the state of the driver that appears characteristically in a dangerous driving state. good. The information detected from the image data around the vehicle 3 is not limited to whether or not the vehicle 3 has deviated from the lane and the number of times the vehicle 3 has changed lanes. Information is fine.

The determination unit 21 determines whether or not the wakeful state detected by the detection unit 19 satisfies the wakefulness execution condition. The determination unit 21 makes the determination at regular time intervals.

In this embodiment, a dangerous driving state is set as an arousal state in which the arousal device 10 needs to generate an arousal stimulus. The dangerous driving state is an awake state in which attention is remarkably reduced, and there is a possibility that dangerous driving such as drowsy driving is being performed.

FIG. 3 is a diagram showing an example of an awakening execution condition. Conditions A1 to A5 shown in FIG. 3 are awakening execution conditions used to determine whether the driver's awakening state is a dangerous driving state.

If the arousal state detected by the detection unit 19 satisfies the conditions A1 to A4 or the conditions A1 to A3 and A5, the determination unit 21 determines that the driver's arousal state is a dangerous driving state.

If the arousal state detected by the detection unit 19 does not satisfy the conditions A1 to A5, the determination unit 21 determines that the driver's arousal state does not satisfy the awakening execution condition. Note that the awakening execution conditions are not limited to the conditions A1 to A5 shown in FIG. 3, and can be changed as appropriate.

When the determination unit 21 determines that the driver's arousal state is a dangerous driving state, the execution unit 23 uses at least one of the awakening means 25 and the terminal device 200 to continue the awakening stimulation in the vehicle 3. to generate. Specifically, the execution unit 23 transmits an alarm signal to at least one of the awakening means 25 and the terminal device 200 to continuously generate the awakening stimulus.

The awakening means 25 continuously generates at least one of alarm sound, alarm light, alarm smell, and alarm wind as an awakening stimulus based on the reception of the alarm signal. The awakening means 25 outputs, for example, an irregular buzzing sound or a voice such as a family member's voice as an alarm sound. The awakening means 25 turns on or blinks a blue light, for example, as warning light. The awakening means 25 diffuses, for example, a mist-like aroma oil having an awakening effect as an alarm odor. The awakening means 25 outputs cold wind, for example, as warning wind.

The terminal device 200 continuously generates at least one of an alarm sound, an alarm light, and an alarm vibration based on the reception of the alarm signal. The terminal device 200 outputs, for example, an irregular buzzer sound as an alarm sound. The terminal device 200 turns on or blinks a blue light, for example, as warning light. The terminal device 200 generates, for example, vibration as the warning vibration.

Note that the alarm sound, alarm light, and alarm smell are also called auditory stimulus, visual stimulus, and olfactory stimulus, respectively. Warning vibrations and warning winds are also called somatosensory stimuli.

The execution unit 23 can cause the awakening means 25 and the terminal device 200 to work together to generate the same awakening stimulus out of the alarm sound and the alarm light. The execution unit 23 can link the awakening means 25 and the terminal device 200 to generate different awakening stimuli among alarm sound, alarm light, alarm smell, alarm wind, and alarm vibration.

The execution unit 23 can randomly generate at least one of an alarm sound, an alarm light, an alarm smell, and an alarm wind using the awakening means 25 every time an awakening stimulus is generated in the vehicle 3. . The execution unit 23 can randomly generate at least one of an alarm sound, an alarm light, and an alarm vibration using the terminal device 200 each time an awakening stimulus is generated in the vehicle 3 .

When the determination unit 21 determines that the driver's wakefulness satisfies the wakefulness execution condition, the execution unit 23
The office PC 300 is notified of the occurrence of the alarm via the transmission unit 13 .

After the awakening stimulus is generated, when the determining unit 21 determines that the driver's arousal state does not satisfy the awakening execution condition, the executing unit 23 determines whether the driver is awake via the transmitting unit 13. The office PC 300 is instructed to confirm. At this time, the execution unit 23 transmits the real-time video signal of the driver to the office PC 300 via the transmission unit 13 .

When the office PC 300 notifies the execution unit 23 via the reception unit 11 that the driver is awake, the execution unit 23 uses at least one of the awakening means 25 and the terminal device 200. stopped generating arousal stimuli. Specifically, the execution unit 23 transmits an alarm stop signal to at least one of the awakening means 25 and the terminal device 200 to stop generation of the awakening stimulus.

When the execution unit 23 transmits the alarm stop signal to at least one of the awakening unit 25 and the terminal device 200 , the execution unit 23 notifies the office PC 300 of the end of the alarm via the transmission unit 13 .

[Hardware configuration of awakening device]
Next, an example of the hardware configuration of the awakening device 10 will be described. FIG. 4 is a diagram showing an example of the hardware configuration of the awakening device 10. As shown in FIG. As shown in FIG. 4 , the awakening device 10 includes a CPU (Central Processing Unit) 51 , a nonvolatile memory 53 , a volatile memory 55 and a hard disk 57 .

The CPU 51 executes programs stored in the nonvolatile memory 53 . The CPU 51 performs arithmetic processing on the data loaded in the volatile memory 55 according to the program, and controls each part of the awakening device 10 in an integrated manner.

The nonvolatile memory 53 stores programs and the like executed by the CPU 51 . The volatile memory 55 temporarily holds computation data when the CPU 51 executes the program stored in the nonvolatile memory 53 .

The hard disk 57 stores basic software such as an OS (Operating System), application programs, and data related to these. The hard disk 57 stores operation information, image data of the driver, image data around the vehicle 3, and wake-up execution conditions. When the voice of the family member is output from the speaker 230 as an arousal stimulus, the hard disk 57 stores audio data such as the voice of the family member recorded in advance.

As shown in FIG. 4, the awakening device 10 includes a communication device 59, an input device 61, a display device 63, an RTC (REAL-TIME CLOCK) 65, a speaker 230, a light emitting device 240, a diffuser 250, and an air conditioner 260.

The communication device 59 executes wireless communication between the awakening device 10 and the terminal device 200 . Communication device 59 performs wireless communication via network 7 between awakening device 10 and office PC 300 .

The input device 61 is composed of buttons, a touch panel, and the like, and receives input operations from the driver of the vehicle 3 or the like. The display device 63 is configured by a liquid crystal display or the like, and displays various information. RTC 65 generates time information.

When generating an alarm sound as an awakening stimulus, the speaker 230 receives an alarm signal from the CPU 51 . When the alarm signal is input, the speaker 230 continuously emits an alarm sound as a stimulus for awakening. Speaker 230 outputs, for example, an irregular buzzer sound as a warning sound. When the alarm stop signal is input from the CPU 51, the speaker 230 stops generating the alarm sound. In addition, when outputting voice such as the family's real voice as the alarm sound, the speaker 230 continuously receives an alarm signal including the family's real voice recorded in advance from the CPU 51 . Note that the speaker 230 is mounted on the vehicle 3 .

When warning light is generated as an arousal stimulus, the light emitting device 240 receives a warning signal from the CPU 51 . When the alarm signal is input, the light-emitting device 240 continuously emits alarm light as a wakeful stimulus. The light emitting device 240 turns on or blinks blue light, for example, as warning light. When the alarm stop signal is input from the CPU 51, the light emitting device 240 stops emitting the alarm light.

When an alarm odor is generated as an awakening stimulus, the diffuser 250 receives an alarm signal from the CPU 51 . When the alarm signal is input, the diffuser 250 continuously emits an alarm odor as an awakening stimulus. The diffuser 250 diffuses, for example, a mist of aromatic oil as an alarm odor. When the alarm stop signal is input from the CPU 51, the diffuser 250 stops generating the alarm odor.

When an alarm wind is generated as an awakening stimulus, an alarm signal is input from the CPU 51 to the air conditioner 260 . When the alarm signal is input, air conditioner 260 continues to generate alarm wind as an awakening stimulus. Air conditioner 260 outputs cold air, for example, as warning air. When the alarm stop signal is input from the CPU 51, the air conditioner 260 stops generating the alarm wind. Note that the air conditioner 260 is mounted on the vehicle 3 .

As shown in FIG. 4, the awakening device 10 has a camera I/F 67 and an external I/F 69 as interfaces.

In-vehicle camera 210 and exterior camera 220 are connected to camera I/F 67 . Image data of the driver is input from the in-vehicle camera 210 to the camera I/F 67 . Image data around the vehicle 3 is input to the camera I/F 67 from the exterior camera 220 .

A travel recorder 100 is connected to the external I/F 69 . Specified operation data is input from the operation recorder 100 to the external I/F 69 .

2 are realized by the communication device 59, the camera I/F 67, and the external I/F 77. As shown in FIG. The control unit 15 shown in FIG. 2 is implemented by the CPU 51 , nonvolatile memory 53 and volatile memory 55 . The storage unit 17 shown in FIG. 2 is implemented by the hard disk 57 .

Each of the detection unit 19, the determination unit 21, and the execution unit 23 shown in FIG. Awakening means 25 shown in FIG. 2 is implemented by speaker 230 , light emitting device 240 , diffuser 250 and air conditioner 260 .

[Configuration of operation recorder]
Next, the configuration of the operation recorder 100 will be described. FIG. 5 is a block diagram of the operation recorder 100. As shown in FIG. As shown in FIG. 5, the operation recorder 100 includes a CPU 101, a nonvolatile memory 103, a volatile memory 105, a hard disk 107, a communication device 109, an input device 111, a display device 113, and an RTC 115.

The CPU 101 executes programs stored in the nonvolatile memory 103 . The CPU 101 performs arithmetic processing on the data loaded into the volatile memory 105 according to the program, and controls each part of the operation recorder 100 in an integrated manner.

The nonvolatile memory 103 stores programs and the like executed by the CPU 101 . Volatile memory 105 temporarily holds computation data when CPU 101 executes a program stored in nonvolatile memory 103 .

The hard disk 107 stores basic software such as an OS, application programs, and data related to these. The hard disk 107 may store operation information.

Communication device 109 performs wireless communication via network 7 between operation recorder 100 and office PC 300 . Communication device 109 may transmit operation information to office PC 300 . The communication device 109 executes communication between the operation recorder 100 and a GPS (GLOBAL POSITIONING SATELLITE) (not shown).

The input device 111 is composed of buttons, a touch panel, etc., and receives input operations from the driver of the vehicle 3 or the like. The display device 113 is configured by a liquid crystal display or the like, and displays various information. RTC 115 generates time information.

As shown in FIG. 5, the operation recorder 100 includes, as interfaces, a camera I/F 117, a speed I/F 119, a rotation speed I/F 121, a sensor I/F 123, a vehicle signal I/F 125, a card I/F 127, and an external An I/F 129 is provided.

Camera outside camera 220 is connected to camera I/F 117 . When an instruction to record the running state of vehicle 3 is input to input device 111 , image data around vehicle 3 is input to camera I/F 117 from outside camera 220 .

A speed sensor 270 is connected to the speed I/F 119 . A speed pulse is input from the speed sensor 270 to the speed I/F 119 . A tire rotation pulse from a tire rotation speed sensor (not shown) is input to the rotation speed I/F 121 .

An acceleration sensor 280 is connected to the sensor I/F 123 . A signal from the acceleration sensor 280 is input to the sensor I/F 123 . The vehicle signal I/F 125 receives a signal indicating ON/OFF of brake operation from a brake operation sensor (not shown). The vehicle signal I/F 125 receives a signal indicating ON/OFF of accelerator operation from an accelerator operation sensor (not shown).

A memory card 290 is detachably attached to the card I/F 127 . Operation information is recorded in the memory card 290 . The memory card 290 is inserted into the card I/F 127 by the driver of the vehicle 3 when the vehicle 3 leaves the garage, for example. The memory card 290 is removed from the card I/F 127 and attached to the office PC 300 by the driver of the vehicle 3 when the vehicle 3 is parked, for example. As a result, the operation information recorded in the memory card 290 is read into the office PC 300 and processed. As a result, the office PC 300 can manage the operation status of the vehicle 3, the driving status of the vehicle 3, the status of the driver of the vehicle 3, and the like.

The CPU 301 acquires, for example, the operation data D1 to D9 described above as operation information by the following method, and records them in the memory card 290. FIG.
Operation data D1: The CPU 301 acquires the current time (date and time) from the RTC 115 .
Operation data D2: The CPU 301 acquires the current position (longitude/latitude) of the vehicle 3 from GPS.
Operation data D3: The CPU 301 acquires the running time of the vehicle 3 using time information from the RTC 115 .
Operation data D4: The CPU 301 acquires the travel distance of the vehicle 3 using the tire rotation pulse input to the rotation speed I/F 121 .
Operation data D5: The CPU 301 acquires the speed of the vehicle 3 using speed pulses input to the speed I/F 119 .
Operation data D6: The CPU 301 acquires the acceleration of the vehicle 3 using the signal from the acceleration sensor 280 that is input to the sensor I/F 123 .
Operation data D7: The CPU 301 acquires the engine speed of the vehicle 3 using engine speed pulses input to the engine I/F (not shown).
Operation data D8: The CPU 301 acquires the on/off state of the brake operation using the signal indicating the on/off state of the brake operation, which is input to the vehicle signal I/F 125 .
Operation data D9: The CPU 301 acquires on/off of accelerator operation using a signal indicating on/off of accelerator operation, which is input to the vehicle signal I/F 125 .

Note that the method of obtaining the operation data D1 to D9 is not limited to the method described above, and other methods may be used as long as appropriate values can be obtained.

The awakening device 10 is connected to the external I/F 129 . The external I/F 129 receives a transmission instruction including identification information of operation data to be specified from the awakening device 10 . When the transmission instruction is input, the CPU 101 outputs the operation data associated with the identification information included in the transmission instruction from the external I/F 129 to the awakening device 10 .

Note that the awakening device 10 may include the function of the operation recorder 100 . In this case, the awakening device 10 is further provided with a speed I/F 119, a rotation speed I/F 121, a sensor I/F 123, a vehicle signal I/F 125, and a card I/F 127.

[Configuration of office PC]
Next, the configuration of office PC 300 will be described. FIG. 6 is a block diagram of the office PC 300. As shown in FIG. As shown in FIG. 6, office PC 300 includes CPU 301, nonvolatile memory 303, volatile memory 305, hard disk 307, communication device 309, input device 311, display device 313, card I/F 315, and audio I/F 317. Prepare.

The CPU 301 executes programs stored in the nonvolatile memory 303 . CPU 301 performs arithmetic processing on the data loaded into volatile memory 305 according to the program, and controls each section of office PC 300 in an integrated manner.

The nonvolatile memory 303 stores programs and the like executed by the CPU 301 . Volatile memory 305 temporarily holds computation data when CPU 301 executes a program stored in nonvolatile memory 303 .

The hard disk 307 stores basic software such as an OS, application programs, and data related to these. Hard disk 107 stores the operation information recorded in memory card 290 . Note that the hard disk 307 may store the operation information when the operation information is transmitted from the operation recorder 100 .

Communication device 309 performs wireless communication via network 7 between awakening device 10 and office PC 300 . The communication device 309 receives instruction information from the awakening device 10 to instruct whether or not the driver of the vehicle 3 is awake. At this time, the communication device 309 receives the driver's video signal in real time. The communication device 309 transmits to the awakening device 10 that it has been confirmed that the driver of the vehicle 3 is awake.

When the wakefulness of the driver satisfies the wakeup execution condition, the communication device 309 receives notification of the occurrence of an alarm from the wakeup device 10 . When the generation of the arousal stimulus is stopped, the communication device 309 receives from the arousal device 10 a notification of the end of the alarm.

Communication device 309 performs wireless communication via network 7 between vehicle 3 and office PC 300 . The communication device 309 transmits a response request to the vehicle 3 in order to confirm whether the driver of the vehicle 3 is awake. The communication device 309 receives from the vehicle 3 a response from the driver of the vehicle 3 to the response request. The communication device 309 receives, as a response from the driver, at least one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the response action of the driver. .

Communication device 309 performs wireless communication via network 7 between operation recorder 100 and office PC 300 . When operation information is transmitted from the operation recorder 100, the communication device 309 receives the operation information.

The input device 311 is composed of buttons, a touch panel, etc., and receives input operations from the driver of the vehicle 3 or the like. A display device 313 is configured by a liquid crystal display or the like, and displays various information.

A memory card 290 is removably attached to the card I/F 315 . The memory card 290 is inserted into the card I/F 315 by the driver of the vehicle 3 when the vehicle 3 is parked, for example. As a result, the operation information recorded in the memory card 290 is read into the office PC 300 and processed.

A microphone 319 is connected to the audio I/F 317 . When transmitting a response request to the vehicle 3 in order to confirm whether the driver of the vehicle 3 is awake, the manager of the office 5 uses the microphone 319 to call. In this case, the manager's voice signal is input from the microphone 319 to the audio I/F 317 . The manager's voice signal is transmitted to the vehicle 3 by the communication device 309 as a response request.

A speaker 320 is connected to the audio I/F 317 . When the driver responds by voice to the response request from office PC 300 , the driver's voice signal is transmitted from vehicle 3 to communication device 309 . In this case, the driver's voice signal is output from audio I/F 317 to speaker 320 . As a result, the driver's voice is output from speaker 320 .

[Awakening System Operation]
Next, the operation of the awakening system 1 will be described. Specifically, an awakening procedure by the awakening device 10 and the office PC 300 will be described. FIG. 7 is a diagram showing a sequence of awakening procedures by the awakening device 10 and the office PC 300. FIG.

Note that the first awakening procedure is started when the ignition switch of the vehicle 3 is turned on. The second and subsequent awakening procedures are started when the previous awakening procedure is completed. Thus, the awakening procedure is continuously executed after the ignition switch of the vehicle 3 is turned on until the ignition switch is turned off.

As shown in FIG. 7, in the awakening device 10, the detection unit 19 detects the awakening state of the driver of the vehicle 3 (step S1). Specifically, based on the specified operation data, the image data of the driver, and the image data of the surroundings of the vehicle 3 within the same period, which are stored in the storage unit 17, the arousal state of the driver is detected. . In this embodiment, the detection unit 19 detects the speed of the vehicle 3, the condition of the driver's eyelids, the tilt of the driver's body, the presence or absence of the vehicle 3's lane departure, and the lane change of the vehicle 3 as the driver's arousal state. to detect the number of Note that step S1 is also called a first detection step.

In the awakening device 10, the determining unit 21 determines whether or not the awakening state detected by the detecting unit 19 satisfies the awakening execution condition (step S3). Specifically, the determination unit 21 determines whether the arousal state detected by the detection unit 19 satisfies the conditions A1 to A4 or the conditions A1 to A3, A5 shown in FIG. Note that step S3 is also called a first determination step.

If the determination unit 21 determines that the detected wakeful state does not satisfy the wakefulness execution condition, the determination unit 21 returns to the process of step S1. On the other hand, when judging that the detected arousal state satisfies the awakening execution condition, the judging section 21 notifies the office PC 300 of the occurrence of an alarm via the transmitting section 13 (step S5). As a result, the awakening device 10 and the office PC 300 transition from the alarm canceled state to the alarm state.

In the awakening device 10 , when the determining unit 21 determines that the detected awakening state satisfies the awakening execution conditions, the executing unit 23 uses at least one of the awakening means 25 and the terminal device 200 to perform Arousal stimulus is continuously generated. As a result, the execution unit 23 warns the driver with an awakening stimulus (step S7). Note that step S7 is also called an execution step.

Specifically, the execution unit 23 transmits an alarm signal to at least one of the awakening means 25 and the terminal device 200 to continuously generate the awakening stimulus. The awakening means 25 continuously generates at least one of alarm sound, alarm light, alarm smell, and alarm wind as an awakening stimulus based on the reception of the alarm signal. The terminal device 200 continuously generates at least one of an alarm sound, an alarm light, and an alarm vibration based on the reception of the alarm signal.

In the awakening device 10, when an awakening stimulus occurs, the detection unit 19 re-detects the driver's awakening state (step S9). Note that step S9 is also called a second detection step.

In the awakening device 10, the determining unit 21 determines whether or not the awakening state re-detected by the detecting unit 19 satisfies the awakening execution condition (step S11). Note that step S11 is also called a second determination step.

When the determination unit 21 determines that the re-detected wakefulness satisfies the wakefulness execution condition, the process returns to step S9. On the other hand, when the determining unit 21 determines that the re-detected arousal state does not satisfy the awakening execution condition, the executing unit 23 confirms whether or not the driver is awake via the transmitting unit 13. to instruct office PC 300 (step S13). Note that step S13 is also called an instruction step.

Specifically, execution unit 23 transmits instruction information to office PC 300 via transmission unit 13 to instruct whether or not the driver is awake. In step S<b>13 , execution unit 23 transmits a real-time video signal of the driver to office PC 300 via transmission unit 13 .

Office PC 300 displays the image of the driver on display device 313 upon receiving the real-time image signal of the driver. Thereby, the manager of the office 5 can confirm the driver's condition from the image displayed on the display device 313 .

Office PC 300 transmits a response request to vehicle 3 in order to confirm whether or not the driver of vehicle 3 is awake based on the instruction information from awakening device 10 (step S15). Specifically, when transmitting the response request to the vehicle 3 , the manager of the office 5 uses the microphone 319 to make a call. In this case, the manager's voice signal is input from the microphone 319 to the office PC 300 . Office PC 300 transmits a manager's voice signal to vehicle 3 as a response request. The manager's voice signal is input to the speaker in the vehicle 3 . As a result, the manager's call is output from the speaker in the vehicle 3 . The speaker in the vehicle 3 is the speaker 230 of the awakening device 10 or the speaker of the terminal device 200, for example.

After transmitting the response request to vehicle 3, office PC 300 determines whether or not there is a response from the driver (step S17). Specifically, the office PC 300 selects at least one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the driver's response operation as the response from the driver. Determine whether one has been received.

In the vehicle 3, when the driver vocally responds to the call from the manager, the office PC 300 receives the driver's voice signal. In this case, office PC 300 outputs the driver's voice from speaker 320 .

In the vehicle 3, when the driver responds to the call from the manager by operating the awakening device 10, the office PC 300 receives the operation signal of the awakening device 10 by the driver. In this case, office PC 300 displays on display device 313 that the operation signal has been received.

In the vehicle 3, when the driver responds to the call from the administrator by waving his hand toward the in-vehicle camera 210, the office PC 300 performs driving including the driver's response operation. receive video signals from other people. In this case, office PC 300 displays the image of the driver on display device 313 .

Thereby, the administrator can confirm the driver's response to the response request from the sound output from the speaker 320 or the image displayed on the display device 313 . After confirming the driver's response to the response request, the administrator inputs to the input device 311 that he has confirmed that the driver is awake.

If confirmation that the driver is awake is not input to input device 311, office PC 300 determines that there is no response from the driver, and returns to step S15. On the other hand, when a confirmation that the driver is awake is input to the input device 311, the office PC 300 determines that there is a response from the driver, and the driver of the vehicle 3 is awake. A message to the effect that it has been confirmed that the user is on is transmitted to the awakening device 10 (step S19).

When the office PC 300 receives at least one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the driver's response action, the office PC 300 receives the vehicle 3 may be transmitted to the awakening device 10 to the effect that it is confirmed that the driver is awake.

In the awakening device 10, when the office PC 300 notifies the execution unit 23 of the awakening means 25 and the terminal device 200 via the reception unit 11 that the driver is awake. Generation of wakeful stimuli using at least one is stopped (step S21). Specifically, the execution unit 23 transmits an alarm stop signal to at least one of the awakening means 25 and the terminal device 200 to stop generation of the awakening stimulus. Note that step S21 is also called a stop step.

In the awakening device 10, when the generation of the awakening stimulus using the awakening means 25 or the terminal device 200 is stopped, the execution unit 23 notifies the office PC 300 of the end of the alarm (step S23). Specifically, when the execution unit 23 transmits an alarm stop signal to at least one of the awakening unit 25 and the terminal device 200, the execution unit 23 notifies the office PC 300 of the end of the alarm via the transmission unit 13. . As a result, the awakening device 10 and the office PC 300 transition from the alarm state to the alarm canceled state.

The expression "instruction information for instructing to confirm whether or not the driver is awake" can be rephrased as "warning cancellation request". Moreover, the above-mentioned expression "to confirm that the driver is awake" can be rephrased as "alert cancellation".

From these paraphrasing, the following can be said.
In step S<b>13 , when the determination unit 21 of the awakening device 10 determines that the re-detected arousal state does not satisfy the awakening execution condition, the execution unit 23 issues an alarm cancellation request via the transmission unit 13 . Send to the local PC 300 .
- In step S19, when the office PC 300 determines that there is a response from the driver, the office PC 300 transmits an alarm cancellation to the awakening device 10.
In step S21, when the execution unit 23 of the awakening device 10 is notified of the cancellation of the alarm from the office PC 300, the generation of the awakening stimulus using at least one of the awakening means 25 and the terminal device 200 is stopped. do.
・In this way, based on the instruction from the office PC 300, the awakening device 10 stops generating the awakening stimulus.

[Action/effect]
According to this embodiment, the awakening device 10 comprises a detection unit 19 , a determination unit 21 and an execution unit 23 . The detector 19 detects the wakefulness of the driver of the vehicle 3 . The determination unit 21 determines whether or not the awakening state detected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the detected arousal state satisfies the awakening execution condition, the execution unit 23 causes the vehicle 3 to generate an awakening stimulus using the awakening means 25 .

The detection unit 19 re-detects the driver's wakefulness when the wakeful stimulus is generated. The determination unit 21 determines whether or not the awakening state re-detected by the detection unit 19 satisfies the awakening execution condition. When the determination unit 21 determines that the re-detected arousal state does not satisfy the awakening execution condition, the execution unit 23 instructs the outside of the vehicle 3 to confirm whether or not the driver is awake. When notified from the outside of the vehicle 3 that it has been confirmed that the driver is awake, the execution unit 23 stops generating the awakening stimulus using the awakening means 25 .

With such a configuration, the awakening device 10 wakes up when it receives from the outside of the vehicle 3 confirmation that the driver's wakefulness does not satisfy the awakening execution condition and that the driver is awake. The generation of the arousal stimulus using means 25 is stopped.

Therefore, even if the awakening device 10 determines that the driver's awakening state no longer satisfies the awakening execution condition even though the driver is not actually awakened, the awakening stimulus is not stopped immediately. . The awakening device 10 continues to generate the awakening stimulus using the awakening means 25 until it receives from the outside of the vehicle 3 that it is confirmed that the driver is awake. You can definitely wake up.

Therefore, according to the present embodiment, the awakening device 10 can wake up the driver more reliably using the awakening stimulus.

According to the present embodiment, the execution unit 23 transmits a real-time video signal of the driver to the outside of the vehicle 3 when instructing the outside of the vehicle 3 to check whether the driver is awake. do.

With such a configuration, by displaying the video signal of the driver in real time on the display device outside the vehicle 3, the driver's condition can be visually confirmed. Therefore, it is possible to reliably confirm whether or not the driver is awake outside the vehicle 3 .

According to this embodiment, the execution unit 23 generates at least one of an auditory stimulus, a visual stimulus, an olfactory stimulus, and a somatosensory stimulus as the arousal stimulus.

With this configuration, when the driver's wakefulness satisfies the wakeup execution condition, the wakeup device 10 stimulates at least one of the driver's hearing, sight, smell, and somatosensory senses to stimulate the driver. can be awakened. Therefore, the awakening device 10 can easily awaken the driver using the awakening stimulus.

According to this embodiment, the detection unit 19 detects the awakening state based on the state of the driver, the running state of the vehicle 3, and the driving operation of the driver.

With such a configuration, the detection unit 19 detects the arousal state of the driver by combining the state of the driver, the running state of the vehicle 3, and the driving operation of the driver. Therefore, compared to the case where the detection unit 19 detects the arousal state of the driver based on one of the state of the driver, the running state of the vehicle 3, and the driving operation of the driver, can be detected in detail in the arousal state of

According to this embodiment, the awakening system 1 includes the above-described awakening device 10 and the office PC 300 connected to the awakening device 10 via wireless communication. Office PC 300 receives instruction information for instructing the outside of vehicle 3 that awakening device 10 confirms whether the driver is awake. Office PC 300 transmits a response request to vehicle 3 in response to receiving the instruction information. When the office PC 300 receives a response from the driver to the response request from the vehicle 3, the office PC 300 notifies the awakening device 10 that it has been confirmed that the driver is awake.

With such a configuration, in the awakening system 1, the awakening device 10 receives from the office PC 300 confirmation that the driver's awakening state does not satisfy the awakening execution condition and that the driver is awake. generation of the awakening stimulus using the awakening means 25 is stopped.

Therefore, even if the awakening device 10 determines that the driver's awakening state no longer satisfies the awakening execution condition even though the driver is not actually awakened, the awakening stimulus is not stopped immediately. . The awakening device 10 continues to generate the awakening stimulus using the awakening means 25 until it receives from the office PC 300 confirmation that the driver is awake. can be awakened to

Therefore, according to the present embodiment, the awakening system 1 can more reliably awaken the driver using the awakening stimulus.

According to the present embodiment, the office PC 300 receives, as a response from the driver, one of the driver's voice signal, the driver's operation signal of the awakening device 10, and the driver's video signal including the response action of the driver. , at least one.

With such a configuration, in response to a response request from the office PC 300, the driver is required to perform at least one action out of voice response, operation of the awakening device 10, and response action such as waving. There is Therefore, office PC 300 can reliably confirm that the driver is awake.

According to this embodiment, the office PC 300 receives the real-time driver's video signal from the awakening device when receiving the instruction information. The office PC 300 displays the driver's video signal in real time on the display device 313 .

With such a configuration, by displaying a real-time video signal of the driver on the display device 313 in the office PC 300, the driver's condition can be visually confirmed. Therefore, it is possible to reliably confirm whether or not the driver is awake on the office PC 300 .

According to this embodiment, the awakening program causes the computer to execute a first detection step, a first determination step, an execution step, a second detection step, a second determination step, an instruction step, and a stop step.

The first detection step detects the wakefulness of the driver of the vehicle 3 . The first determination step determines whether or not the awakened state detected by the first detection step satisfies the awakening execution condition. The execution step uses the awakening means 25 to generate an awakening stimulus in the vehicle 3 when the first determination step determines that the detected awakening state satisfies the awakening execution condition.

The second detection step re-detects the arousal state of the driver when the arousal stimulus occurs. The second determination step determines whether or not the awakened state re-detected by the second detection step satisfies the awakening execution condition. The instruction step instructs the outside of the vehicle 3 to confirm whether the driver is awake when the second determination step determines that the re-detected arousal state does not satisfy the awakening execution condition. In the stop step, when it is notified from the outside of the vehicle 3 that it has been confirmed that the driver is awake, the generation of the arousal stimulus using the awakening means 25 is stopped.

With such a configuration, the configuration of the awakening device 10 described above can be realized as software by a program loaded into the memory. Therefore, according to the present embodiment, by causing the computer to execute the awakening program, the driver can be more reliably awakened using the awakening stimulus.

[Modification]
In the above-described embodiment, the dangerous driving state is set as the awakening state in which the awakening device 10 needs to generate the awakening stimulus, but the present invention is not limited to this. In this modified example, a low alert driving state and a dangerous driving state are set as the arousal state in which the awakening device 10 needs to generate an awakening stimulus.

The unconscious running state is an arousal state in which attention is reduced due to less change in the line of sight during running. A driver who falls into a sluggish driving state does not have subjective symptoms such as drowsiness, and his attention is reduced even though his eyes are wide open. A sluggish driving state tends to occur in a straight section of an expressway. In particular, when the vehicle has an auto-cruise function, the driver can drive the vehicle at a constant set speed without operating the accelerator on a straight section of a highway. A running state is likely to occur.

Thus, the arousal state of the driver is affected by the road conditions on which the vehicle is traveling. Therefore, in the present embodiment, the detection unit 19 detects the road state in order to complement the detection of the driver's arousal state. The detection unit 19 detects the following information from the image data around the vehicle 3 as road conditions. The detection unit 19 performs image analysis on the image data around the vehicle 3 to detect the shape of the road on which the vehicle 3 is traveling, the presence or absence of a traffic light, and the presence or absence of a pedestrian crossing.

The information detected from the image data around the vehicle 3 is not limited to the shape of the road, the presence or absence of a traffic light, or the presence or absence of a crosswalk. good.

Note that the detection unit 19 may detect road conditions from the operation data of the operation recorder 100 . In this case, the operation recorder 100 records the road segment as new operation data D10. Specifically, the operation recorder 100 interlocks with ETC (ELECTRONIC TOLL COLLECTION SYSTEM) to identify whether the road on which the vehicle 3 is traveling is a general road or a highway, Record road conditions.

Further, in the present embodiment, the detection unit 19 detects the following information from the designated operation data, the image data of the driver, and the image data around the vehicle 3 as the driver's arousal state.

The detection unit 19 detects the speed of the vehicle 3, the on/off state of the brake operation, and the on/off state of the accelerator operation from the designated operation data D5, D8, and D9. The detection unit 19 analyzes the image data of the driver to detect the state of the driver's eyelids, the movement of the driver's line of sight, and the movement/inclination of the driver's body. The detection unit 19 performs image analysis on the image data around the vehicle 3 to detect whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3 .

The designated operation data is not limited to the operation data D5, D8, D9, and may be any data that can detect the driver's driving operation characteristically appearing in the dull driving state and the dangerous driving state. The information detected from the driver's image data is not limited to the condition of the driver's eyelids, the movement of the driver's line of sight, and the movement and inclination of the driver's body. Any information may be used as long as it can detect the driver's condition that appears characteristically. The information detected from the image data around the vehicle 3 is not limited to whether or not the vehicle 3 has deviated from the lane and the number of times the vehicle 3 has changed lanes. Any information that can detect the state of

The determination unit 21 determines whether the wakefulness state and the road state detected by the detection unit 19 satisfy the wakefulness execution condition.

FIG. 8 is a diagram showing an example of an awakening execution condition. Conditions B1 to B9 shown in FIG. 8 are awakening execution conditions used to determine whether or not the driver's awakening state is the low-wake state.

If the arousal state detected by the detection unit 19 satisfies the conditions B1 to B6 and the road state detected by the detection unit 19 satisfies the conditions B7 to B9, the determination unit 21 determines that the arousal state of the driver is It is determined that the vehicle is in a slow running state. Conditions B2 and B3 are removed when the vehicle 3 does not have the auto-cruise function.

If the arousal state detected by the detection unit 19 satisfies the conditions A1 to A4 or the conditions A1 to A3 and A5 shown in FIG. do.

If the arousal state detected by the detection unit 19 does not satisfy the conditions A1 to A5 and the conditions B1 to B6 and the road state detected by the detection unit 19 does not satisfy the conditions B7 to B9 , the arousal state of the driver is determined not to satisfy the arousal execution condition.

When the determination unit 21 determines that the wakefulness state of the driver and the road condition satisfy the wakeup execution conditions, the execution unit 23 uses at least one of the wakeup means 25 and the terminal device 200 to wake up in the vehicle 3 . Continue to generate stimulation.

After the arousal stimulus is generated, when the determination unit 21 determines that the arousal state of the driver and the road state do not satisfy the arousal execution condition, the execution unit 23 determines whether the driver is awake via the transmission unit 13. Office PC 300 is instructed to confirm whether or not.

According to this embodiment, the detection unit 19 detects the road conditions on which the vehicle 3 is traveling in order to complement the detection of the wakefulness. The determination unit 21 determines whether or not the combination of the arousal state detected by the detection unit 19 and the road state satisfies the arousal execution condition. When the determination unit 21 determines that the combination of the detected arousal state and the road state satisfies the awakening execution condition, the execution unit 23 uses the awakening means 25 to generate an awakening stimulus.

With such a configuration, the detection unit 19 can detect that the driver's arousal state is the unconscious driving state. For this reason, the detection unit 19 can detect different arousal states in which attention is lowered in a distinguishable manner.

According to this embodiment, the detection unit 19 re-detects the road state when an awakening stimulus occurs. The determination unit 21 determines whether or not the combination of the wakeful state re-detected by the detection unit 19 and the road state satisfies the wakefulness execution condition. When the determination unit 21 determines that the re-detected combination of the arousal state and the road state does not satisfy the awakening execution condition, the execution unit 23 instructs the vehicle 3 to confirm whether or not the driver is awake. direct to the outside of

With such a configuration, the arousal device 10 can distinguishably detect different arousal states in which attention is lowered, and instruct the outside of the vehicle 3 to check whether the driver is awake. can.

[Other embodiments]
In the above-described embodiment, the detection unit 19 analyzes the image data around the vehicle 3 to detect whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3. However, the detection unit 19 is not limited to this. For example, the operation recorder 100 analyzes the image data of the surroundings of the vehicle 3 from the outside camera 220 as new operation data, and detects whether the vehicle 3 has deviated from the lane and the number of lane changes of the vehicle 3. You may

In the above-described embodiment, if office PC 300 does not receive a response from the driver to the response request from vehicle 3 even after a predetermined period of time has elapsed, office PC 300 repeatedly transmits the response request, but is not limited to this. For example, if the office PC 300 does not receive a response from the driver to the response request from the vehicle 3 after a predetermined period of time has passed, the office PC 300 issues an alarm outside the vehicle 3 to warn vehicles, pedestrians, etc. outside the vehicle 3. You can let us know of any anomalies. Examples of the warning include sounding the horn of the vehicle 3 and blinking the hazard lamps of the vehicle 3 .

Although the present embodiment has been described above, the present embodiment is not limited to these, and various modifications are possible within the scope of the gist of the present embodiment.

REFERENCE SIGNS LIST 1 awakening system 3 vehicle 10 awakening device 19 detector 21 determination unit 23 execution unit 25 awakening means 300 office PC

Claims (8)

a detection unit that detects the arousal state of the driver of the vehicle;
a determination unit that determines whether the wakeful state detected by the detection unit satisfies an alertness execution condition;
an execution unit for generating an awakening stimulus in the vehicle using an awakening means when the determining unit determines that the detected arousal state satisfies the awakening execution condition;
with
The detection unit re-detects the arousal state of the driver when the arousal stimulus occurs,
The determination unit determines whether or not the awakening state re-detected by the detection unit satisfies the awakening execution condition,
When the determination unit determines that the re-detected arousal state does not satisfy the awakening execution condition, the execution unit instructs the outside of the vehicle to confirm whether the driver is awake. death,
The wake-up device, wherein the execution unit stops generation of the wake-up stimulus using the wake-up means when notified from the outside of the vehicle that it is confirmed that the driver is awake. 2. The execution unit transmits a real-time image signal of the driver to the outside of the vehicle when instructing the outside of the vehicle to confirm whether the driver is awake. Awakening device as described. 3. The awakening device according to claim 1, wherein the execution unit generates at least one of an auditory stimulus, a visual stimulus, an olfactory stimulus, and a somatosensory stimulus as the arousal stimulus. 4. The awakening device according to any one of claims 1 to 3, wherein the detection unit detects the awakening state based on the state of the driver, the running state of the vehicle, and the driving operation of the driver. The detection unit detects a road condition on which the vehicle is traveling in order to complement detection of the arousal state,
The determination unit determines whether a combination of the wakeful state detected by the detection unit and the road state satisfies the wakefulness execution condition,
3. When the judging unit judges that the combination of the detected arousal state and the road state satisfies the awakening execution condition, the execution unit generates the awakening stimulus using the awakening means. 5. The awakening device according to 4. The awakening device according to any one of claims 1 to 5;
an external device connected to the awakening device via wireless communication;
with
The external device receives instruction information for instructing the outside of the vehicle that the awakening device confirms whether the driver is awake,
The external device transmits a response request to the vehicle in response to receiving the instruction information,
A wake-up system in which the external device notifies the wake-up device that it has been confirmed that the driver is awake when receiving a response from the driver to the response request from the vehicle. The external device, as a response from the driver, selects at least one of the driver's voice signal, the driver's operation signal of the awakening device, and the driver's video signal including the response action of the driver. 7. The arousal system of claim 6, receiving one. a first detection step of detecting an arousal state of the driver of the vehicle;
a first determination step of determining whether the wakeful state detected by the first detection step satisfies an alertness execution condition;
If the first determining step determines that the detected arousal state satisfies an arousal execution condition, an execution step of generating an arousal stimulus in the vehicle using an arousal means;
a second detection step of re-detecting the arousal state of the driver when the arousal stimulus occurs;
a second determination step of determining whether the wakeful state re-detected by the second detection step satisfies the wakefulness execution condition;
an instruction step of instructing the outside of the vehicle to confirm whether or not the driver is awake when the second determination step determines that the re-detected arousal state does not satisfy the awakening execution condition; ,
a stopping step of stopping generation of the awakening stimulus using the awakening means when notified from outside the vehicle that the driver has confirmed that the driver is awake;
A wake-up program that causes the computer to run

Images