JP2018195250A - Operation support system and wearable device - Google Patents

Abstract

To provide an operation support system and wearable device, capable of achieving highly intelligent operation support suited to a fitting state and a physical status of a wearable device of a driver.SOLUTION: An information acquisition part 16 acquires a sensor signal Sa (an acceleration sensor signal Sa1 and a heart beat sensor signal Sa2) from a first sensor 12 for detecting a physical amount of movement of a wearable device 2 and a second sensor 13 for detecting biological information of a wearer of the wearable device 2. A state monitoring part 17 monitors a fitting state of the wearable device 2 and a physical status of a driver on the basis of the acceleration sensor signal Sa1 and the heart beat sensor signal Sa2. An operation processing part 18 makes a vehicle 1 execute processing suited to the monitoring result on the basis of the monitoring result of the state monitoring part 17.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a driving support system and a wearable device that supports driving of a vehicle using a wearable device attached to a driver.

  2. Description of the Related Art Conventionally, a driving support system that controls a driving state of a vehicle using a wearable device worn by a user is well known (see Patent Document 1 and the like). Wearable devices can measure the number of steps, distance traveled, exercise, etc. of a wearer, and are mainly used for health management.

JP 2017-37359 A

  By the way, in patent document 1, although wearing of a wearable device is obligatory, there is no mention about detecting the wearing state of a wearable device. In addition, there is a need to control the vehicle in consideration of the physical condition of the driver when supporting the vehicle driving using the wearable device.

  An object of the present invention is to provide a driving support system and a wearable device that can realize advanced driving support according to the wearing state and physical condition of the wearable device of the driver.

  The driving support system that solves the above problems can detect a physical quantity of movement generated in a wearable device worn by a driver of the vehicle and biometric information of the driver wearing the wearable device. Based on the information acquisition unit for acquiring each sensor signal from the second sensor, and each sensor signal of the first sensor and the second sensor, the wearing state of the wearable device and the physical condition of the driver are monitored. And an operation processing unit that causes the vehicle to execute processing according to the monitoring result based on the monitoring result of the state monitoring unit.

  According to this structure, the wearable device provided with the 1st sensor which detects the physical quantity of a motion, and the 2nd sensor which detects a driver | operator's biometric information is used, The output of these sensors is used, Monitor the wearing state and the physical condition of the driver. And based on the monitoring result, a vehicle is made to perform the process according to the monitoring result. Therefore, it is possible to realize high-level driving support according to the wearing state and physical condition of the wearable device of the driver.

  In the driving support system, when the sensor signal of the second sensor is in an off state, the state monitoring unit checks the sensor signal of the first sensor by interrupt processing, and wear information on the wearable device and the body of the driver It is preferable to determine the situation and cause the operation processing unit to execute an operation according to the result. According to this configuration, when the sensor signal of the second sensor is in the off state, there is a high possibility that an abnormality has occurred in the physical condition of the driver. Therefore, it is possible to check the sensor signal of the first sensor at an appropriate timing at which there is a high possibility that an abnormality has occurred in the driver's physical condition, and to execute the optimum process to be taken in that case.

  In the driving support system, when the state monitoring unit confirms the sensor signal of the first sensor by the interrupt process, if the sensor signal of the first sensor is in an off state, the driver's physical condition is abnormal. It is preferable that the operation processing unit execute an operation that determines that there is a driver and ensures the safety of the driver. According to this configuration, even if an abnormality occurs in the physical condition of the driver, it is possible to cause the vehicle to take an action corresponding to the abnormality. Therefore, even if the vehicle is in a state where normal traveling cannot be ensured, it is possible to avoid the disruption of the traffic state.

  In the driving support system, when the state monitoring unit confirms the sensor signal of the first sensor by the interrupt process and the sensor signal of the first sensor is on, the driver removes the wearable device. It is preferable to cause the operation processing unit to execute a warning that prompts the user to wear the wearable device. According to this configuration, the wearable device can be reattached while paying attention to the user that the wearable device has been removed.

  The wearable device that solves the above problems includes a first sensor that can detect a physical quantity of movement generated in a wearer, a second sensor that can detect biological information of the wearer, the first sensor, and the second sensor. An information acquisition unit that acquires each sensor signal from, a state monitoring unit that monitors the wearing state of the wearable device and the physical condition of the driver based on the sensor signals of the first sensor and the second sensor, And an operation processing unit that causes the vehicle to execute processing according to the monitoring result based on the monitoring result of the state monitoring unit.

  ADVANTAGE OF THE INVENTION According to this invention, the high degree driving assistance according to the wearing condition and physical condition of a driver | operator's wearable device is realizable.

The block diagram of the driving assistance system and wearable device of one Embodiment. The schematic diagram when transmitting the automatic driving | operation switching notification from a vehicle to a wearable device. The timing chart of the sensor output of a 1st sensor and a 2nd sensor. A table summarizing a series of processes for controlling the vehicle by monitoring the state of the driver. (A), (b) is explanatory drawing which shows the operation example of process (I). Explanatory drawing which shows the operation example of process (II). Explanatory drawing which shows the operation example of process (III).

Hereinafter, an embodiment of a driving support system and a wearable device will be described with reference to FIGS.
As shown in FIG. 1, the vehicle 1 includes a driving support system 3 that supports driving while using a wearable device 2. The driving support system 3 of this example uses the wearable device 2 to monitor the wearing state of the wearable device 2 and the physical condition of the driver (the wearer of the wearable device 2), and the vehicle 1 performs an operation based on the monitoring result. To be executed. The wearable device 2 is preferably a wristband type, for example.

  The wearable device 2 includes a device control unit 6 that controls the operation of the wearable device 2, and a communication unit 7 that communicates with the vehicle 1 in the wearable device 2. The vehicle 1 also includes a system control unit 8 that controls the operation of the driving support system 3 and a communication unit 9 that communicates with the wearable device 2 in the vehicle 1. The communication between the vehicle 1 and the wearable device 2 is preferably, for example, bidirectional narrow area communication. As narrowband communication, for example, communication using radio waves in the LF (Low Frequency) band, communication using radio waves in the UHF (Ultra High Frequency) band, communication using Bluetooth (Bluetooth: registered trademark), etc. are used. Is preferred.

  The wearable device 2 includes a first sensor 12 capable of detecting a physical quantity of movement generated in the wearable device 2 worn by a driver (wearer) of the vehicle 1 and biological information (for example, heartbeat) of the driver wearing the wearable device 2. Etc.). The first sensor 12 is, for example, an acceleration sensor 12a, and outputs a detection value of a sensor signal Sa (acceleration sensor signal Sa1) corresponding to the movement generated by the driver to the device control unit 6. The second sensor 13 is, for example, a heart rate sensor 13a, and outputs a sensor signal Sa (heart rate sensor signal Sa2) corresponding to the driver's heart rate (biological information detected by the second sensor 13) to the device control unit 6. To do.

  The driving support system 3 includes an information acquisition unit 16 that acquires sensor signals Sa (acceleration sensor signal Sa1 and heart rate sensor signal Sa2) of the first sensor 12 and the second sensor 13. The information acquisition unit 16 is provided in the device control unit 6. The information acquisition unit 16 periodically monitors the outputs of the first sensor 12 and the second sensor 13 and acquires the sensor signal Sa output from the first sensor 12 and the second sensor 13.

  The driving support system 3 includes a state monitoring unit 17 that monitors the wearing state of the wearable device 2 and the physical state of the driver based on the sensor signal Sa (the acceleration sensor signal Sa1 and the heart rate sensor signal Sa2). The state monitoring unit 17 is provided in the system control unit 8 of the vehicle 1. In this example, the wearing state of the wearable device 2 is whether or not the wearable device 2 is attached. The physical condition of the driver is a physical condition related to the life of the driver estimated from the heartbeat.

  The driving support system 3 includes an operation processing unit 18 that causes the vehicle 1 to execute processing according to the monitoring result of the state monitoring unit 17. The operation processing unit 18 of this example includes a first operation processing unit 18a provided in the wearable device 2 (device control unit 6) and a second operation processing unit 18b provided in the vehicle 1 (system control unit 8). Prepare.

  The first operation processing unit 18 a transmits an operation request K corresponding to the monitoring result based on the monitoring result of the state monitoring unit 17. As the operation request K, there are an operation request K1 for causing the vehicle 1 to perform an operation for ensuring the safety of the driver, an operation request K2 for informing the vehicle 1 of a warning prompting the user to wear the wearable device 2, and the like. The operation request K is transmitted from the wearable device 2 to the vehicle 1 through the communication unit 7.

  Based on the operation request K acquired from the wearable device 2, the second operation processing unit 18 b causes the vehicle 1 to execute a process according to the monitoring result using, for example, the buzzer 21, the travel control unit 22, and the on-vehicle meter 23. . The buzzer 21 can output a warning sound to the outside of the vehicle, and can notify the surroundings of the vehicle 1 that an abnormality has occurred to the driver of the host vehicle. The traveling control unit 22 switches the traveling speed, the steering angle, and the like by controlling the engine, the steering mechanism, and the like according to various traveling operations, for example. The in-vehicle meter 23 is provided on the instrument panel of the driver's seat and displays various information such as speed and range position.

Next, the operation and effect of the driving support system 3 according to the embodiment of the present invention will be described with reference to FIGS.
As shown in FIG. 2, when the vehicle 1 shifts from the normal driving mode to the automatic driving mode, the vehicle 1 transmits an automatic driving switching notification Sk1 that notifies the wearable device 2 to that effect from the communication unit 9 to the wearable device 2. When the wearable device 2 receives the automatic driving switching notification Sk1 transmitted from the vehicle 1, the wearable device 2 activates the first sensor 12 and the second sensor 13 to detect the physical state of the driver and the wearing state of the wearable device 2. Start processing. Thus, a series of processes of this example are performed during automatic operation.

  As shown in FIG. 3, the state monitoring unit 17 checks the acceleration sensor signal Sa1 of the acceleration sensor 12a when the heartbeat sensor signal Sa2 of the heartbeat sensor 13a is switched from the on state (Hi) to the off state (Low). And an operation for confirming Hi / Low of the acceleration sensor signal Sa1. Further, the state monitoring unit 17 generates an interrupt signal Sr2 for confirming the heart rate sensor signal Sa2 of the heart rate sensor 13a when the acceleration sensor signal Sa1 of the acceleration sensor 12a is switched from the off state (Low) to the on state (Hi). To confirm the Hi / Low of the heart rate sensor signal Sa2.

  FIG. 4 shows a table summarizing a series of operations of this example. When the acceleration sensor signal Sa1 of the acceleration sensor 12a is confirmed when the heart rate sensor 13a is switched from on to off, the on / off state of the acceleration sensor 12a is confirmed (processing of the interrupt signal Sr1). At this time, if the acceleration sensor signal Sa1 of the acceleration sensor 12a is in the OFF state, the process (I) is executed as an operation for ensuring the safety of the driver. The process (I) in this example is a process for notifying the driver of an abnormality and shifting the vehicle 1 to the safety mode.

  5A and 5B show a specific example of the process (I). As shown in FIG. 5A, when the first operation processing unit 18a checks the acceleration sensor signal Sa1 of the acceleration sensor 12a when the heart rate sensor 13a is switched from on to off, the acceleration sensor signal Sa1 of the acceleration sensor 12a If it is in the off state, an operation request K1 for requesting execution of an operation for ensuring the safety of the driver is transmitted from the communication unit 7 to the vehicle 1. When the communication unit 9 receives the operation request K1 transmitted from the wearable device 2, the second operation processing unit 18b executes a countermeasure according to the operation request K1. Specifically, as shown in FIG. 5B, a warning is sounded from the buzzer 21 to the surroundings, and the vehicle 1 is stopped on the road shoulder.

  Returning to FIG. 4, when the acceleration sensor signal Sa1 of the acceleration sensor 12a is confirmed when the heart rate sensor 13a is switched from on to off, if the acceleration sensor signal Sa1 of the acceleration sensor 12a is on, the wearable device 2 is attached. Process (II) is executed as an urging action. The process (II) in this example is a process for giving a warning prompting the driver to wear the wearable device 2.

  FIG. 6 shows a specific example of the process (II). As shown in the figure, when the first operation processing unit 18a confirms the acceleration sensor signal Sa1 of the acceleration sensor 12a when the heart rate sensor 13a is switched from on to off, the acceleration sensor signal Sa1 of the acceleration sensor 12a is in the on state. If so, the communication unit 7 transmits an operation request K2 for requesting execution of an operation for prompting the wearing of the wearable device 2 to the vehicle 1. When the communication unit 9 receives the operation request K2 transmitted from the wearable device 2, the second operation processing unit 18b executes a countermeasure according to the operation request K2. Specifically, the wearable device 2 attachment request is displayed on the vehicle-mounted meter 23 in the driver's seat.

  Returning to FIG. 4, when the acceleration sensor signal Sa1 of the acceleration sensor 12a is switched on within a predetermined time after the execution of the processing (II), the on / off state of the heart rate sensor 13a is confirmed (processing of the interrupt signal Sr2). . At this time, if the heart rate sensor signal Sa2 of the heart rate sensor 13a is in the ON state, the process (III) is executed as the release of the operation for prompting the wearable device 2 to be worn. The process (III) in this example is a process for canceling the warning that prompts the wearable device 2 to be mounted. On the other hand, if the heart rate sensor signal Sa2 of the heart rate sensor 13a is in the off state, the vehicle 1 is executed to ensure the safety of the driver.

  FIG. 7 illustrates a specific example of the process (III). As shown in the figure, the first operation processing unit 18a urges wearing of the wearable device 2 if the heart rate sensor signal Sa2 of the heart rate sensor 13a is on when the on / off of the heart rate sensor 13a is confirmed by the interrupt signal Sr2. An operation request K3 requesting release of the warning is transmitted from the communication unit 7 to the vehicle 1. The 2nd operation process part 18b will cancel | release the warning currently displayed on the vehicle-mounted meter 23, if the communication request | requirement K3 transmitted from the wearable device 2 is received.

  In the case of this example, the wearable device 2 provided with the first sensor 12 for detecting the physical quantity of movement and the second sensor 13 for detecting the biological information of the driver is used. The wearing state of the wearable device 2 and the physical condition of the driver are monitored using the output of the two sensors 13. And based on the monitoring result, the vehicle 1 is made to perform the process according to the monitoring result. Therefore, it is possible to realize high-level driving assistance according to the wearing state and physical condition of the wearable device 2 of the driver.

  When the heart rate sensor signal Sa2 of the second sensor 13 is in the off state, the state monitoring unit 17 checks the acceleration sensor signal Sa1 of the first sensor 12 by interrupt processing, and wears the wearable device 2 and the physical condition of the driver And the operation processing unit 18 is caused to execute an operation corresponding to the result. By the way, when the heart rate sensor signal Sa2 of the second sensor 13 is in the OFF state, there is a high possibility that an abnormality has occurred in the physical condition of the driver. Therefore, the acceleration sensor signal Sa1 of the first sensor 12 can be confirmed at an appropriate timing when there is a high possibility that an abnormality has occurred in the physical condition of the driver, and the optimum process to be taken in that case can be executed. Become.

  The state monitoring unit 17 determines that the driver's physical condition is abnormal if the acceleration sensor signal Sa1 of the first sensor 12 is off when the acceleration sensor signal Sa1 of the first sensor 12 is confirmed by interrupt processing. Then, the operation processing unit 18 is caused to execute an operation for ensuring the safety of the driver (in this example, the processing (I)). For this reason, even if an abnormality occurs in the physical condition of the driver, the vehicle 1 can be operated according to the abnormality. Therefore, even if the vehicle 1 is in a state where normal traveling cannot be ensured, it is possible to avoid disruption of the traffic state.

  When the state monitoring unit 17 confirms the acceleration sensor signal Sa1 of the first sensor 12 by interrupt processing, if the acceleration sensor signal Sa1 of the first sensor 12 is on, the driver has removed the wearable device 2. The operation processing unit 18 executes a warning (in this example, processing (II)) that makes a determination and prompts the wearable device 2 to be mounted. Therefore, the wearable device 2 can be reattached while paying attention to the user that the wearable device 2 has been removed.

  A series of processes for monitoring the sensor signals Sa of the first sensor 12 and the second sensor 13 and causing the vehicle 1 to execute processes based on the monitoring results are executed when the vehicle 1 is in automatic driving. Therefore, it is possible to prevent the wearable device 2 from being removed during automatic driving and to monitor the physical condition of the driver during automatic driving, which is advantageous for safely performing automatic driving. Become.

  The operation for ensuring the driver's safety (processing (I) in this example) is a warning that the driver has an abnormality. Therefore, the driver's abnormality can be notified to the surroundings through a warning that the driver has an abnormality.

  The operation for ensuring the safety of the driver is an operation for shifting the vehicle 1 to the safety mode (the processing (I) in this example). As a result, when the driver's physical condition is abnormal, the vehicle 1 can be shifted to the safety mode to make it difficult to influence other surrounding vehicles. Therefore, disruption of traffic conditions can be avoided.

Note that the embodiment is not limited to the configuration described so far, and may be modified as follows.
When performing automatic driving, whether or not automatic driving is possible may be transmitted to the vehicle 1 depending on whether or not the wearable device 2 is attached. In this case, automatic operation is not started unless the wearable device 2 is attached, which is advantageous for safely performing automatic operation.

The first sensor 12 is not limited to the acceleration sensor 12a, and may be changed to a gyro sensor, a direction sensor, or the like.
The second sensor 13 is not limited to the heart rate sensor 13a, but may be changed to a pulse wave sensor, a cardiac potential sensor, a skin electrical activity sensor, a skin humidity sensor, a bioimpedance sensor, or the like.

The wearing state of the wearable device 2 to be monitored is not limited to the presence or absence of wearing, and can be changed to other modes, for example, detecting that the wearable device 2 is not firmly attached.
-The physical condition of the driver to be monitored can be changed to various parameters as long as normal driving cannot be ensured.

The warning that prompts the user to wear the wearable device 2 can be changed to various modes such as voice notification or the wearable device 2.
-The safety mode of the vehicle 1 should just be the process which can transfer the vehicle 1 to a safe state.

-The operation | movement which ensures a driver | operator's safety is not limited to the warning to the circumference | surroundings, or the process which transfers the vehicle 1 to safety mode, What is necessary is just an operation | movement which can protect a driver | operator's body.
A series of processes for controlling the vehicle 1 by monitoring the driver's state (wearing device 2 wearing state, driver's physical condition) is not limited to being performed during automatic driving, but is performed during manual driving. May be.

  The sensor signals Sa of the first sensor 12 and the second sensor 13 may be transmitted as they are to the vehicle 1 from the wearable device 2 and the driver may be monitored on the vehicle 1 side. In this case, the functional blocks (information acquisition unit 16, state monitoring unit 17, operation processing unit 18) of the driving support system 3 are provided in the vehicle 1 (system control unit 8).

-The process according to the monitoring result of the state monitoring part 17 is not limited to the above-mentioned process (I)-(III), You may change into another aspect.
The wearable device 2 is not limited to the wristband type, and may be changed to another shape.

Communication between the vehicle 1 and the wearable device 2 is not limited to bidirectional communication, and may be unidirectional communication from the wearable device 2 to the vehicle 1.
Next, technical ideas that can be grasped from the above-described embodiment and other examples will be described below together with their effects.

  (A) In the driving support system, a series of processes for monitoring the sensor signals of the first sensor and the second sensor and causing the vehicle to execute a process based on the monitoring result is performed when the vehicle is in an automatic operation. It is preferred that it is sometimes executed. According to this configuration, it is possible to prevent the wearable device from being removed during automatic driving and to monitor the physical condition of the driver during automatic driving, so that automatic driving can be performed safely. Is advantageous.

  (B) In the driving support system, the operation for ensuring the safety of the driver is preferably a warning that the driver has an abnormality. According to this configuration, the driver's abnormality can be notified to the surroundings through a warning that the driver has an abnormality.

  (C) In the driving support system, it is preferable that the operation for ensuring the safety of the driver is an operation for shifting the vehicle to a safety mode. According to this configuration, when the physical condition of the driver is abnormal, the vehicle can be shifted to the safety mode to make it difficult to influence other surrounding vehicles. Therefore, it is possible to avoid disruption of traffic conditions.

  (2) In the driving support system, when the operation processing unit issues a warning for prompting the wearable device to be mounted, and the first sensor changes from OFF to ON within a predetermined time, the second sensor If the second sensor is in the ON state, the warning is canceled. According to this configuration, it is possible to cancel the warning that prompts the user to remount the wearable device.

  (E) In the driving support system, when the first sensor changes from OFF to ON within a certain period of time after the warning for prompting the wearable device to be mounted, the second sensor If the second sensor remains in the OFF state, the vehicle is caused to perform an operation for ensuring the safety of the driver. According to this configuration, when an abnormality occurs in the driver, it is possible to cause the vehicle to perform an operation that ensures the safety of the driver.

  DESCRIPTION OF SYMBOLS 1 ... Vehicle, 2 ... Wearable device, 3 ... Driving support system, 12 ... 1st sensor, 12a ... Acceleration sensor, 13 ... 2nd sensor, 13a ... Heart rate sensor, 16 ... Information acquisition part, 17 ... State monitoring part, 18 ... an operation processing unit, 18a ... a first operation processing unit, 18b ... a second operation processing unit, Sa, Sa1, Sa2 ... sensor signals.

Claims (5)

Each sensor signal is obtained from a first sensor capable of detecting a physical quantity of movement generated in a wearable device worn by a driver of the vehicle and a second sensor capable of detecting biological information of the driver wearing the wearable device. An information acquisition unit to acquire;
A state monitoring unit that monitors the wearing state of the wearable device and the physical condition of the driver based on the sensor signals of the first sensor and the second sensor;
A driving support system comprising: an operation processing unit that causes the vehicle to execute processing according to the monitoring result based on the monitoring result of the state monitoring unit. When the sensor signal of the second sensor is in an off state, the state monitoring unit checks the sensor signal of the first sensor by an interrupt process, and determines wearing information of the wearable device and a physical condition of the driver. The driving support system according to claim 1, wherein the operation processing unit is caused to execute an operation according to the result. When the sensor signal of the first sensor is confirmed by the interrupt process, the state monitoring unit determines that the physical condition of the driver is abnormal if the sensor signal of the first sensor is off, and driving The driving support system according to claim 2, wherein the operation processing unit is configured to execute an operation for ensuring safety of a person. The state monitoring unit determines that the driver has removed the wearable device if the sensor signal of the first sensor is on when the sensor signal of the first sensor is confirmed by the interrupt process. The driving support system according to claim 2 or 3, wherein the operation processing unit is caused to execute a warning for prompting the wearable device to be mounted. A first sensor capable of detecting a physical quantity of movement generated in the wearer;
A second sensor capable of detecting the wearer's biological information;
An information acquisition unit for acquiring each sensor signal from the first sensor and the second sensor;
A state monitoring unit that monitors the wearing state of the wearable device and the physical condition of the driver based on the sensor signals of the first sensor and the second sensor;
A wearable device comprising: an operation processing unit that causes a vehicle to execute a process according to the monitoring result based on the monitoring result of the state monitoring unit.